-- Logs begin at Wed 2022-09-14 08:30:39 UTC, end at Wed 2022-09-14 11:10:53 UTC. -- Sep 14 09:04:39.562658 n-d-851028-12 systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 09:04:39.570902 n-d-851028-12 devstack@n-api.service[106542]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 09:04:39 2022] *** Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: nodename: n-d-851028-12 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: machine: x86_64 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: clock source: unix Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: pcre jit disabled Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: detected number of CPU cores: 4 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: current working directory: / Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: detected binary path: /usr/bin/uwsgi-core Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: your processes number limit is 47680 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: your memory page size is 4096 bytes Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: detected max file descriptor number: 2048 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: lock engine: pthread robust mutexes Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: thunder lock: enabled Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 09:04:39.576613 n-d-851028-12 devstack@n-api.service[106542]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 09:04:39.613820 n-d-851028-12 devstack@n-api.service[106542]: Python main interpreter initialized at 0x561e612db9c0 Sep 14 09:04:39.613820 n-d-851028-12 devstack@n-api.service[106542]: python threads support enabled Sep 14 09:04:39.613820 n-d-851028-12 devstack@n-api.service[106542]: your server socket listen backlog is limited to 100 connections Sep 14 09:04:39.613820 n-d-851028-12 devstack@n-api.service[106542]: your mercy for graceful operations on workers is 90 seconds Sep 14 09:04:39.614651 n-d-851028-12 devstack@n-api.service[106542]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 09:04:39.614651 n-d-851028-12 devstack@n-api.service[106542]: *** Operational MODE: preforking *** Sep 14 09:04:39.614651 n-d-851028-12 devstack@n-api.service[106542]: *** uWSGI is running in multiple interpreter mode *** Sep 14 09:04:39.614651 n-d-851028-12 devstack@n-api.service[106542]: spawned uWSGI master process (pid: 106542) Sep 14 09:04:39.614759 n-d-851028-12 systemd[1]: Started Devstack devstack@n-api.service. Sep 14 09:04:39.615338 n-d-851028-12 devstack@n-api.service[106542]: spawned uWSGI worker 1 (pid: 106543, cores: 1) Sep 14 09:04:39.615630 n-d-851028-12 devstack@n-api.service[106542]: spawned uWSGI worker 2 (pid: 106544, cores: 1) Sep 14 09:04:39.615788 n-d-851028-12 devstack@n-api.service[106542]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 09:04:40.276293 n-d-851028-12 devstack@n-api.service[106544]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 09:04:40.279668 n-d-851028-12 devstack@n-api.service[106543]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 09:04:41.361097 n-d-851028-12 devstack@n-api.service[106544]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:04:41.361097 n-d-851028-12 devstack@n-api.service[106544]: from cryptography.utils import int_from_bytes Sep 14 09:04:41.361719 n-d-851028-12 devstack@n-api.service[106544]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:04:41.361719 n-d-851028-12 devstack@n-api.service[106544]: from cryptography.utils import int_from_bytes Sep 14 09:04:41.362582 n-d-851028-12 devstack@n-api.service[106543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:04:41.362582 n-d-851028-12 devstack@n-api.service[106543]: from cryptography.utils import int_from_bytes Sep 14 09:04:41.363008 n-d-851028-12 devstack@n-api.service[106543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:04:41.363008 n-d-851028-12 devstack@n-api.service[106543]: from cryptography.utils import int_from_bytes Sep 14 09:04:43.909834 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 09:04:43.910425 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 09:04:43.910531 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 09:04:43.910882 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 09:04:43.910975 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 09:04:43.911059 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 09:04:43.911208 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 09:04:43.911328 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 09:04:43.911595 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.911683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 09:04:43.911947 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.912101 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 09:04:43.912438 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.912738 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.912827 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.913073 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.913316 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.913419 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.913685 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.913806 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914009 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914140 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914340 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914481 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914598 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914799 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.914911 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.915150 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.915250 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-12 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.915547 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.915722 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.915852 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916197 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916334 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916484 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916573 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916807 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.916941 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917130 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917253 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-12 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917432 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917518 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917764 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.917928 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918323 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918501 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918574 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918674 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918774 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.918971 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.919433 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.919616 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.919865 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920078 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920209 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920304 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920430 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920548 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920746 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.920845 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.921062 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.921162 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.921549 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.921639 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.921985 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-12 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.922235 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.922321 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.922612 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.922802 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.922927 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.923347 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.923452 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.923658 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.923989 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.924089 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.924323 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.924501 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.924829 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.924917 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925153 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925246 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-12 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925482 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925569 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925800 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.925894 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926118 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926212 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926440 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926603 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926748 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.926925 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.927053 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.927250 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.927363 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.927751 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.927879 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.928208 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.928393 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.928515 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.928767 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.928957 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.929073 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.929393 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.929484 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.929714 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930003 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930090 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930270 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930469 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930806 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.930892 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.931117 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.931380 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.931468 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.931689 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.931776 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932020 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932115 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932327 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932415 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932631 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932726 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.932925 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933019 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933231 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933322 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933535 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933622 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933840 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.933933 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934159 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934244 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934437 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934542 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934696 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.934804 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935022 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935108 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935350 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935443 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935666 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.935765 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936004 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936097 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936325 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936426 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936636 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936791 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.936951 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937039 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937271 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937360 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937583 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937682 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.937936 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.938022 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.938243 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.938337 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.938578 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.938896 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939039 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939207 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939296 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939532 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939654 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.939873 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940039 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940201 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940368 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940463 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940545 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940744 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.940882 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941048 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941164 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941365 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941481 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941670 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941806 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.941975 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942136 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942332 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942470 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942631 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942784 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.942936 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943096 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943240 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943423 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943544 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943763 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.943849 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944098 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944187 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944353 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944440 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944664 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944761 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.944971 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945253 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945338 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945562 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945649 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945867 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.945962 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946181 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946265 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946488 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946577 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946793 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.946926 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947097 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947192 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947406 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947514 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947713 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.947815 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.948045 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.948358 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.948668 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.948979 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.949289 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.949472 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.949608 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.949785 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.949934 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950106 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950260 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950440 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950571 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950755 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.950880 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951068 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951189 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951392 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951498 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951705 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.951824 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952043 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952148 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952368 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952463 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952673 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952767 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.952983 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.953079 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.954077 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.954429 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.954749 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.954950 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955065 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955282 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955393 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955604 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955691 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.955939 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956048 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956257 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956344 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956569 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956659 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.956879 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957016 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957189 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957276 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957499 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957588 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957802 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.957896 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958130 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958217 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958439 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958537 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958750 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.958846 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.959056 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.959380 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.959706 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960042 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960225 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960357 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960549 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960667 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960883 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.960991 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:04:43.961230 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.961317 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.961571 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.961663 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.961919 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962005 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962237 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962332 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962577 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962666 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.962915 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963018 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963239 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963355 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963555 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963642 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.963873 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964036 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964227 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964315 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964540 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964636 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.964860 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965023 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965179 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965291 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965498 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965610 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965821 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.965916 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966154 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966286 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966467 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966555 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966785 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.966911 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967104 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967207 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967417 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967580 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967732 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.967830 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968089 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968176 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968408 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968493 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968721 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.968869 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.969645 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.969786 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.969991 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970080 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970306 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970402 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970632 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970720 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.970956 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971042 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971267 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971356 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971577 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971664 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.971888 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972034 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972251 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972339 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972563 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972656 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972875 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.972969 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973191 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973278 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973500 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973587 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973821 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.973921 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974131 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974224 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974439 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974525 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974749 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.974844 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975061 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975159 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975366 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975452 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975699 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.975842 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976037 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976126 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976360 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976447 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976673 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976770 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.976984 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977083 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977300 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977394 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977609 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977695 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.977917 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978004 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978227 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978321 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978536 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978708 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978839 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.978915 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979138 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979227 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979444 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979532 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979746 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.979832 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980087 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980175 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980414 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980510 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980719 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.980806 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981050 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981148 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981353 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981440 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981660 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981747 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.981967 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982061 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982273 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982371 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982579 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982680 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.982888 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983038 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983191 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983280 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983492 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983585 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983814 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.983929 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.984150 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.984236 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.984497 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.984593 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.984825 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985012 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985191 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985422 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985539 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985741 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.985855 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986028 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986142 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986341 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986450 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986653 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986740 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.986962 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987050 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987285 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987596 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987689 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.987939 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988043 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988258 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988346 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988590 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988679 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988894 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.988981 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989215 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989308 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989536 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989630 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989852 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.989945 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990154 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990242 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990463 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990549 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990764 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.990887 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991068 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991163 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991371 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991467 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991676 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.991764 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992001 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992104 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992306 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992393 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992606 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992694 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.992907 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993003 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993207 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993294 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993512 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993605 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993820 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.993913 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994120 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994207 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994421 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994516 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994723 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.994821 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995027 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995113 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995632 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995739 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995823 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.995944 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996045 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996122 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996385 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996473 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996707 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.996784 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997027 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997112 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997341 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997465 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997654 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997894 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.997988 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998210 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998295 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998530 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998616 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998847 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.998923 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999161 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999260 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999471 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999611 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999803 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:43.999917 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.000302 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.000402 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.000618 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.000741 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.000937 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001078 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001241 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001399 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001726 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.001901 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002029 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002226 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002344 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002540 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002696 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.002861 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003042 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003178 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003353 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003488 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.003792 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004027 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004180 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004348 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004438 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004665 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004752 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.004983 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005070 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005301 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005452 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005615 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005708 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.005926 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006024 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006239 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006346 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006547 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006661 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006862 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.006959 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007163 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007258 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007474 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007561 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007798 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.007884 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008128 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008223 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008448 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008575 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008759 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.008858 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009075 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009163 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009382 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009470 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009690 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009786 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.009997 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010091 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010298 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010376 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010608 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010748 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.010911 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011046 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011218 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011507 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011597 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011820 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.011965 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012156 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012243 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012461 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012559 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012772 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.012858 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013079 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013166 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013383 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013488 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013684 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013771 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.013990 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014083 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014300 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014401 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014604 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014690 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.014923 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.015011 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.015235 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.015329 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.015534 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.015620 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.016409 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.016498 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.016732 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.016867 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017039 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017222 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017340 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017557 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017652 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017872 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.017963 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018183 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018276 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018495 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018590 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018805 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.018893 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019140 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019226 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019454 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019759 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.019854 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020097 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020196 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020406 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020495 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020713 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.020808 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021032 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021119 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021340 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021435 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021644 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021731 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.021953 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022041 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022260 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022348 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022567 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022654 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022875 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.022962 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023187 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023274 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023490 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023575 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023797 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.023933 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024128 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024229 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024431 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024532 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024740 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.024835 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.025051 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.025144 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.025362 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.025678 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.025800 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026004 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026118 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026320 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026576 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026673 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.026910 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027057 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027230 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027328 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027556 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027644 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.027915 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028019 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028232 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028337 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028542 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028667 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028851 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.028972 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029154 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029282 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029457 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029566 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029763 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.029875 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030062 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030166 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030363 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030452 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030668 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030764 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.030975 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.031062 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.031294 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.031441 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032165 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032258 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032470 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032559 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032772 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.032905 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033077 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033164 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033378 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033466 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033685 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033778 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.033984 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034071 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034299 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034386 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034602 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034696 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034903 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.034991 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035204 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035293 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035504 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035593 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035814 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.035966 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036145 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036235 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036455 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036542 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036793 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.036888 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037099 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037185 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037421 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037507 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037723 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.037821 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038044 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038131 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038349 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038437 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038649 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038738 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.038948 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039043 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039252 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039341 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039650 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039852 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.039959 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040187 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040285 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040493 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040580 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040797 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.040890 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041109 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041195 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041509 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041733 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.041827 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042042 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042137 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042347 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042435 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042650 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042736 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.042951 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043054 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043249 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043337 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043641 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.043855 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.044015 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.044442 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.044544 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.044748 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.044843 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045048 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045144 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045352 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045437 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045650 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045736 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.045949 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046038 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046249 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046335 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046552 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046639 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046856 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.046977 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047181 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047268 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047501 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047620 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047807 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.047968 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048140 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048237 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048442 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048519 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048748 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.048827 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049049 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049126 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049350 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049441 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049655 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049733 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.049961 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050049 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050255 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050365 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050564 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050668 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050871 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.050956 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051169 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051268 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051470 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051603 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051770 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.051858 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052097 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052199 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052399 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052494 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052699 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052796 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.052997 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053109 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053295 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053387 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053596 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.053905 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054012 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054210 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054314 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054504 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054616 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054806 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.054897 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055105 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055192 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055414 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055508 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055725 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.055814 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056055 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056145 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056443 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056554 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056711 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.056799 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057072 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057159 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057381 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057476 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057688 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.057776 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058004 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058091 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058305 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058406 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058615 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058703 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.058921 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059010 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059224 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059320 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059522 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059608 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059820 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.059927 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060164 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060269 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060474 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060562 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060779 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.060915 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061096 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061193 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061408 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061494 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061721 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.061808 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062018 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062105 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062322 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062418 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062655 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.062899 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063000 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063083 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063288 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063376 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063601 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063687 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.063930 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064038 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064249 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064342 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064560 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064659 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064870 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.064958 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065178 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065274 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065487 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065588 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065795 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.065882 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066103 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066190 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066405 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066502 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066717 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.066813 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067020 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067107 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067329 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067460 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067636 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067722 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.067965 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068068 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068276 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068364 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068578 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068720 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.068884 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069012 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069199 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069307 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069512 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069656 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069908 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.069996 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070217 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070307 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070547 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070632 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070854 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.070981 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071167 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071263 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071478 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071566 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071795 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.071942 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072139 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072236 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072477 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072614 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072843 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.072974 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073118 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073207 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073419 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073520 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073727 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.073827 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074048 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074142 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074350 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074449 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074651 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074751 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.074953 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075046 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075268 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075354 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075568 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075654 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075872 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.075986 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076219 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076318 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076528 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076624 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076852 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.076939 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077271 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077358 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077593 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077681 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077902 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.077988 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.078831 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.078932 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.079197 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.079293 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.079512 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.079664 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.079838 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080016 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080190 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080335 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080518 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080646 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080826 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.080972 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081142 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081298 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081454 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081610 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081780 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.081925 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082106 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082228 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082420 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082551 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082738 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.082873 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083047 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083185 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083374 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083506 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083699 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.083937 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084028 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084265 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084355 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084574 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084757 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.084893 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085085 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085216 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085399 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085518 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085723 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.085811 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086065 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086194 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086358 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086445 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086666 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086780 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.086979 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087083 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087285 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087379 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087786 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.087958 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088170 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088255 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088486 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088574 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088795 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.088941 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089102 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089190 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089425 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089513 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089732 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.089841 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090059 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090194 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090360 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090448 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090680 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090767 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.090992 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091085 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091301 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091391 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091614 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091702 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.091942 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092073 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092290 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092392 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092645 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092733 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.092952 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.093040 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.093277 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.093375 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.093588 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.093720 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096211 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096353 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096471 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096471 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096634 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096715 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096793 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096872 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.096954 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097090 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097172 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097260 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097349 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097429 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097516 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097593 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097673 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097752 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097830 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097898 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.097985 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098066 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098211 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098361 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098517 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098671 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098828 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.098985 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099133 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099295 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099440 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099605 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099745 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.099931 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100080 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100252 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100384 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100562 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100689 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100870 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.100989 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101178 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101314 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101505 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101619 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101814 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.101942 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102142 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102232 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102456 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102545 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102765 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.102860 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103077 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103182 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103384 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103482 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103731 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.103819 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104061 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104164 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104394 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104481 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104708 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.104793 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105022 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105117 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105337 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105432 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105654 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105777 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.105967 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106065 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106283 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106369 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106596 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.106910 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107007 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107218 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107304 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107529 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107611 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107840 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.107958 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.108186 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.108275 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.108503 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.108749 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109062 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109154 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109386 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109477 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109729 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.109816 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110042 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110121 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110355 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110442 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110676 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110894 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.110986 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111077 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111304 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111441 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111638 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111742 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.111977 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112072 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112294 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112380 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112618 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112718 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.112943 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113030 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113275 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113362 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113596 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113685 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113910 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.113998 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114224 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114313 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114538 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114626 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114856 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.114987 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115195 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115302 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115495 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115608 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115814 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.115974 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116149 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116249 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116460 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116549 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116770 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.116858 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117079 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117181 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117393 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117480 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117702 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.117788 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118012 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118134 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118323 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118434 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118640 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118758 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.118947 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119035 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119276 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119375 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119605 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119690 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.119941 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120046 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120257 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120345 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120571 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120672 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120888 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.120994 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.121248 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.121390 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.121707 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.121818 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122040 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122128 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122361 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122457 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122683 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122782 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.122999 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123086 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123311 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123408 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123635 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123733 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.123960 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124049 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124264 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124351 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124571 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124661 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124877 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.124965 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.125292 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.125437 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.125626 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.125853 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.125939 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126018 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126232 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126321 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126542 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126647 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126864 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.126963 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.127175 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.127395 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.127715 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.127814 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128077 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128179 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128398 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128493 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128722 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.128808 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129036 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129124 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129341 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129437 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129652 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129736 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.129955 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130043 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130259 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130360 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130570 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130663 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130877 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.130963 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131180 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131268 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131484 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131580 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131792 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.131970 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132125 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132214 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132429 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132516 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132735 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.132820 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133036 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133161 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133349 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133435 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133649 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133735 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.133953 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134043 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134255 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134345 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134562 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134657 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134864 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.134959 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.135215 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.135655 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.135758 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.135857 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.135963 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136059 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136141 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136227 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136365 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136463 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136671 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136760 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.136972 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137060 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137280 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137380 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137600 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137690 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.137926 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138020 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138226 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138323 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138544 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138630 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138843 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.138937 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139144 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139233 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139459 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139547 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139766 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.139853 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.140108 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.140198 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.140417 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.140504 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.141255 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.141489 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.141590 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.141674 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.141900 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.142003 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.142327 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.142413 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.142748 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.142869 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143066 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143207 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143397 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143530 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143725 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.143868 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144037 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144228 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144347 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144542 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144651 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144857 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.144973 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145168 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145293 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145498 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145588 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145815 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.145903 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146134 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146230 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146450 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146537 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146755 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.146841 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147061 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147161 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147369 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147470 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147676 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.147764 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148009 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148112 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148317 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148404 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148623 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148717 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.148930 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149019 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149236 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149323 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149547 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149634 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149860 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.149949 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150178 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150265 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150493 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150586 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150808 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.150896 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151119 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151215 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151427 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151529 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151733 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.151821 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152065 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152155 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152373 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152473 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152769 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.152997 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153093 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153304 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153399 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153606 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153705 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.153940 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.154251 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.154351 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.154600 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.154919 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155006 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155239 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155327 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155549 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155638 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.155869 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.156032 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.156210 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.156349 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157135 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157224 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157477 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157604 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157788 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.157934 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158121 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158262 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158463 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158597 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158791 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.158923 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.159242 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.159376 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.159576 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.159690 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160078 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160214 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160325 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160432 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160538 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160643 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160832 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.160955 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.161148 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.161263 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.163723 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.163866 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.163988 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164064 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164133 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164215 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164215 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164360 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164449 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164538 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164626 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164707 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164786 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164864 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.164864 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165024 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165105 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165199 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165279 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165358 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165444 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165522 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165590 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165669 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165754 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165845 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.165926 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166005 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166090 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166170 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166248 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166334 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166415 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166493 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166579 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166659 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166857 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.166986 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.167921 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168047 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168124 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168193 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168262 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168348 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168499 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168580 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168659 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168755 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.168828 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.169059 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.169426 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.169638 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.169970 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170151 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170320 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170495 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170590 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170824 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.170920 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.171178 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.171270 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.171459 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.171553 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172445 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172541 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172614 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172683 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172750 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172817 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.172923 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173032 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173237 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173319 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173549 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173689 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173862 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.173963 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174193 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174291 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174520 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174608 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174827 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.174923 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175154 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175250 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175470 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175567 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175790 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.175878 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176134 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176224 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176446 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176547 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176778 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.176866 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177088 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177176 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177400 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177496 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177709 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.177844 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178023 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178111 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178333 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178646 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178733 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.178956 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179043 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179266 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179354 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179579 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179666 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.179915 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180017 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180239 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180328 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180565 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180659 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180873 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.180970 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181196 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181283 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181642 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181750 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181868 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.181971 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182178 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182266 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182518 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182613 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182846 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.182944 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183158 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183247 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183467 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183554 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183771 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.183867 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:04:44.184039 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 09:04:44.184127 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106544) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 09:04:44.340303 n-d-851028-12 devstack@n-api.service[106543]: INFO dbcounter [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Registered counter for database nova_api Sep 14 09:04:44.341834 n-d-851028-12 devstack@n-api.service[106544]: INFO dbcounter [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Registered counter for database nova_api Sep 14 09:04:44.360567 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_db.sqlalchemy.engines [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.362441 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_db.sqlalchemy.engines [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.367761 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writer thread running {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.369078 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writer thread running {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.427358 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.context [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=106543) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 09:04:44.427550 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.context [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=106544) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 09:04:44.432869 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.433348 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.434920 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.435666 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.436140 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.438765 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_concurrency.lockutils [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106544) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.440770 n-d-851028-12 devstack@n-api.service[106544]: INFO dbcounter [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Registered counter for database nova_cell0 Sep 14 09:04:44.441955 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.443007 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.444691 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.444964 n-d-851028-12 devstack@n-api.service[106544]: INFO dbcounter [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Registered counter for database nova_cell1 Sep 14 09:04:44.445468 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:04:44.445917 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:04:44.447950 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:04:44.450001 n-d-851028-12 devstack@n-api.service[106543]: INFO dbcounter [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Registered counter for database nova_cell0 Sep 14 09:04:44.452193 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_db.sqlalchemy.engines [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.454472 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_db.sqlalchemy.engines [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.455153 n-d-851028-12 devstack@n-api.service[106543]: INFO dbcounter [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Registered counter for database nova_cell1 Sep 14 09:04:44.459834 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writer thread running {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.462225 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_db.sqlalchemy.engines [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.466858 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writer thread running {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.467503 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_db.sqlalchemy.engines [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.602526 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writer thread running {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.613896 n-d-851028-12 devstack@n-api.service[106544]: INFO dbcounter [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Registered counter for database nova_cell0 Sep 14 09:04:44.617931 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writer thread running {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.620577 n-d-851028-12 devstack@n-api.service[106544]: DEBUG oslo_db.sqlalchemy.engines [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106544) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.626378 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writer thread running {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.628082 n-d-851028-12 devstack@n-api.service[106543]: INFO dbcounter [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Registered counter for database nova_cell0 Sep 14 09:04:44.636813 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_db.sqlalchemy.engines [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:04:44.641215 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writer thread running {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:04:44.978449 n-d-851028-12 devstack@n-api.service[106543]: WARNING keystonemiddleware.auth_token [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:04:44.979401 n-d-851028-12 devstack@n-api.service[106544]: WARNING keystonemiddleware.auth_token [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:04:44.986458 n-d-851028-12 devstack@n-api.service[106543]: WARNING keystonemiddleware.auth_token [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:04:44.987680 n-d-851028-12 devstack@n-api.service[106544]: WARNING keystonemiddleware.auth_token [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:04:45.333390 n-d-851028-12 devstack@n-api.service[106543]: WARNING keystonemiddleware.auth_token [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:04:45.339793 n-d-851028-12 devstack@n-api.service[106543]: WARNING keystonemiddleware.auth_token [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:04:45.342931 n-d-851028-12 devstack@n-api.service[106544]: WARNING keystonemiddleware.auth_token [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:04:45.345560 n-d-851028-12 devstack@n-api.service[106543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e612db9c0 pid: 106543 (default app) Sep 14 09:04:45.347693 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:04:45.348935 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001832 Sep 14 09:04:45.349347 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 788 bytes} [Wed Sep 14 09:04:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:04:45.349499 n-d-851028-12 devstack@n-api.service[106544]: WARNING keystonemiddleware.auth_token [None req-d222c3bb-4238-41df-9da2-c5e4f6f4cb5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:04:45.354780 n-d-851028-12 devstack@n-api.service[106544]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561e612db9c0 pid: 106544 (default app) Sep 14 09:06:11.650198 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:11.651115 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 14 09:06:11.651715 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 2/2] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:11.665874 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_api:SELECT=3 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:11.667037 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_cell0:SELECT=3 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:11.667763 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_cell1:SELECT=3 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:11.668526 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:12.553551 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9d1a7e0a-dcd5-43fe-a787-aac134bfe7d9 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:12.586593 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9d1a7e0a-dcd5-43fe-a787-aac134bfe7d9 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927423 Sep 14 09:06:12.587937 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 1/3] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 09:06:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:15.425704 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:15.426856 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-fd075994-6612-4e45-939d-785ebde29ee9 None None] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 14 09:06:15.431942 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 3/4] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:15.889874 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-f10633fa-3c5b-40e5-a791-9735b5e5faf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:15.940032 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-f10633fa-3c5b-40e5-a791-9735b5e5faf2 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505160 Sep 14 09:06:15.940607 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 2/5] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:15.956906 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_api:SELECT=3 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:15.958638 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_cell0:SELECT=3 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:15.960322 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_cell1:SELECT=3 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:15.962898 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:16.179861 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-7ecdcb80-def4-42b1-b548-0656902139cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:16.251563 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-7ecdcb80-def4-42b1-b548-0656902139cb admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301964 Sep 14 09:06:16.252475 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 4/6] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Sep 14 09:06:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:18.959582 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-f10633fa-3c5b-40e5-a791-9735b5e5faf2 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:18.960631 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-f10633fa-3c5b-40e5-a791-9735b5e5faf2 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 14 09:06:18.961288 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 3/7] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:19.843463 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-86677ca2-fa06-40f4-847f-7d3d318862bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:19.903607 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-86677ca2-fa06-40f4-847f-7d3d318862bc admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.935445 Sep 14 09:06:19.905950 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 5/8] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:06:19.920587 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-513e7d86-3290-473c-8b1c-3181f4c3fbad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:19.973719 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-513e7d86-3290-473c-8b1c-3181f4c3fbad admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057261 Sep 14 09:06:19.975285 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 4/9] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Sep 14 09:06:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:23.277057 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-86677ca2-fa06-40f4-847f-7d3d318862bc admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:23.277952 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-86677ca2-fa06-40f4-847f-7d3d318862bc admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 14 09:06:23.278511 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 6/10] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:23.746855 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-faa9ca7c-6f2e-42d5-b6d8-17c0cae5ddba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "vcpus": 1, "name": "ds1G"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:23.767330 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-faa9ca7c-6f2e-42d5-b6d8-17c0cae5ddba admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480788 Sep 14 09:06:23.768219 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 5/11] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:23.782039 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-ba8f8dfa-ac49-427d-b822-3e19fe943192 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:23.812923 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-ba8f8dfa-ac49-427d-b822-3e19fe943192 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036273 Sep 14 09:06:23.815934 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 7/12] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Sep 14 09:06:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:26.538708 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-faa9ca7c-6f2e-42d5-b6d8-17c0cae5ddba admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:26.539739 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-faa9ca7c-6f2e-42d5-b6d8-17c0cae5ddba admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 14 09:06:26.540193 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 6/13] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:27.039060 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-a80bdbf6-d21f-4ce4-948d-2fe27046d01c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:27.059746 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-a80bdbf6-d21f-4ce4-948d-2fe27046d01c admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512679 Sep 14 09:06:27.060758 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 8/14] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:27.072913 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-69f67ecc-e0a8-4af3-8b1f-e9bd0d820ed5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:27.110501 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-69f67ecc-e0a8-4af3-8b1f-e9bd0d820ed5 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041270 Sep 14 09:06:27.112797 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 7/15] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Sep 14 09:06:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:30.140705 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-a80bdbf6-d21f-4ce4-948d-2fe27046d01c admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:30.142325 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-a80bdbf6-d21f-4ce4-948d-2fe27046d01c admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Sep 14 09:06:30.149817 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 9/16] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:30 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:30.752827 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:30.786506 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.636426 Sep 14 09:06:30.788357 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 8/17] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:30.800791 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-457fbde4-004a-49e4-8ccb-b6b1f5e14058 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:30.827291 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-457fbde4-004a-49e4-8ccb-b6b1f5e14058 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030095 Sep 14 09:06:30.828589 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 10/18] 10.222.0.90 () {64 vars in 1336 bytes} [Wed Sep 14 09:06:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:33.724777 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:33.725835 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Sep 14 09:06:33.726678 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 9/19] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:34.346925 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-315dc6b3-f7e2-46cf-b433-1bb3ae8405e2 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:34.393267 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-315dc6b3-f7e2-46cf-b433-1bb3ae8405e2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.654820 Sep 14 09:06:34.394203 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 11/20] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 09:06:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:06:37.666180 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:37.667273 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-8488d682-d8de-4ef1-8517-3cf428b1452e admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 14 09:06:37.667696 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 10/21] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:38.148421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-57f7d2a4-d3df-4aea-8c25-73153ef8b199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:38.183756 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-57f7d2a4-d3df-4aea-8c25-73153ef8b199 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.507897 Sep 14 09:06:38.184720 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 12/22] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:38.199625 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9157fc6e-2b26-4cbe-afb7-e8d3dee0c300 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:38.243943 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9157fc6e-2b26-4cbe-afb7-e8d3dee0c300 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048947 Sep 14 09:06:38.245163 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 11/23] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Sep 14 09:06:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:06:41.042625 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-57f7d2a4-d3df-4aea-8c25-73153ef8b199 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:41.043654 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-57f7d2a4-d3df-4aea-8c25-73153ef8b199 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 14 09:06:41.044884 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 13/24] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:41.534618 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-28c6f11a-e426-48e7-ab95-7b86aa15a496 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:41.557719 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-28c6f11a-e426-48e7-ab95-7b86aa15a496 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506268 Sep 14 09:06:41.558284 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 12/25] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:41.572478 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-36ed501c-3f1f-4449-840c-1e5db100befd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:41.598238 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-36ed501c-3f1f-4449-840c-1e5db100befd admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030092 Sep 14 09:06:41.598824 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 14/26] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Sep 14 09:06:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:44.275477 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-28c6f11a-e426-48e7-ab95-7b86aa15a496 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:44.276526 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-28c6f11a-e426-48e7-ab95-7b86aa15a496 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 14 09:06:44.277123 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 13/27] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:44.662087 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-ced2e38b-27e3-4f34-9df8-c6f6782a1c1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:44.686058 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-ced2e38b-27e3-4f34-9df8-c6f6782a1c1f admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.402071 Sep 14 09:06:44.686774 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 15/28] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:06:44.698831 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-46b5241d-83e7-48e5-bc54-9282db939eb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:44.704418 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:44.730096 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-46b5241d-83e7-48e5-bc54-9282db939eb4 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034848 Sep 14 09:06:44.730813 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 14/29] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Sep 14 09:06:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:47.412838 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-ced2e38b-27e3-4f34-9df8-c6f6782a1c1f admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:47.414264 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-ced2e38b-27e3-4f34-9df8-c6f6782a1c1f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Sep 14 09:06:47.419291 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 16/30] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:47.881990 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-668f864f-72be-42fb-a3f5-9f69edc2a051 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "ram": 8192, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:47.906181 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-668f864f-72be-42fb-a3f5-9f69edc2a051 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485079 Sep 14 09:06:47.907985 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 15/31] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:47.919115 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-735e8f9d-989d-4fcb-80b6-5de0e8344d15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:47.925514 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:06:47.950860 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-735e8f9d-989d-4fcb-80b6-5de0e8344d15 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035383 Sep 14 09:06:47.951774 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 17/32] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Sep 14 09:06:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:06:50.628272 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-668f864f-72be-42fb-a3f5-9f69edc2a051 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:06:50.629951 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-668f864f-72be-42fb-a3f5-9f69edc2a051 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Sep 14 09:06:50.630353 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 16/33] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:06:51.110885 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "name": "m1.xlarge"}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:51.133855 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497106 Sep 14 09:06:51.134622 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 18/34] 10.222.0.90 () {64 vars in 1283 bytes} [Wed Sep 14 09:06:50 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:06:51.146434 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-38dc207a-55e1-414e-8621-257956f5b4b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:06:51.180435 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-38dc207a-55e1-414e-8621-257956f5b4b5 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037522 Sep 14 09:06:51.181569 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 17/35] 10.222.0.90 () {64 vars in 1333 bytes} [Wed Sep 14 09:06:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:07:11.129777 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:11.130710 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 14 09:07:11.131123 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 19/36] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:11.143286 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:11.533835 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-7ca09102-ec21-4590-90f8-e6e35493e8c3 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:11.552617 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-7ca09102-ec21-4590-90f8-e6e35493e8c3 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415342 Sep 14 09:07:11.553165 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 18/37] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 09:07:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:07:12.884851 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:12.886037 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-15db1917-782a-4eec-9f81-dcb82ad542e4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 14 09:07:12.886503 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 20/38] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:13.446967 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-585b2fe9-60d0-4ad3-b3c5-036848dceee2 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.452962 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.wsgi [None req-585b2fe9-60d0-4ad3-b3c5-036848dceee2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-585b2fe9-60d0-4ad3-b3c5-036848dceee2 admin admin] Request method failure captured: Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Accept: application/json Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Accept-Encoding: gzip, deflate Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Connection: keep-alive Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Content-Length: 0 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Host: 10.222.0.90 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: Openstack-System-Scope: None Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: User-Agent: python-novaclient Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Auth-Token: gAAAAABjIZnAf_NeKONLN-FkJpoyj3W39d00MLC5iJBGD1CtNo86dREoB34JU5WTgLPWhQ6plksRYIZTm6OQzWw71YXpV7Hlt48XWtREFQNsCH-sGFYxL-wXc2zv13_aMEkmlPp3WTzdwmgSaU8T_3BdZXWgKQYiEgTraO_Kp5O6X26WHOGkDGs Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Id: None Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Name: None Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Identity-Status: Confirmed Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Is-Admin-Project: True Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Id: default Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Name: Default Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Name: admin Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Role: admin,member,reader Sep 14 09:07:13.456251 n-d-851028-12 devstack@n-api.service[106544]: X-Roles: admin,member,reader Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant: admin Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Name: admin Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-User: admin Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Id: default Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Name: Default Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: X-User-Name: admin Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: method: > Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: exception: Flavor 42 could not be found. Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: action_args: {'id': '42'} Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:13.457827 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:13.458797 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.460178 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-585b2fe9-60d0-4ad3-b3c5-036848dceee2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:13.461520 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-585b2fe9-60d0-4ad3-b3c5-036848dceee2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.413604 Sep 14 09:07:13.461520 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 19/39] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:13.467575 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-0676e918-3893-467c-a805-ad21557664d4 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.471797 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:07:13.491179 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-0676e918-3893-467c-a805-ad21557664d4 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027227 Sep 14 09:07:13.491736 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 21/40] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:13.508167 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-ae22e8f8-76e4-41e7-9a13-1ebc78fee01f admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.531228 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-ae22e8f8-76e4-41e7-9a13-1ebc78fee01f admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027451 Sep 14 09:07:13.531767 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 20/41] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:13.541100 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-51911416-668a-4c44-a55c-408cb4288b26 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:13.547755 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.wsgi [None req-51911416-668a-4c44-a55c-408cb4288b26 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-51911416-668a-4c44-a55c-408cb4288b26 admin admin] Request method failure captured: Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Accept: application/json Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Accept-Encoding: gzip, deflate Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Connection: keep-alive Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Content-Length: 0 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Host: 10.222.0.90 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: Openstack-System-Scope: None Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: User-Agent: python-novaclient Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Auth-Token: gAAAAABjIZnAf_NeKONLN-FkJpoyj3W39d00MLC5iJBGD1CtNo86dREoB34JU5WTgLPWhQ6plksRYIZTm6OQzWw71YXpV7Hlt48XWtREFQNsCH-sGFYxL-wXc2zv13_aMEkmlPp3WTzdwmgSaU8T_3BdZXWgKQYiEgTraO_Kp5O6X26WHOGkDGs Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Id: None Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Name: None Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Identity-Status: Confirmed Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Is-Admin-Project: True Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Id: default Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Name: Default Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Name: admin Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Role: admin,member,reader Sep 14 09:07:13.551033 n-d-851028-12 devstack@n-api.service[106543]: X-Roles: admin,member,reader Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant: admin Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Name: admin Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-User: admin Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Id: default Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Name: Default Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: X-User-Name: admin Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: method: > Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: exception: Flavor 42 could not be found. Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: action_args: {'id': '42'} Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:13.552598 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:13.553526 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:13.554752 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-51911416-668a-4c44-a55c-408cb4288b26 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:13.555885 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-51911416-668a-4c44-a55c-408cb4288b26 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014971 Sep 14 09:07:13.555885 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 22/42] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:07:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:14.785797 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-ae22e8f8-76e4-41e7-9a13-1ebc78fee01f admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:14.786812 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-ae22e8f8-76e4-41e7-9a13-1ebc78fee01f admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 14 09:07:14.787216 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 21/43] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:15.322761 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-f2250cc3-c94a-4396-8577-3112177e4c50 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.328047 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.wsgi [None req-f2250cc3-c94a-4396-8577-3112177e4c50 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-f2250cc3-c94a-4396-8577-3112177e4c50 admin admin] Request method failure captured: Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Accept: application/json Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Accept-Encoding: gzip, deflate Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Connection: keep-alive Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Content-Length: 0 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Host: 10.222.0.90 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: Openstack-System-Scope: None Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: User-Agent: python-novaclient Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Auth-Token: gAAAAABjIZnCmb4f_OSzanv51vcJLb9R7v4qxJgRzfAKnr2L_6-tS_Khvf1bhjTP7lh4032SU973psGKfDl9bjdG9JrT8xCLGoCXx1jAkWS9bgHwKwJgaZobDr8UJVLqRqCXaGvbDXV71jRLOYclQxnOv9sC8Uk6yNBMkqURp--xC-_cyOjYoCI Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Id: None Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Name: None Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Identity-Status: Confirmed Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Is-Admin-Project: True Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Id: default Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Name: Default Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Name: admin Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Role: admin,member,reader Sep 14 09:07:15.329564 n-d-851028-12 devstack@n-api.service[106543]: X-Roles: admin,member,reader Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant: admin Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Name: admin Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-User: admin Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Id: default Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Name: Default Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: X-User-Name: admin Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: method: > Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: exception: Flavor 84 could not be found. Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: action_args: {'id': '84'} Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:15.331118 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:15.332164 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.333486 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-f2250cc3-c94a-4396-8577-3112177e4c50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:15.334717 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-f2250cc3-c94a-4396-8577-3112177e4c50 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.403930 Sep 14 09:07:15.334717 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 23/44] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:07:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:15.340997 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-01f097ed-ff71-4e74-a886-79431fd0b37e admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.356267 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-01f097ed-ff71-4e74-a886-79431fd0b37e admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019072 Sep 14 09:07:15.356803 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 22/45] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:15.366963 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-8ce66410-8574-4d3b-9147-fae3fc8e44dc admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.383160 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-8ce66410-8574-4d3b-9147-fae3fc8e44dc admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019794 Sep 14 09:07:15.383695 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 24/46] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:15.393146 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-728adc73-138e-4a7e-a4b3-800c2cad7ad9 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:15.398177 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.wsgi [None req-728adc73-138e-4a7e-a4b3-800c2cad7ad9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-728adc73-138e-4a7e-a4b3-800c2cad7ad9 admin admin] Request method failure captured: Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Accept: application/json Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Accept-Encoding: gzip, deflate Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Connection: keep-alive Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Content-Length: 0 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Host: 10.222.0.90 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: Openstack-System-Scope: None Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: User-Agent: python-novaclient Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Auth-Token: gAAAAABjIZnCmb4f_OSzanv51vcJLb9R7v4qxJgRzfAKnr2L_6-tS_Khvf1bhjTP7lh4032SU973psGKfDl9bjdG9JrT8xCLGoCXx1jAkWS9bgHwKwJgaZobDr8UJVLqRqCXaGvbDXV71jRLOYclQxnOv9sC8Uk6yNBMkqURp--xC-_cyOjYoCI Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Id: None Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Name: None Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Identity-Status: Confirmed Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Is-Admin-Project: True Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Id: default Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Name: Default Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Name: admin Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Role: admin,member,reader Sep 14 09:07:15.399680 n-d-851028-12 devstack@n-api.service[106544]: X-Roles: admin,member,reader Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant: admin Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Name: admin Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-User: admin Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Id: default Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Name: Default Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: X-User-Name: admin Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: method: > Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: exception: Flavor 84 could not be found. Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: action_args: {'id': '84'} Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:15.401227 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:15.402248 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:15.403670 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-728adc73-138e-4a7e-a4b3-800c2cad7ad9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:15.404910 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-728adc73-138e-4a7e-a4b3-800c2cad7ad9 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011610 Sep 14 09:07:15.404910 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 23/47] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:07:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:16.635836 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-8ce66410-8574-4d3b-9147-fae3fc8e44dc admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:16.636912 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-8ce66410-8574-4d3b-9147-fae3fc8e44dc admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 14 09:07:16.637303 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 25/48] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:17.181399 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-c425e798-0399-47e5-9c75-948ffc99a640 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.187993 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.wsgi [None req-c425e798-0399-47e5-9c75-948ffc99a640 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-c425e798-0399-47e5-9c75-948ffc99a640 admin admin] Request method failure captured: Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Accept: application/json Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Accept-Encoding: gzip, deflate Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Connection: keep-alive Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Content-Length: 0 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Host: 10.222.0.90 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: Openstack-System-Scope: None Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: User-Agent: python-novaclient Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Auth-Token: gAAAAABjIZnEVlfuSr8MB077utk9ar1jnmzuwudjduM-xnJl-AEIf-yaHu0bBz_myZ3cexezwvCw3bzkGXJTHsY0Wp5Qet0SgmEOBD3y_ZHrFRpEDUm1KR9GYGNqZcV2z-71wBozcE8VKh2EwpfFti2JmafVZ2LWcIzHyeY81wI-gMYtMOqJwgw Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Id: None Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Domain-Name: None Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Identity-Status: Confirmed Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Is-Admin-Project: True Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Id: default Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Domain-Name: Default Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Project-Name: admin Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Role: admin,member,reader Sep 14 09:07:17.189476 n-d-851028-12 devstack@n-api.service[106544]: X-Roles: admin,member,reader Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant: admin Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-Tenant-Name: admin Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-User: admin Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Id: default Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-User-Domain-Name: Default Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: X-User-Name: admin Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: method: > Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: exception: Flavor 451 could not be found. Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: action_args: {'id': '451'} Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:17.191024 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:17.192040 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.193327 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-c425e798-0399-47e5-9c75-948ffc99a640 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106544) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:17.194656 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-c425e798-0399-47e5-9c75-948ffc99a640 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.406732 Sep 14 09:07:17.194656 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 24/49] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:07:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:17.200629 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-fe88cab5-d895-46f0-a537-108dfc31d2a4 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.216573 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-fe88cab5-d895-46f0-a537-108dfc31d2a4 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019513 Sep 14 09:07:17.217108 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 26/50] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:07:17.226757 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.241998 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018758 Sep 14 09:07:17.242516 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 25/51] 10.222.0.90 () {60 vars in 1210 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:07:17.253232 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-9447c9d3-b50a-4476-907d-b1d27be00a53 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:17.258189 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.wsgi [None req-9447c9d3-b50a-4476-907d-b1d27be00a53 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-9447c9d3-b50a-4476-907d-b1d27be00a53 admin admin] Request method failure captured: Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Accept: application/json Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Accept-Encoding: gzip, deflate Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Connection: keep-alive Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Content-Length: 0 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Host: 10.222.0.90 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Openstack-Api-Version: compute 2.92 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: Openstack-System-Scope: None Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: User-Agent: python-novaclient Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Auth-Token: gAAAAABjIZnEVlfuSr8MB077utk9ar1jnmzuwudjduM-xnJl-AEIf-yaHu0bBz_myZ3cexezwvCw3bzkGXJTHsY0Wp5Qet0SgmEOBD3y_ZHrFRpEDUm1KR9GYGNqZcV2z-71wBozcE8VKh2EwpfFti2JmafVZ2LWcIzHyeY81wI-gMYtMOqJwgw Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Id: None Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Domain-Name: None Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Identity-Status: Confirmed Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Is-Admin-Project: True Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Openstack-Nova-Api-Version: 2.92 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Id: default Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Domain-Name: Default Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Project-Name: admin Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Role: admin,member,reader Sep 14 09:07:17.259686 n-d-851028-12 devstack@n-api.service[106543]: X-Roles: admin,member,reader Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fd73f6a574ff4cc18240414a093672c1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fd73f6a574ff4cc18240414a093672c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fd73f6a574ff4cc18240414a093672c1"}]}] Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant: admin Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Id: fd73f6a574ff4cc18240414a093672c1 Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-Tenant-Name: admin Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-User: admin Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Id: default Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-User-Domain-Name: Default Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-User-Id: 8212a5135c3942048ef8aaeb9eccac06 Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: X-User-Name: admin Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: method: > Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: exception: Flavor 451 could not be found. Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: action_args: {'id': '451'} Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:07:17.261095 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:17.261916 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: ERROR nova.api.openstack.wsgi Sep 14 09:07:17.263071 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-9447c9d3-b50a-4476-907d-b1d27be00a53 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106543) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:07:17.264176 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-9447c9d3-b50a-4476-907d-b1d27be00a53 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012955 Sep 14 09:07:17.264176 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 27/52] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:07:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:07:18.517017 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:18.518016 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 14 09:07:18.518418 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 26/53] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:19.048309 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-f6ec1add-1cf9-4368-bffa-1f3d00723985 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:19.068338 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-f6ec1add-1cf9-4368-bffa-1f3d00723985 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.410844 Sep 14 09:07:19.068813 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 28/54] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Sep 14 09:07:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:07:20.307289 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:20.308406 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Sep 14 09:07:20.308804 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 27/55] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:20.852487 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-179ce3e4-7b30-43f3-a1e5-64efc99ddc27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:20.871266 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-179ce3e4-7b30-43f3-a1e5-64efc99ddc27 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.425272 Sep 14 09:07:20.871801 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 29/56] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Sep 14 09:07:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:07:22.118842 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:22.119848 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 14 09:07:22.120315 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 28/57] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:22.660737 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-629b338a-6f65-4a91-a5d3-39c672304320 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:22.681789 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-629b338a-6f65-4a91-a5d3-39c672304320 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.412905 Sep 14 09:07:22.682364 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 30/58] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Sep 14 09:07:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:07:23.933756 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:23.934767 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 14 09:07:23.935158 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 29/59] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:24.479677 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-a943b68f-1f62-46ef-b5f6-a644d8f854a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:07:24.498388 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-a943b68f-1f62-46ef-b5f6-a644d8f854a3 admin admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.422250 Sep 14 09:07:24.498928 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 31/60] 10.222.0.90 () {64 vars in 1235 bytes} [Wed Sep 14 09:07:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:07:25.751638 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:25.752786 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Sep 14 09:07:25.753248 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 30/61] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:07:26.279343 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-f842dc96-9c16-4ae7-8108-da3fa636ca99 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:07:26.301816 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-f842dc96-9c16-4ae7-8108-da3fa636ca99 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409004 Sep 14 09:07:26.302354 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 32/62] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Sep 14 09:07:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:24.414644 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.415844 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-9175076c-22d5-43aa-b594-191a8bbc61f4 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Sep 14 09:08:24.416362 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 31/63] 10.222.0.90 () {54 vars in 931 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:08:24.428009 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:24.856349 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-35176234-7192-4584-95d2-0d20e212eccd admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.877981 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-35176234-7192-4584-95d2-0d20e212eccd admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.454260 Sep 14 09:08:24.878533 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 33/64] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:08:24.900036 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_api:SELECT=14 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:08:24.903961 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-f070834c-dbfc-4d74-8f84-43ee6778bac2 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.912152 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-f070834c-dbfc-4d74-8f84-43ee6778bac2 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013438 Sep 14 09:08:24.912718 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 32/65] 10.222.0.90 () {60 vars in 1283 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:08:24.928653 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-63af65df-6b97-4d35-a426-ad5c6a87cd58 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.939909 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-63af65df-6b97-4d35-a426-ad5c6a87cd58 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017846 Sep 14 09:08:24.940386 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 34/66] 10.222.0.90 () {60 vars in 1286 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:24.953466 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.961539 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012403 Sep 14 09:08:24.962086 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 33/67] 10.222.0.90 () {60 vars in 1286 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:08:24.974391 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-5910a872-6a18-41e0-9cda-7867df2bc4a8 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:08:24.983314 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-5910a872-6a18-41e0-9cda-7867df2bc4a8 admin admin] 10.222.0.90 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012499 Sep 14 09:08:24.983873 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 35/68] 10.222.0.90 () {60 vars in 1283 bytes} [Wed Sep 14 09:08:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:14:15.885138 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:15.886189 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 14 09:14:15.886595 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 34/69] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:16.026297 n-d-851028-12 devstack@n-api.service[106543]: DEBUG dbcounter [-] [106543] Writing DB stats nova_api:SELECT=6 {{(pid=106543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:14:16.168723 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:16.173976 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:16.174421 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:16.174851 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:16.175573 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:16.176040 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:16.176727 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:16.216240 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-ab9d2f0f-036e-469f-82ed-04377c6d1f50 admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.191013 Sep 14 09:14:16.216806 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 36/70] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:14:16 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:14:17.322620 n-d-851028-12 devstack@n-api.service[106544]: DEBUG nova.api.openstack.wsgi [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] Calling method '>' {{(pid=106544) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:17.324391 n-d-851028-12 devstack@n-api.service[106544]: INFO nova.api.openstack.requestlog [None req-e7859a43-8f37-41d4-8d57-2964dd28b4b3 admin admin] 10.222.0.90 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Sep 14 09:14:17.324816 n-d-851028-12 devstack@n-api.service[106544]: [pid: 106544|app: 0|req: 35/71] 10.222.0.90 () {56 vars in 1074 bytes} [Wed Sep 14 09:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:14:17.528200 n-d-851028-12 devstack@n-api.service[106543]: DEBUG nova.api.openstack.wsgi [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Calling method '>' {{(pid=106543) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:14:17.533223 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:17.533704 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:17.534146 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:17.534874 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:14:17.535323 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:14:17.535766 n-d-851028-12 devstack@n-api.service[106543]: DEBUG oslo_concurrency.lockutils [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106543) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:14:17.559391 n-d-851028-12 devstack@n-api.service[106543]: INFO nova.api.openstack.requestlog [None req-012601ae-1ca6-4e7b-8b6f-2a509b8b253f admin admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.095316 Sep 14 09:14:17.559984 n-d-851028-12 devstack@n-api.service[106543]: [pid: 106543|app: 0|req: 37/72] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:14:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:02.377074 n-d-851028-12 devstack@n-api.service[106542]: Wed Sep 14 09:15:02 2022 - graceful shutdown triggered... Sep 14 09:15:02.377306 n-d-851028-12 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 14 09:15:02.379907 n-d-851028-12 devstack@n-api.service[106543]: Gracefully killing worker 1 (pid: 106543)... Sep 14 09:15:02.380319 n-d-851028-12 devstack@n-api.service[106544]: Gracefully killing worker 2 (pid: 106544)... Sep 14 09:15:02.514150 n-d-851028-12 devstack@n-api.service[106544]: DEBUG dbcounter [-] [106544] Writing DB stats nova_api:SELECT=4 {{(pid=106544) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:03.378726 n-d-851028-12 devstack@n-api.service[106542]: worker 1 buried after 1 seconds Sep 14 09:15:03.378726 n-d-851028-12 devstack@n-api.service[106542]: worker 2 buried after 1 seconds Sep 14 09:15:03.378726 n-d-851028-12 devstack@n-api.service[106542]: goodbye to uWSGI. Sep 14 09:15:03.380760 n-d-851028-12 systemd[1]: devstack@n-api.service: Succeeded. Sep 14 09:15:03.381352 n-d-851028-12 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 14 09:15:03.384176 n-d-851028-12 systemd[1]: Starting Devstack devstack@n-api.service... Sep 14 09:15:03.399922 n-d-851028-12 devstack@n-api.service[122431]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 09:15:03 2022] *** Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: nodename: n-d-851028-12 Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: machine: x86_64 Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: clock source: unix Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: pcre jit disabled Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: detected number of CPU cores: 4 Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: current working directory: / Sep 14 09:15:03.416942 n-d-851028-12 devstack@n-api.service[122431]: detected binary path: /usr/bin/uwsgi-core Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: your processes number limit is 47680 Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: your memory page size is 4096 bytes Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: detected max file descriptor number: 2048 Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: lock engine: pthread robust mutexes Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: thunder lock: enabled Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 14 09:15:03.417937 n-d-851028-12 devstack@n-api.service[122431]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 09:15:03.461469 n-d-851028-12 devstack@n-api.service[122431]: Python main interpreter initialized at 0x5611043e29c0 Sep 14 09:15:03.461469 n-d-851028-12 devstack@n-api.service[122431]: python threads support enabled Sep 14 09:15:03.461469 n-d-851028-12 devstack@n-api.service[122431]: your server socket listen backlog is limited to 100 connections Sep 14 09:15:03.461469 n-d-851028-12 devstack@n-api.service[122431]: your mercy for graceful operations on workers is 90 seconds Sep 14 09:15:03.462028 n-d-851028-12 devstack@n-api.service[122431]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 09:15:03.462028 n-d-851028-12 devstack@n-api.service[122431]: *** Operational MODE: preforking *** Sep 14 09:15:03.462266 n-d-851028-12 devstack@n-api.service[122431]: *** uWSGI is running in multiple interpreter mode *** Sep 14 09:15:03.462266 n-d-851028-12 devstack@n-api.service[122431]: spawned uWSGI master process (pid: 122431) Sep 14 09:15:03.462289 n-d-851028-12 systemd[1]: Started Devstack devstack@n-api.service. Sep 14 09:15:03.463483 n-d-851028-12 devstack@n-api.service[122431]: spawned uWSGI worker 1 (pid: 122443, cores: 1) Sep 14 09:15:03.463483 n-d-851028-12 devstack@n-api.service[122431]: spawned uWSGI worker 2 (pid: 122444, cores: 1) Sep 14 09:15:03.463483 n-d-851028-12 devstack@n-api.service[122431]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 09:15:04.174026 n-d-851028-12 devstack@n-api.service[122443]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 09:15:04.180814 n-d-851028-12 devstack@n-api.service[122444]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 14 09:15:05.471049 n-d-851028-12 devstack@n-api.service[122444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:15:05.471049 n-d-851028-12 devstack@n-api.service[122444]: from cryptography.utils import int_from_bytes Sep 14 09:15:05.471769 n-d-851028-12 devstack@n-api.service[122444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:15:05.471769 n-d-851028-12 devstack@n-api.service[122444]: from cryptography.utils import int_from_bytes Sep 14 09:15:05.472954 n-d-851028-12 devstack@n-api.service[122443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:15:05.472954 n-d-851028-12 devstack@n-api.service[122443]: from cryptography.utils import int_from_bytes Sep 14 09:15:05.473403 n-d-851028-12 devstack@n-api.service[122443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 09:15:05.473403 n-d-851028-12 devstack@n-api.service[122443]: from cryptography.utils import int_from_bytes Sep 14 09:15:07.931143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 09:15:07.931988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 09:15:07.931988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 09:15:07.932336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 09:15:07.932600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 09:15:07.933006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.933341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.933670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.934166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.934515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.934832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.935163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.935491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.935829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.936123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.936448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.936785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-12 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.937112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.937429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.937745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.938077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.938391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.938718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.939039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.939561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.940047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.940364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.940768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.941129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.941959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.942293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.942630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.942961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.943286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.943614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.944053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-12 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.944395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.944720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.945036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.945473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.945790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.946103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.946434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.947208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.947208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.947436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.947699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.948059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.948390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.948699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.949016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.949331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.949659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.949978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.950291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.950550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.950865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.951197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.951527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.951861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.952146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.952403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.952732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.953062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.953386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.953703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.954014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.954328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.954643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.954955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.955271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.955584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.955955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.956291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.956629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.956947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.957274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.957693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.957949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.958269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.958618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.958948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.959305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.959605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.969076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.972569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.973857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.974514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.975257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.975257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.975518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.975735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.977924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.978273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.978614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.978964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.979288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.979627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.979995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.980328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.980650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.980974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.981317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.981640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.981958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.982278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.982604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.982929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.983258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 09:15:07.983764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.983932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 09:15:07.984084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.984084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.984347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 09:15:07.984495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.984638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 09:15:07.984771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.984903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 09:15:07.985035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.985177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.985325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.985469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.985603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.985743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.985884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.986109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.986254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.986450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.986596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.986764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.986900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.987087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.987224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.987991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.988235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.988458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.988632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.988825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.989101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.989233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.989366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.989510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.989738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.989883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-851028-12 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.990027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.990166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.990307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.990440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.990581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.990725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.990887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.991059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.991200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.991739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.991990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.992194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.992407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.992733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.992972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.993185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.993429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.993640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.993835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.994035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.994248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.994462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.994670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.994886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.995090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.995291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.995488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.995970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.996245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.996450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.996655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.996866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.997089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.997302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.997479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.997616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.997756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.997900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-851028-12 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.998033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.998174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.998315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.998456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.998601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.998745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.998878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.998878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.999145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.999280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.999419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.999564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:07.999709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:07.999842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.000021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.000157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.000298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.000440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.000581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.000722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.000862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.001000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.001148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.001281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.001429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.001937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.002084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.002218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.002366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.002500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.002654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.002982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.003708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.004109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.004263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.004399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.004533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.004673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.004807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.004807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.005077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.005218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.005356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.005489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.005621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.005766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.005900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.006031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.006216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.006351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.006492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.006636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.006636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.006898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.007037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.007178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.007325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.007468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.007601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.007744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.007924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.007924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.008195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.008328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.008470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.008609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.008750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.008889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.009035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.009168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.009305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.009437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.009576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.010945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.011096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.011230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.011370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.011503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.011651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.012187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.012327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.012470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.90 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.012621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.012761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.90 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.012902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.013148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.013298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.013431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.013571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.013711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.013843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.013974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.014114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.014254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.014386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.014526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.014669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.014798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.014940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.015073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.015210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.015352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.015484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.015621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.015768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.015928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.016063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.016206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.016387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.016530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.016669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.016801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.016801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.017066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.017199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.017343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.017476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.017616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.017760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.017900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.018038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.018185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.018318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.018457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.018608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.018744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.018883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.019163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.019312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.019454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.019594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.019887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.020098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.020242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.020376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.020523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.020655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.020794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.020935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.021067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.021198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.021343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.021483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.021625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.021770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.021916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.022409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.022542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.022672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.022672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.022939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.023084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.023314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.023469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.023603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.023733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.023863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.024014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.024144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.024295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.024438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.024580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.024721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.024854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.024985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.025125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.025266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.025398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.025530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.025668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.025809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.025948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.026089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.026222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.026410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.026555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.026697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.026830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.026969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.027110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.027243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.027384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.027384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.027656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.027789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.027949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.028096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.028230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.028376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.028518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.028652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.028792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.028932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.029079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.029220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.029351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.029488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.029634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.029767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.029907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.030040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.030177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.030309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.030439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.030570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.030710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.030850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.030995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.031129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 09:15:08.031282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.031465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.031616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.031762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.031939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.032102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.032613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.032764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.032899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.033978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.034977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.035980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.036935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.037916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.038877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.039848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.040851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.041865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.042048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.042189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.042679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.042817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.042957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.043906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.044913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.045929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.046935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.047987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.048978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.049801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.050447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.050562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.050701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.050835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.050976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.051120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.051253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.051640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.051773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.051929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.052079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.052079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.052347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.052874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.052874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.053941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.054911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.055853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.056891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.057969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.058944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.059984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.060897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.061970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.062146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.062296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.062455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.062612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.063945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.064876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.065016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.065147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.065281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.065402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.066969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.067102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.067233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.067668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.067818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.068778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.068950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.069872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.070794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.071937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.072091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.072253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.072421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.072580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.072785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.073378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.073535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.073693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.073852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.074966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.075976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.076866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.077836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.078955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.079920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.080905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.081970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.082143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.082278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.082417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.082615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.082835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.083079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.083079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.083942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.084925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.085970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.086985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.087848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.088975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.089944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.090874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.091826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.092964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.093085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.093204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.093424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.093842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.093967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.094924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.095884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.096208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.096208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.096446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.096569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.097885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.098934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.099820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.100964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.101909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.102822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.103049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.103218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.103352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.103609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.104992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.105956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.106860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.107818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.109578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.109749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.109899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.110881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.111802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.112008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.112152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.112279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.112511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.113173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.113314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.113447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.113447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.114760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.115935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.116989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.117826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.118979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.119839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.120894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.121956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.122922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.123756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.124945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.125884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.126944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.127259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.127436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.127642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.127805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.128949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.129898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.130983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.131138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.131287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.131441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.131661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.131852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.132846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.133930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.134198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.134633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.134831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.134831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.135130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.135277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.135423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.135608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.139992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.140311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.140481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.140620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.140753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.140885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.141932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.142877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.143867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.144887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.145836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.173327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.180876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.180979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.180979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.188999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.188999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.189957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.190977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.191969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.192949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.193834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.194957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.195946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.196905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.197816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.198993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.199716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.200970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.201819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.202894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.203991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.204994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.205919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.207976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.208901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.209908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.210946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.211763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.212941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.213998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.214957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.215837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.216985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.217994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.218924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.219774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.220931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.221614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.222259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.222450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.222721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.223450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.224237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.225064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.225064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.225279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.225494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.225811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.226131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.226458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.226780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.227111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.227435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.227761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.228151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.228477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.229128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.229409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.229753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.230082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.230419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.230822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.231300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.231591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.232061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.232386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.232712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.233181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.233688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.234166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.235049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.235049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.235292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.235435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.235755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.236100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.236422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.236740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.237058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.237477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.238312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.239199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.239199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.241191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.242418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.242418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.242418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.242418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.243046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.243046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.243255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.243576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.244109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.244337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.244674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.244994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.245325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.245644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.245981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.246352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.246672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.247006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.247317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.247634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.247991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.248288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.248615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.248938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.249261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.249572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.249886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.252717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.253965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.253965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.253965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.254412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.254531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.254760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.255076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.255386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.256834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.256834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.256834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.256834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.257286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.257445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.257720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.258040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.258371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.258702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.259030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.259351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.259694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.260038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.260361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.260683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.261002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.261386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.262302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.262302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.262302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.263035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.263035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.263355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.263557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.264021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.264345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.264691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.265011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.265329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.265647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.265989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.266328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.266595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.266910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.267228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.267552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.267888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.268254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.268613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.269174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.269773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.270149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.270520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.270849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.271203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.271545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.271867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.272220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.272529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 09:15:08.272779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 09:15:08.299402 n-d-851028-12 devstack@n-api.service[122443]: INFO dbcounter [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Registered counter for database nova_api Sep 14 09:15:08.323730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.331628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writer thread running {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.339820 n-d-851028-12 devstack@n-api.service[122444]: INFO dbcounter [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Registered counter for database nova_api Sep 14 09:15:08.361574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.369910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writer thread running {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.399096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.context [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122443) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 09:15:08.403187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.403642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.405250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.405982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.406425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.408453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.411175 n-d-851028-12 devstack@n-api.service[122443]: INFO dbcounter [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Registered counter for database nova_cell0 Sep 14 09:15:08.415450 n-d-851028-12 devstack@n-api.service[122443]: INFO dbcounter [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Registered counter for database nova_cell1 Sep 14 09:15:08.425777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.427888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.431573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.context [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122444) load_cells /opt/stack/nova/nova/context.py:464}} Sep 14 09:15:08.434427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writer thread running {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.435659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.435767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writer thread running {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.436210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.437797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.438529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:08.439009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:08.441681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:08.443713 n-d-851028-12 devstack@n-api.service[122444]: INFO dbcounter [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Registered counter for database nova_cell0 Sep 14 09:15:08.447765 n-d-851028-12 devstack@n-api.service[122444]: INFO dbcounter [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Registered counter for database nova_cell1 Sep 14 09:15:08.455955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.463931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writer thread running {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.466316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.595107 n-d-851028-12 devstack@n-api.service[122443]: INFO dbcounter [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Registered counter for database nova_cell0 Sep 14 09:15:08.602894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.611530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writer thread running {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.618034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writer thread running {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.626806 n-d-851028-12 devstack@n-api.service[122444]: INFO dbcounter [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Registered counter for database nova_cell0 Sep 14 09:15:08.634385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_db.sqlalchemy.engines [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 09:15:08.639089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writer thread running {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 09:15:08.939552 n-d-851028-12 devstack@n-api.service[122443]: WARNING keystonemiddleware.auth_token [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:15:08.947442 n-d-851028-12 devstack@n-api.service[122443]: WARNING keystonemiddleware.auth_token [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:15:08.961764 n-d-851028-12 devstack@n-api.service[122444]: WARNING keystonemiddleware.auth_token [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:15:08.969107 n-d-851028-12 devstack@n-api.service[122444]: WARNING keystonemiddleware.auth_token [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:15:09.296707 n-d-851028-12 devstack@n-api.service[122443]: WARNING keystonemiddleware.auth_token [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:15:09.303530 n-d-851028-12 devstack@n-api.service[122443]: WARNING keystonemiddleware.auth_token [None req-9a5ebb13-7b58-4070-b42a-e0b0fb4492b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:15:09.308943 n-d-851028-12 devstack@n-api.service[122443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611043e29c0 pid: 122443 (default app) Sep 14 09:15:09.327352 n-d-851028-12 devstack@n-api.service[122444]: WARNING keystonemiddleware.auth_token [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 14 09:15:09.335789 n-d-851028-12 devstack@n-api.service[122444]: WARNING keystonemiddleware.auth_token [None req-3cca0f62-d0f3-4389-912b-f70d799b19db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 14 09:15:09.340970 n-d-851028-12 devstack@n-api.service[122444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611043e29c0 pid: 122444 (default app) Sep 14 09:15:50.154097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.155163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.159990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.161055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.593609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.594595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.595315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:50.596080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:51.335947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1535468775", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:51.729880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Calling method '.version_select at 0x7f694524bf70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.734285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.734774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.735210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.735959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:51.736415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:51.737616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:51.780105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6ff2c16-9da9-4325-86dd-762ed2fa56ef tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 1.197331 Sep 14 09:15:51.780944 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1/1] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:15:50 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:51.979033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a20b2c4e-545c-4d3f-90c1-7f117ea3bebd tempest-AZAdminNegativeTestJSON-824765065 tempest-AZAdminNegativeTestJSON-824765065-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:51.980315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a20b2c4e-545c-4d3f-90c1-7f117ea3bebd tempest-AZAdminNegativeTestJSON-824765065 tempest-AZAdminNegativeTestJSON-824765065-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '558264de9a2746b496e3c13c67cb478f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd68280bb0984040b37dcf037375922f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a20b2c4e-545c-4d3f-90c1-7f117ea3bebd tempest-AZAdminNegativeTestJSON-824765065 tempest-AZAdminNegativeTestJSON-824765065-project] Request method failure captured: Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvE9kJjxYUlSbL2PWkhzrYfTDf6WJlB7tBh2QJL40-Oda_32tBPAUoL0fbrRwMaDl7aYuHepjY0T22_eW-dx7KbXxQVzsqx0-pf8OApgszQ2cs7n2KTiEZmjE7vvzS3zLJLtwKYGEyj69u4YTvJWG76g93RgkCCzIgAzUadH7XUfio Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: cd68280bb0984040b37dcf037375922f Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AZAdminNegativeTestJSON-824765065 Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:15:51.984791 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_cd68280bb0984040b37dcf037375922f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cd68280bb0984040b37dcf037375922f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cd68280bb0984040b37dcf037375922f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/cd68280bb0984040b37dcf037375922f"}]}] Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AZAdminNegativeTestJSON-824765065 Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: cd68280bb0984040b37dcf037375922f Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-824765065 Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AZAdminNegativeTestJSON-824765065-project Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 558264de9a2746b496e3c13c67cb478f Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AZAdminNegativeTestJSON-824765065-project Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 09:15:51.986010 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:51.987264 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:51.988317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a20b2c4e-545c-4d3f-90c1-7f117ea3bebd tempest-AZAdminNegativeTestJSON-824765065 tempest-AZAdminNegativeTestJSON-824765065-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:51.989162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a20b2c4e-545c-4d3f-90c1-7f117ea3bebd tempest-AZAdminNegativeTestJSON-824765065 tempest-AZAdminNegativeTestJSON-824765065-project] 10.222.0.90 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.204555 Sep 14 09:15:51.989162 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2/2] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:52.097424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:52.160344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:52.163983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.164466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.164900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.166070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.166515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.166932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.201522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbd4915b-7664-4519-9d96-e5c117c8b665 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.211413 Sep 14 09:15:52.208237 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3/3] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:15:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:52.420132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Calling method '.version_select at 0x7f69450dfca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:52.429559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122444) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 14 09:15:52.430294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.431012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.431444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.459116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.459516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.459969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.472764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.473253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.473686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.480978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7250a205-9654-47b0-a008-3c2042d08e34 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.271584 Sep 14 09:15:52.481250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4/4] 10.222.0.90 () {60 vars in 1208 bytes} [Wed Sep 14 09:15:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:15:52.543289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:52.543759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:52.544925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:52.546296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:52.547175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:52.561826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.562293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.562721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.563464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:52.563921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:52.564346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:52.596525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Getting quotas for project a3b1d50d5a294b7dbb4872750404dce6. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:52.608575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Getting quotas for user 1847a213fbac4b75a751337e7ddd6ddf and project a3b1d50d5a294b7dbb4872750404dce6. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:52.615701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5705452-5e2b-4521-ad97-b9eadf7b690e tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-22424726", "ram": 512, "vcpus": 1, "disk": 10, "id": 407051262, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:52.625913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:52.629025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:52.677370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5705452-5e2b-4521-ad97-b9eadf7b690e tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.194525 Sep 14 09:15:52.678074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 5/5] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:52 2022] POST /compute/v2.1/flavors => generated 411 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:52.728901 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2dc61be1-50ce-4f15-a974-04a454a1e32b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.580670 Sep 14 09:15:52.730360 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1/6] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:15:52.830939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b59ba12e-1878-47ac-ba6a-496d73b8180f tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Calling method '.version_select at 0x7f6945030c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:52.835105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b59ba12e-1878-47ac-ba6a-496d73b8180f tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b59ba12e-1878-47ac-ba6a-496d73b8180f tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:15:52.837136 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:15:52.838235 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:52.838932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 14 09:15:52.839837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:52.840825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b59ba12e-1878-47ac-ba6a-496d73b8180f tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:52.840825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b59ba12e-1878-47ac-ba6a-496d73b8180f tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.159227 Sep 14 09:15:52.840825 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 6/7] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:15:52 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:52.944099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ddb34c1-7478-4eb7-b8b3-763a9c5910a3 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-585859089", "id": 913664556, "os-flavor-access:is_public": "False"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:52.976283 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ddb34c1-7478-4eb7-b8b3-763a9c5910a3 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.244262 Sep 14 09:15:52.977536 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2/8] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:52 2022] POST /compute/v2.1/flavors => generated 427 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:52.982266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8daa0c0-fc4d-47f2-ba1d-c0e9200a714e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1235720774"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:52.985606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-f8daa0c0-fc4d-47f2-ba1d-c0e9200a714e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid ea5218f9-039b-482f-8db7-08f3f8972203 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:53.039594 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f8daa0c0-fc4d-47f2-ba1d-c0e9200a714e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060761 Sep 14 09:15:53.040276 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 3/9] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:53.051431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-522c5750-6ba9-4a30-b904-31194f50d25a tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.120519 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-522c5750-6ba9-4a30-b904-31194f50d25a tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074449 Sep 14 09:15:53.121646 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 4/10] 10.222.0.90 () {60 vars in 1221 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:53.133643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5db0590d-d852-43e3-87a4-61a5ae40351b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.134783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5db0590d-d852-43e3-87a4-61a5ae40351b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:53.161776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '.version_select at 0x7f6944ff8f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.164086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.164573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.165007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.209736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.210788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.211510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.228945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.234301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.235087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.257388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-528e16de-42c5-4856-96f7-2adf16bd9d07 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.416875 Sep 14 09:15:53.258196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5db0590d-d852-43e3-87a4-61a5ae40351b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.258681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 7/11] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:15:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:53.263563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-954af5a0-83ec-424f-b4ba-598bc3176091 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Calling method '.version_select at 0x7f6944ff8820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.265631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-954af5a0-83ec-424f-b4ba-598bc3176091 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-954af5a0-83ec-424f-b4ba-598bc3176091 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hosts/n-d-851028-12/reboot HTTP/1.1 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:15:53.270079 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'n-d-851028-12'} Sep 14 09:15:53.271880 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:53.272715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 14 09:15:53.273684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.276276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-954af5a0-83ec-424f-b4ba-598bc3176091 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:53.277342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-954af5a0-83ec-424f-b4ba-598bc3176091 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-d-851028-12/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017567 Sep 14 09:15:53.279125 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 8/12] 10.222.0.90 () {58 vars in 1191 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/os-hosts/n-d-851028-12/reboot => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:53.284767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e0cde17-d914-454c-94e7-4953102361e6 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d3f7edd5f08e42b498da2efb9a0f62ba"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.286757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5db0590d-d852-43e3-87a4-61a5ae40351b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1220 microversion: 2.1 time: 0.163481 Sep 14 09:15:53.287405 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 5/13] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:53.304617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6338923c-8a16-4b02-a354-cc6a44362590 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.346823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6338923c-8a16-4b02-a354-cc6a44362590 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:53.348413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6338923c-8a16-4b02-a354-cc6a44362590 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:53.348873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6338923c-8a16-4b02-a354-cc6a44362590 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:53.575864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e0cde17-d914-454c-94e7-4953102361e6 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/913664556/action" status: 200 len: 96 microversion: 2.1 time: 0.294627 Sep 14 09:15:53.583445 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 9/14] 10.222.0.90 () {60 vars in 1197 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/flavors/913664556/action => generated 96 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:53.733026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c03c3587-ec93-4ade-88cf-d679f80cacf7 tempest-FlavorsExtraSpecsTestJSON-228326346 tempest-FlavorsExtraSpecsTestJSON-228326346-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.780208 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c03c3587-ec93-4ade-88cf-d679f80cacf7 tempest-FlavorsExtraSpecsTestJSON-228326346 tempest-FlavorsExtraSpecsTestJSON-228326346-project] 10.222.0.90 "GET /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.194693 Sep 14 09:15:53.783416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 10/15] 10.222.0.90 () {58 vars in 1200 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:53.791597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a52dbe60-4396-4feb-99f3-0d043ae64f26 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Calling method '.version_select at 0x7f6945065af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.836703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a52dbe60-4396-4feb-99f3-0d043ae64f26 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a52dbe60-4396-4feb-99f3-0d043ae64f26 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:15:53.844527 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'nonexistent_hostname'} Sep 14 09:15:53.846293 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:53.847734 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 09:15:53.849220 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a52dbe60-4396-4feb-99f3-0d043ae64f26 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a52dbe60-4396-4feb-99f3-0d043ae64f26 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.060463 Sep 14 09:15:53.850437 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 11/16] 10.222.0.90 () {58 vars in 1212 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:53.901335 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6338923c-8a16-4b02-a354-cc6a44362590 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.612301 Sep 14 09:15:53.902166 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 6/17] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:53.907351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f2c54620-c46c-47f4-9311-23850068a3ae tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:53.944714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f2c54620-c46c-47f4-9311-23850068a3ae tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041562 Sep 14 09:15:53.945966 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 7/18] 10.222.0.90 () {60 vars in 1221 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:53.954346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-48c32128-6169-413e-9fb7-35037697b9db tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Calling method '.version_select at 0x7f6944732af0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:53.956880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-48c32128-6169-413e-9fb7-35037697b9db tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-48c32128-6169-413e-9fb7-35037697b9db tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hosts/n-d-851028-12 HTTP/1.1 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:53.963948 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12'} Sep 14 09:15:53.965849 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:53.966766 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 14 09:15:53.968432 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:53.969864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-48c32128-6169-413e-9fb7-35037697b9db tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:53.969864 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-48c32128-6169-413e-9fb7-35037697b9db tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-d-851028-12" status: 403 len: 109 microversion: 2.1 time: 0.019661 Sep 14 09:15:53.972050 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 8/19] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/os-hosts/n-d-851028-12 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:53.976903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.006028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.006601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.007264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.041315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-851028-12. Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 40 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:54.063460 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: {"add_host": {"host": "n-h2-851028-12"}} Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:54.065497 n-d-851028-12 devstack@n-api.service[122443]: exception: Aggregate 1 already has host n-h2-851028-12. Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-851028-12'}}} Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:15:54.066481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-851028-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 09:15:54.067664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 09:15:54.069463 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:15:54.070635 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-851028-12-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 9, 15, 54, 26604), 'updated_at': None, 'host': 'n-h2-851028-12', 'aggregate_id': 1}] Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.071701 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-851028-12. Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.072692 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-851028-12. Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:54.073951 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:54.075219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-851028-12. Sep 14 09:15:54.075219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.081780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-851028-12. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.081780 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0955739f-c351-42e5-a2b8-d5182e193bc5 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.104620 Sep 14 09:15:54.081780 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 9/20] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 14 09:15:54.091024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f4cbb77-e5c1-4a65-bd48-56150a1f345b tempest-FlavorsExtraSpecsTestJSON-228326346 tempest-FlavorsExtraSpecsTestJSON-228326346-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.128976 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f4cbb77-e5c1-4a65-bd48-56150a1f345b tempest-FlavorsExtraSpecsTestJSON-228326346 tempest-FlavorsExtraSpecsTestJSON-228326346-project] 10.222.0.90 "GET /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.045467 Sep 14 09:15:54.139012 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 10/21] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.143234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e6196c18-b98f-497f-977a-8964f7e9ae25 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Calling method '.version_select at 0x7f69444568b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.158696 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-e6196c18-b98f-497f-977a-8964f7e9ae25 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e6196c18-b98f-497f-977a-8964f7e9ae25 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:54.165674 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'nonexistent_hostname'} Sep 14 09:15:54.167705 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.169012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.177430 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.188849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e6196c18-b98f-497f-977a-8964f7e9ae25 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.188849 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e6196c18-b98f-497f-977a-8964f7e9ae25 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.029939 Sep 14 09:15:54.191074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f30cda4-3d8f-4e27-9eb9-4fdb44f1f755 tempest-FlavorsAccessTestJSON-1260253994 tempest-FlavorsAccessTestJSON-1260253994-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.191345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 11/22] 10.222.0.90 () {58 vars in 1191 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:54.191345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c8dd82a0-7b9c-4eab-b2c6-101471f2d437 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.191345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8dd82a0-7b9c-4eab-b2c6-101471f2d437 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.191345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8dd82a0-7b9c-4eab-b2c6-101471f2d437 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.192221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8dd82a0-7b9c-4eab-b2c6-101471f2d437 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:54.243279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f30cda4-3d8f-4e27-9eb9-4fdb44f1f755 tempest-FlavorsAccessTestJSON-1260253994 tempest-FlavorsAccessTestJSON-1260253994-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5809 microversion: 2.1 time: 0.394434 Sep 14 09:15:54.244730 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 12/23] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:15:53 2022] GET /compute/v2.1/flavors/detail => generated 5809 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:54.254006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e18d7b9-1f29-407c-b761-32bbe9d91261 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.289653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e18d7b9-1f29-407c-b761-32bbe9d91261 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.043399 Sep 14 09:15:54.290325 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 13/24] 10.222.0.90 () {60 vars in 1221 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.298060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-791fbbd1-2150-42f2-9e90-953cbccd4086 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Calling method '.version_select at 0x7f6944edc940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.301109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-791fbbd1-2150-42f2-9e90-953cbccd4086 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-791fbbd1-2150-42f2-9e90-953cbccd4086 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hosts/n-d-851028-12/shutdown HTTP/1.1 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:15:54.303331 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'n-d-851028-12'} Sep 14 09:15:54.304715 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:54.305479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 14 09:15:54.306461 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.307422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-791fbbd1-2150-42f2-9e90-953cbccd4086 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.307422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-791fbbd1-2150-42f2-9e90-953cbccd4086 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-d-851028-12/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.011258 Sep 14 09:15:54.307422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 14/25] 10.222.0.90 () {58 vars in 1197 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-hosts/n-d-851028-12/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:54.314027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5964f6fc-284c-4ae6-af3c-bf3d006e4ec1 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d3f7edd5f08e42b498da2efb9a0f62ba"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.373354 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c8dd82a0-7b9c-4eab-b2c6-101471f2d437 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.204262 Sep 14 09:15:54.381251 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 12/26] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:54.389048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9419ad4-60b6-44fa-a719-27f951400888 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.398634 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9419ad4-60b6-44fa-a719-27f951400888 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019566 Sep 14 09:15:54.399250 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 13/27] 10.222.0.90 () {58 vars in 1200 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.403695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f9fbf24-9887-4e23-b9a9-6f11357c663a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.404862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f9fbf24-9887-4e23-b9a9-6f11357c663a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:54.477952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4f9fbf24-9887-4e23-b9a9-6f11357c663a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:54.487788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f9fbf24-9887-4e23-b9a9-6f11357c663a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1220 microversion: 2.1 time: 0.085580 Sep 14 09:15:54.488432 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 14/28] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:54.496862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69c5b972-af42-4cc5-9986-50905910146d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Calling method '.version_select at 0x7f69444693a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.512371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-69c5b972-af42-4cc5-9986-50905910146d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69c5b972-af42-4cc5-9986-50905910146d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:54.515645 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'nonexistent_hostname'} Sep 14 09:15:54.517340 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:54.518314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 09:15:54.519610 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.520860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69c5b972-af42-4cc5-9986-50905910146d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.522508 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-69c5b972-af42-4cc5-9986-50905910146d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032785 Sep 14 09:15:54.524770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 15/29] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:54.536027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cce4b0e1-5566-4741-a668-28b730e1c9ce tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.580135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cce4b0e1-5566-4741-a668-28b730e1c9ce tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.052668 Sep 14 09:15:54.582673 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 16/30] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:54 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:54.592630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-282bae18-ca06-41bd-beff-19b19cb0eafd tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.647164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:54.653074 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-282bae18-ca06-41bd-beff-19b19cb0eafd tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "PUT /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.068402 Sep 14 09:15:54.653680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 17/31] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:15:54 2022] PUT /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes => generated 22 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.667737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4679a87a-2385-4d4b-a17e-91a9a5dbfe42 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Calling method '.version_select at 0x7f69444568b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.670130 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5964f6fc-284c-4ae6-af3c-bf3d006e4ec1 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/913664556/action" status: 200 len: 21 microversion: 2.1 time: 0.362227 Sep 14 09:15:54.671155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 15/32] 10.222.0.90 () {60 vars in 1197 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/flavors/913664556/action => generated 21 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.671707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4679a87a-2385-4d4b-a17e-91a9a5dbfe42 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4679a87a-2385-4d4b-a17e-91a9a5dbfe42 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hosts/n-d-851028-12/startup HTTP/1.1 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:54.675725 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12'} Sep 14 09:15:54.678123 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:54.679383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 14 09:15:54.681128 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.682779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4679a87a-2385-4d4b-a17e-91a9a5dbfe42 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.682779 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4679a87a-2385-4d4b-a17e-91a9a5dbfe42 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-d-851028-12/startup" status: 403 len: 110 microversion: 2.1 time: 0.017468 Sep 14 09:15:54.683246 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 18/33] 10.222.0.90 () {58 vars in 1194 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-hosts/n-d-851028-12/startup => generated 110 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:54.688243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7156330c-6faf-4bed-a85f-a02b46fca023 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-472096298", "name": "tempest-test_aggregate-967659582"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.691084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-337537f0-487b-4e2d-80a7-7eb2111222e1 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1932615160"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.698204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-337537f0-487b-4e2d-80a7-7eb2111222e1 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 94a10b95-8917-4cde-a233-0304eb80d516 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:54.711798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-7156330c-6faf-4bed-a85f-a02b46fca023 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid afe07151-7c9b-4861-82d0-1c6e209a0ef9 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:54.743061 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7156330c-6faf-4bed-a85f-a02b46fca023 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.058577 Sep 14 09:15:54.743912 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 19/34] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:54.760579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-689f0a4e-1ef9-4ac0-a08f-a1f20699e40c tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.771643 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-689f0a4e-1ef9-4ac0-a08f-a1f20699e40c tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.026456 Sep 14 09:15:54.772886 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 20/35] 10.222.0.90 () {58 vars in 1200 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/flavors/407051262/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:54.781293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-337537f0-487b-4e2d-80a7-7eb2111222e1 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108046 Sep 14 09:15:54.784945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-474f4597-52f0-47b9-a6aa-14fe8f9de58f tempest-FlavorsAccessTestJSON-1260253994 tempest-FlavorsAccessTestJSON-1260253994-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.791022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 16/36] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:54.798184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adb5885c-9e8b-4de9-9da9-b0f19310b1d9 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Calling method '.version_select at 0x7f6944ee29d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.811410 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-adb5885c-9e8b-4de9-9da9-b0f19310b1d9 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adb5885c-9e8b-4de9-9da9-b0f19310b1d9 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:15:54.813605 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'nonexistent_hostname'} Sep 14 09:15:54.816430 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:54.819001 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 14 09:15:54.820605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adb5885c-9e8b-4de9-9da9-b0f19310b1d9 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-adb5885c-9e8b-4de9-9da9-b0f19310b1d9 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.022924 Sep 14 09:15:54.822363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 17/37] 10.222.0.90 () {58 vars in 1215 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:54.827209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-694dcc03-2bb9-4598-bb7b-bd30c0978109 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.834972 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-474f4597-52f0-47b9-a6aa-14fe8f9de58f tempest-FlavorsAccessTestJSON-1260253994 tempest-FlavorsAccessTestJSON-1260253994-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.055409 Sep 14 09:15:54.836283 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 21/38] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:54.840991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b164399-025b-462c-bfa2-7242560b5878 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.863717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-694dcc03-2bb9-4598-bb7b-bd30c0978109 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.040379 Sep 14 09:15:54.864519 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 18/39] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:15:54 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:54.881115 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b164399-025b-462c-bfa2-7242560b5878 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.043500 Sep 14 09:15:54.884781 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 22/40] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:15:54 2022] DELETE /compute/v2.1/flavors/407051262/os-extra_specs/hw:numa_nodes => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:54.890400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4bc0e381-7b67-4a8b-bd79-97344e56d31a tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Action: 'update', calling method: .version_select at 0x7f69446bb550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4bc0e381-7b67-4a8b-bd79-97344e56d31a tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-hosts/n-d-851028-12 HTTP/1.1 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 51 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:54.896144 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: {"status": "enable", "maintenance_mode": "invalid"} Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:54.897341 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance: Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.898028 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:54.899672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4bc0e381-7b67-4a8b-bd79-97344e56d31a tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4bc0e381-7b67-4a8b-bd79-97344e56d31a tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-hosts/n-d-851028-12" status: 400 len: 199 microversion: 2.1 time: 0.014449 Sep 14 09:15:54.901183 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 23/41] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:15:54 2022] PUT /compute/v2.1/os-hosts/n-d-851028-12 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:15:54.906480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-296f1bd2-619a-4f26-b981-565879a5f109 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:54.936852 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-296f1bd2-619a-4f26-b981-565879a5f109 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/913664556" status: 202 len: 0 microversion: 2.1 time: 0.036147 Sep 14 09:15:54.937830 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 24/42] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:15:54 2022] DELETE /compute/v2.1/flavors/913664556 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:54.943117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2bfecab5-c5ab-4771-bd04-7eb09408e7b9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:54.954586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfecab5-c5ab-4771-bd04-7eb09408e7b9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:54.956029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfecab5-c5ab-4771-bd04-7eb09408e7b9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:54.956815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfecab5-c5ab-4771-bd04-7eb09408e7b9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.136296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d69e479-8ced-435f-9002-140c6bebb615 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.140639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d69e479-8ced-435f-9002-140c6bebb615 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d69e479-8ced-435f-9002-140c6bebb615 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 40 Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:15:55.143495 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: {"add_host": {"host": "n-h2-851028-12"}} Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:15:55.144636 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-851028-12'}}} Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.145315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 14 09:15:55.146297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.147233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d69e479-8ced-435f-9002-140c6bebb615 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.147233 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d69e479-8ced-435f-9002-140c6bebb615 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.278032 Sep 14 09:15:55.151138 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 19/43] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 286 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:55.158037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ad81fa7-9772-4e24-aa01-bfa77efb977b tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.182893 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2bfecab5-c5ab-4771-bd04-7eb09408e7b9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 313 microversion: 2.1 time: 0.243403 Sep 14 09:15:55.184106 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 25/44] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:55.192659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-566b3119-7f8f-4de5-9510-e3a43c6788c0 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Action: 'update', calling method: .version_select at 0x7f6944420280>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.195098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ad81fa7-9772-4e24-aa01-bfa77efb977b tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/407051262/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.042343 Sep 14 09:15:55.195705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 20/45] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/flavors/407051262/os-extra_specs/hw:cpu_policy => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-566b3119-7f8f-4de5-9510-e3a43c6788c0 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-hosts/n-d-851028-12 HTTP/1.1 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 51 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.200411 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: {"status": "invalid", "maintenance_mode": "enable"} Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:55.202106 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance: Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.202947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.204844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.206889 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.206889 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:15:55.206889 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:15:55.206889 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 14 09:15:55.206889 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.207322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-995f4b83-ef3c-4dfa-ba7e-dcd4c079de24 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.209180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-566b3119-7f8f-4de5-9510-e3a43c6788c0 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.210559 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-566b3119-7f8f-4de5-9510-e3a43c6788c0 tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-hosts/n-d-851028-12" status: 400 len: 189 microversion: 2.1 time: 0.024803 Sep 14 09:15:55.212411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 26/46] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:15:55 2022] PUT /compute/v2.1/os-hosts/n-d-851028-12 => generated 189 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:15:55.219065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79690947-84d5-4626-beb9-f306e75abbd8 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.252031 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79690947-84d5-4626-beb9-f306e75abbd8 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.037175 Sep 14 09:15:55.253116 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 27/47] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:55.260919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-995f4b83-ef3c-4dfa-ba7e-dcd4c079de24 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.064078 Sep 14 09:15:55.276188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-90634dcc-f84c-4f46-83ab-d704be76ef5a tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.276188 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-90634dcc-f84c-4f46-83ab-d704be76ef5a tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/407051262/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017295 Sep 14 09:15:55.276188 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 28/48] 10.222.0.90 () {58 vars in 1200 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/flavors/407051262/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:55.277796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-225a5e6e-1f6c-48f1-b5f1-2d0176f5d393 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Action: 'update', calling method: .version_select at 0x7f69443a7700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.278432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 21/49] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.285062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-766ebd1d-6f6e-4169-9da4-a18ebe95571c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-114773267"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.286389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-225a5e6e-1f6c-48f1-b5f1-2d0176f5d393 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '92d35d81f41843189e56c5ba9a214263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddc4104a58c8465fbf97fdd6029e6f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-225a5e6e-1f6c-48f1-b5f1-2d0176f5d393 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Request method failure captured: Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-hosts/n-d-851028-12 HTTP/1.1 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 50 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvEj59VbD__GWpVFqNS1i53YEhhdKItT9_ur2R1hDnyMpoK6ttUv1O8Vb7J5LCHd2id07LUNVvafHwJlIewinmXM0KEZNCtgL9s-WxFUEtTgr3oKzkTIjRbTcqDwx9riI2dURDJbLJJf7y2kcAru4kC2B1rlJFdSi2fDR8o9FJwze0 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:55.288370 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ddc4104a58c8465fbf97fdd6029e6f58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ddc4104a58c8465fbf97fdd6029e6f58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ddc4104a58c8465fbf97fdd6029e6f58"}]}] Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ddc4104a58c8465fbf97fdd6029e6f58 Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1467028874 Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 92d35d81f41843189e56c5ba9a214263 Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1467028874-project Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: {"status": "enable", "maintenance_mode": "enable"} Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 09:15:55.289533 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.290248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 14 09:15:55.292391 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.293699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-766ebd1d-6f6e-4169-9da4-a18ebe95571c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 43a2cd70-616c-48a3-94f3-53e5731dd6c8 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:55.293782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-225a5e6e-1f6c-48f1-b5f1-2d0176f5d393 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.293782 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-225a5e6e-1f6c-48f1-b5f1-2d0176f5d393 tempest-HostsAdminNegativeTestJSON-1467028874 tempest-HostsAdminNegativeTestJSON-1467028874-project] 10.222.0.90 "PUT /compute/v2.1/os-hosts/n-d-851028-12" status: 403 len: 111 microversion: 2.1 time: 0.016054 Sep 14 09:15:55.293782 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 29/50] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:15:55 2022] PUT /compute/v2.1/os-hosts/n-d-851028-12 => generated 111 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:55.300736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab294602-3824-46b1-bcf0-8b20d13b16f3 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-695393330", "id": 466603956, "os-flavor-access:is_public": "False"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.321774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-766ebd1d-6f6e-4169-9da4-a18ebe95571c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042170 Sep 14 09:15:55.322385 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 22/51] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:55.323966 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab294602-3824-46b1-bcf0-8b20d13b16f3 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.031892 Sep 14 09:15:55.326016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 30/52] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/flavors => generated 427 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:55.332482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c272e489-bba2-4626-926c-18cd4054f77d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Action: 'update', calling method: .version_select at 0x7f69443a7700>, body: {"status": null, "maintenance_mode": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c272e489-bba2-4626-926c-18cd4054f77d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-hosts/n-d-851028-12 HTTP/1.1 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 42 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.336783 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: {"status": null, "maintenance_mode": null} Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 09:15:55.337886 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'n-d-851028-12', 'body': {'status': None, 'maintenance_mode': None}} Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'disable', Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Enable', Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'Disable', Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance: Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi None Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.338628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.339844 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c272e489-bba2-4626-926c-18cd4054f77d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.343259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c272e489-bba2-4626-926c-18cd4054f77d tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-hosts/n-d-851028-12" status: 400 len: 127 microversion: 2.1 time: 0.011094 Sep 14 09:15:55.344251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-457ba490-0e84-40e0-a6d6-80bae1a84809 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.344422 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 31/53] 10.222.0.90 () {60 vars in 1190 bytes} [Wed Sep 14 09:15:55 2022] PUT /compute/v2.1/os-hosts/n-d-851028-12 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:15:55.344422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-589521955"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.366588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122443) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 14 09:15:55.367601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.368707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.369060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.374424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-457ba490-0e84-40e0-a6d6-80bae1a84809 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/407051262" status: 202 len: 0 microversion: 2.1 time: 0.050704 Sep 14 09:15:55.375339 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 23/54] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/flavors/407051262 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:55.379955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.380599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.381094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.382602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-28379e6b-973e-434c-a0cf-47a7d6b1c2d0 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.389774 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-589521955 could not be found. Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 57 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.391799 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: {"add_host": {"host": "tempest-nonexist_host-589521955"}} Sep 14 09:15:55.393544 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: exception: Compute host tempest-nonexist_host-589521955 could not be found. Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-589521955'}}} Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-589521955' is not mapped to any cell Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.394187 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 14 09:15:55.395184 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-589521955 could not be found. Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-589521955 could not be found. Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.397584 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-589521955 could not be found. Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-589521955 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-183be6b0-0dfe-4f45-ad37-029bc7f70e60 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.054740 Sep 14 09:15:55.400007 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 32/55] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:55.401449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-28379e6b-973e-434c-a0cf-47a7d6b1c2d0 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/466603956/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023255 Sep 14 09:15:55.401449 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 24/56] 10.222.0.90 () {58 vars in 1206 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/flavors/466603956/os-flavor-access => generated 21 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:15:55.401823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Action: 'update', calling method: .version_select at 0x7f69443a73a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.404910 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.hosts [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Enabling host nonexistent_hostname. Sep 14 09:15:55.419201 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Request method failure captured: Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 50 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvGhWc18rhxgX-zMRv-wpPUDBm7Hz_phX-ghzn3E2HhafjhOL5KZr26uH6J2pFqwhnWub-BDmXs5xmtx5UO61Nrrt-OhsoNH5qj33OzVJvy-b5828PW26ca1yWNWDV_dHZHG9wqsY1fNkGAf_K4GI04TGsb2XQ9ot7cS_UaXxTSno4 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.421288 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bd7360cb2e224d61aab271b26a560e9b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bd7360cb2e224d61aab271b26a560e9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bd7360cb2e224d61aab271b26a560e9b"}]}] Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: bd7360cb2e224d61aab271b26a560e9b Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1612864471 Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 025ef19e16024a998fe1b0b02ee827bb Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1612864471-project-admin Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: {"status": "enable", "maintenance_mode": "enable"} Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:55.422420 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:15:55.423120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.424714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.425818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.426591 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-89aee043-1941-4ea7-b12f-ae6a5a056c6c tempest-HostsAdminNegativeTestJSON-1612864471 tempest-HostsAdminNegativeTestJSON-1612864471-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025666 Sep 14 09:15:55.426591 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 33/57] 10.222.0.90 () {60 vars in 1211 bytes} [Wed Sep 14 09:15:55 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:55.429405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78f0de8a-c7c3-48a4-8909-9ad978a207c5 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.460995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78f0de8a-c7c3-48a4-8909-9ad978a207c5 tempest-FlavorsExtraSpecsTestJSON-94814891 tempest-FlavorsExtraSpecsTestJSON-94814891-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036022 Sep 14 09:15:55.461633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 34/58] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.471756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-188d68a9-9338-4774-8333-8b68973e76ea tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.511878 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-188d68a9-9338-4774-8333-8b68973e76ea tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.048918 Sep 14 09:15:55.512729 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 35/59] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:55.518028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2db78a1b-4cc8-4ab3-826d-483e0d6b561a tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.539967 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2db78a1b-4cc8-4ab3-826d-483e0d6b561a tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/466603956" status: 202 len: 0 microversion: 2.1 time: 0.025759 Sep 14 09:15:55.540837 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 36/60] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/flavors/466603956 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:15:55.552927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.554848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:55.563720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.564252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.565445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.566293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.566756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.567317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.733692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.748762 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-251cb138-8fd4-4e9e-b8af-75fbb1e933e5 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1280 microversion: 2.1 time: 0.206043 Sep 14 09:15:55.748970 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 37/61] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.760229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-895899180", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "availability_zone": "tempest-test_az-472096298"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.772976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f758fe9-653c-48fc-98e1-f60105bc1823 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f758fe9-653c-48fc-98e1-f60105bc1823 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 283 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.777765 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.778925 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:15:55.779484 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.780050 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.780957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.781718 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:15:55.781718 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:15:55.781718 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:15:55.781718 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.783458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f758fe9-653c-48fc-98e1-f60105bc1823 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.785980 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f758fe9-653c-48fc-98e1-f60105bc1823 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.023790 Sep 14 09:15:55.786138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.786912 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 38/62] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:15:55.788543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.790244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.795058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-90e3244d-1e3f-4bb0-981e-e90bdcf41f20 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:55.797720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:55.800052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:55.800713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:55.818475 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-90e3244d-1e3f-4bb0-981e-e90bdcf41f20 tempest-FlavorsAccessTestJSON-1338888187 tempest-FlavorsAccessTestJSON-1338888187-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030127 Sep 14 09:15:55.819723 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 39/63] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:15:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:55.837829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7f7a160-f19d-4ac8-b54b-1e47fd8c22ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7f7a160-f19d-4ac8-b54b-1e47fd8c22ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 27 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.844083 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: {"aggregate": {"name": ""}} Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:55.845386 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi '' Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.846316 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:15:55.847449 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.850723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7f7a160-f19d-4ac8-b54b-1e47fd8c22ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.851931 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7f7a160-f19d-4ac8-b54b-1e47fd8c22ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030828 Sep 14 09:15:55.853288 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 40/64] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:15:55.865334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8a8671e-875e-4959-bd95-8161a5bd7203 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-3075583"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.869287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b8a8671e-875e-4959-bd95-8161a5bd7203 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8a8671e-875e-4959-bd95-8161a5bd7203 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 57 Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:55.871722 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: {"aggregate": {"name": "tempest-test_aggregate-3075583"}} Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:55.872858 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-3075583'}}} Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:55.873604 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:55.879834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 14 09:15:55.881404 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.881404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8a8671e-875e-4959-bd95-8161a5bd7203 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.881404 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b8a8671e-875e-4959-bd95-8161a5bd7203 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013979 Sep 14 09:15:55.881404 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 41/65] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:15:55.886445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0a306815-3c69-48d5-93f9-a71d29c33aea tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-698928238"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.890177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-0a306815-3c69-48d5-93f9-a71d29c33aea tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 612ccfc2-84cb-44cf-b38f-92d549bc2d94 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:55.939405 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0a306815-3c69-48d5-93f9-a71d29c33aea tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058583 Sep 14 09:15:55.946584 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 42/66] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:55.951694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-698928238"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:55.956014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 51e03a0d-7236-48eb-9692-279f7c254f39 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:55.981372 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-698928238 already exists. Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 59 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:55.983117 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: {"aggregate": {"name": "tempest-test_aggregate-698928238"}} Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:55.984227 n-d-851028-12 devstack@n-api.service[122443]: exception: Aggregate tempest-test_aggregate-698928238 already exists. Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-698928238'}}} Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 14 09:15:55.984884 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-698928238 already exists. Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:15:55.990376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-698928238 already exists. Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-698928238 already exists. Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-698928238 already exists. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:55.991371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1b3987a-98d6-4249-9fb8-99f3efc494c6 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.036959 Sep 14 09:15:55.992144 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 43/67] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:15:55.995994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-654e2c63-7fa6-45df-8403-0a3fd1ed401f tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.062472 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-654e2c63-7fa6-45df-8403-0a3fd1ed401f tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.071235 Sep 14 09:15:56.063264 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 44/68] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:56.075337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-61f724d1-75fe-44b9-865e-bc162168fcbb tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1088062838"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:56.079163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-61f724d1-75fe-44b9-865e-bc162168fcbb tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid b69bb605-d3e2-4fee-a552-6aed28de606e for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:56.114109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-61f724d1-75fe-44b9-865e-bc162168fcbb tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.043325 Sep 14 09:15:56.116474 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 45/69] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:56.134258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0558fa9b-3059-419e-b914-d030e4570b81 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.136067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0558fa9b-3059-419e-b914-d030e4570b81 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0558fa9b-3059-419e-b914-d030e4570b81 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:56.138312 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 09:15:56.139829 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '6'} Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:56.140483 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 14 09:15:56.141397 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.144525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0558fa9b-3059-419e-b914-d030e4570b81 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:56.145574 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0558fa9b-3059-419e-b914-d030e4570b81 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.016441 Sep 14 09:15:56.150332 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 46/70] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:56.155836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-62aab458-6e6b-44b2-8a42-72e56883f086 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.182377 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-62aab458-6e6b-44b2-8a42-72e56883f086 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.030875 Sep 14 09:15:56.183047 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 47/71] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 14 09:15:56.194218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18f3fe85-18ba-49f2-8a4c-9386e652733e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.208055 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-18f3fe85-18ba-49f2-8a4c-9386e652733e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18f3fe85-18ba-49f2-8a4c-9386e652733e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:56.209883 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: exception: Aggregate -1 could not be found. Sep 14 09:15:56.211014 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '-1'} Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:15:56.211751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.212792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18f3fe85-18ba-49f2-8a4c-9386e652733e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18f3fe85-18ba-49f2-8a4c-9386e652733e tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.022453 Sep 14 09:15:56.214052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 48/72] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:15:56 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:15:56.225957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ade1714-88ca-43aa-9a26-982345acaa21 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-923976692"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:56.230234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-7ade1714-88ca-43aa-9a26-982345acaa21 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 75ab848b-f2de-475a-b438-678c5a8193be for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:15:56.234241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=15 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:56.258918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ade1714-88ca-43aa-9a26-982345acaa21 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.037620 Sep 14 09:15:56.267714 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 49/73] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:15:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:15:56.273872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-461806b5-4f00-4db2-97b9-34ef28b73727 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.275360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-461806b5-4f00-4db2-97b9-34ef28b73727 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-461806b5-4f00-4db2-97b9-34ef28b73727 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:56.276916 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 09:15:56.278263 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '7'} Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:56.279009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 14 09:15:56.280199 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.282421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-461806b5-4f00-4db2-97b9-34ef28b73727 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:56.284514 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-461806b5-4f00-4db2-97b9-34ef28b73727 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.014682 Sep 14 09:15:56.286242 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 50/74] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:15:56.301138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b93743fa-b0db-4828-a30a-4e938a5bdb00 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.339823 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b93743fa-b0db-4828-a30a-4e938a5bdb00 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048033 Sep 14 09:15:56.340450 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 51/75] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:15:56.353829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a76877bc-6dbd-404d-8714-f96ab55c0c40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.364128 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a76877bc-6dbd-404d-8714-f96ab55c0c40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a76877bc-6dbd-404d-8714-f96ab55c0c40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:15:56.365766 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: exception: Aggregate -1 could not be found. Sep 14 09:15:56.367155 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '-1'} Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.371916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 14 09:15:56.372932 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.373824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a76877bc-6dbd-404d-8714-f96ab55c0c40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:56.373824 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a76877bc-6dbd-404d-8714-f96ab55c0c40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021387 Sep 14 09:15:56.373824 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 52/76] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:15:56.376486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-064702fa-5698-4a3b-bf1b-9d454ce6d126 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.378925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-064702fa-5698-4a3b-bf1b-9d454ce6d126 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-064702fa-5698-4a3b-bf1b-9d454ce6d126 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:15:56.380536 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 09:15:56.382414 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:15:56.383181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:15:56.384191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-064702fa-5698-4a3b-bf1b-9d454ce6d126 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:15:56.385367 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-064702fa-5698-4a3b-bf1b-9d454ce6d126 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009207 Sep 14 09:15:56.385367 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 53/77] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:15:56.777427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:56.778288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:56.792479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.797078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.797654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.798497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:56.799340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:56.801778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:56.927096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:56.937650 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9607b8d4-dfbd-41c5-a74e-52f3a7daec60 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1278 microversion: 2.1 time: 0.164771 Sep 14 09:15:56.938230 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 54/78] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:56 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:15:57.192734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:15:57.814335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:15:57.816098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:15:57.817102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:15:57.817878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:15:57.819736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:15:57.902872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.905043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.906621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.909004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.909563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.910181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.962797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:57.963407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:57.988695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.990204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.991207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:57.993898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:57.994720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:57.997411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:58.011846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Getting quotas for project 2d71b76895c448f7a8f219badb96d77c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:15:58.037789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Getting quotas for user 765f8ca2a67742c9899851ae8bad8d40 and project 2d71b76895c448f7a8f219badb96d77c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:15:58.070681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:15:58.073616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:15:58.116894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:15:58.130127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.147582 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-91e15c5f-3b1f-40e1-b014-696acfde32d7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1278 microversion: 2.1 time: 0.187867 Sep 14 09:15:58.149548 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 55/79] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:57 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:58.293302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8bd3366c-7dad-4c18-9b10-3e1f07dca00f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.890353 Sep 14 09:15:58.308991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 25/80] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:15:58.322623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c23e9af8-294b-43da-a9c2-5a76e7d86246 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:58.328380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c23e9af8-294b-43da-a9c2-5a76e7d86246 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:58.530151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c23e9af8-294b-43da-a9c2-5a76e7d86246 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:58.588381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c23e9af8-294b-43da-a9c2-5a76e7d86246 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1241 microversion: 2.1 time: 0.277941 Sep 14 09:15:58.608927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 26/81] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:58 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1241 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:59.059335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-50f20be1-f615-4e19-be07-0d9e1324ee0b tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1890042687", "id": 1628670328, "os-flavor-access:is_public": "False"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:59.117632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-50f20be1-f615-4e19-be07-0d9e1324ee0b tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.965437 Sep 14 09:15:59.120219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 56/82] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:15:58 2022] POST /compute/v2.1/flavors => generated 439 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:15:59.137422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1d6b3ab-dcce-4852-9b69-1dfbfdc68696 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:15:59.180744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:59.181934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.204077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.209771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.210620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.212165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.217410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.218208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.833037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:15:59.866393 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a43f7541-ece7-4fc8-bedd-d65462d8f530 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.689954 Sep 14 09:15:59.867726 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 57/83] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:59 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:15:59.878446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:15:59.879389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:15:59.894111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.896013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.897433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:15:59.899065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:15:59.900637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:15:59.901558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.100370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:00.154105 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b7f86cfd-819d-4550-a94e-c1459e192ca7 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1241 microversion: 2.1 time: 0.284759 Sep 14 09:16:00.177653 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 58/84] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:15:59 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:00.194832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1d6b3ab-dcce-4852-9b69-1dfbfdc68696 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1628670328/action" status: 200 len: 97 microversion: 2.1 time: 1.061803 Sep 14 09:16:00.195864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 27/85] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:15:59 2022] POST /compute/v2.1/flavors/1628670328/action => generated 97 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:00.208530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b5134c7-7898-4c7e-b59e-e88b670787c7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:00.897424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:00.898051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:00.911401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.911921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.912519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.915972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:00.916617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:00.917298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:00.987492 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4b5134c7-7898-4c7e-b59e-e88b670787c7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b5134c7-7898-4c7e-b59e-e88b670787c7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Request method failure captured: Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/flavors/1628670328/action HTTP/1.1 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 67 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvM-GyF0l6g0QHWBwPDTj0XEPLzMZnVYmUC-7lC01DYix28WjoR05pXpRBvt_LQzG-Y0bdwPOa0ozQLWg8PSDFiaD6VPZyCQLOeJs_QenYL5RW8Koutf-1vys9D-1sU-5YyHVliRUj9JO7sncuWxxJTCn6fFyoSGBjQ2z1ihmjCG_U Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:16:01.002628 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dbd8bbbd70794336bd754e4377dffa28", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dbd8bbbd70794336bd754e4377dffa28"}]}] Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3f1d788ee00f4a51b750e974ad41db9c Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} Sep 14 09:16:01.004656 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: exception: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '1628670328', 'body': {'addTenantAccess': {'tenant': '5ef42493bf114527936e661af4a0184c'}}} Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:16:01.005613 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-5ef42493bf114527936e661af4a0184c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 09:16:01.015291 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 09:16:01.018434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:16:01.020894 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-5ef42493bf114527936e661af4a0184c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 9, 16, 0, 959500), 'updated_at': None, 'flavor_id': 18, 'project_id': '5ef42493bf114527936e661af4a0184c'}] Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:01.023866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:01.026107 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:01.028714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:01.031293 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. Sep 14 09:16:01.031293 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:01.031293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b5134c7-7898-4c7e-b59e-e88b670787c7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 5ef42493bf114527936e661af4a0184c combination. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:01.031293 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b5134c7-7898-4c7e-b59e-e88b670787c7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1628670328/action" status: 409 len: 152 microversion: 2.1 time: 0.802982 Sep 14 09:16:01.031293 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 59/86] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:16:00 2022] POST /compute/v2.1/flavors/1628670328/action => generated 152 bytes in 814 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:16:01.037930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f2d5c504-be76-4757-b58d-7487f7f7e03b tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:01.329514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.392242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52421449-6c80-4a7f-b243-14a1fda2dedc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.497268 Sep 14 09:16:01.397510 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 28/87] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:00 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.417830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.423887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:01.451825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.454321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.457716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.458958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:01.463108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:01.465174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:01.774368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:01.786368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-472086be-24d8-415b-a521-e942ba4a605a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1295 microversion: 2.1 time: 0.385089 Sep 14 09:16:01.788546 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 29/88] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1295 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:01.835287 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f2d5c504-be76-4757-b58d-7487f7f7e03b tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1628670328/action" status: 200 len: 21 microversion: 2.1 time: 0.816971 Sep 14 09:16:01.839337 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 60/89] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:16:01 2022] POST /compute/v2.1/flavors/1628670328/action => generated 21 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:01.852333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb11965f-5570-48ff-8819-1cb74014dc1a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:01.918211 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb11965f-5570-48ff-8819-1cb74014dc1a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1628670328" status: 202 len: 0 microversion: 2.1 time: 0.071810 Sep 14 09:16:01.920589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 30/90] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:16:01 2022] DELETE /compute/v2.1/flavors/1628670328 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:01.935534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b812304-787e-4494-8d20-1035ecf31054 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.030533 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b812304-787e-4494-8d20-1035ecf31054 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.101312 Sep 14 09:16:02.065071 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 61/91] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:02.116662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5bce6aea-ad37-4141-b79e-d9d24603016e tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1108722688", "id": 611231985, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:02.187333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5bce6aea-ad37-4141-b79e-d9d24603016e tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.099298 Sep 14 09:16:02.201441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-768ca52b-f316-42d6-9eaf-91be7e7c28a9 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.208200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 31/92] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:02 2022] POST /compute/v2.1/flavors => generated 435 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:02.211222 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-768ca52b-f316-42d6-9eaf-91be7e7c28a9 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-768ca52b-f316-42d6-9eaf-91be7e7c28a9 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Request method failure captured: Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/flavors/611231985/os-flavor-access HTTP/1.1 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvM-GyF0l6g0QHWBwPDTj0XEPLzMZnVYmUC-7lC01DYix28WjoR05pXpRBvt_LQzG-Y0bdwPOa0ozQLWg8PSDFiaD6VPZyCQLOeJs_QenYL5RW8Koutf-1vys9D-1sU-5YyHVliRUj9JO7sncuWxxJTCn6fFyoSGBjQ2z1ihmjCG_U Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:16:02.213032 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dbd8bbbd70794336bd754e4377dffa28", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dbd8bbbd70794336bd754e4377dffa28"}]}] Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3f1d788ee00f4a51b750e974ad41db9c Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: exception: Access list not available for public flavors. Sep 14 09:16:02.214421 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'flavor_id': '611231985'} Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 14 09:16:02.215174 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:02.217384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-768ca52b-f316-42d6-9eaf-91be7e7c28a9 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:02.218620 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-768ca52b-f316-42d6-9eaf-91be7e7c28a9 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/611231985/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020903 Sep 14 09:16:02.229784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cee6fe0-b3e4-494c-807b-c755dc0ffddc tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.249611 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 62/93] 10.222.0.90 () {58 vars in 1206 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/flavors/611231985/os-flavor-access => generated 91 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:16:02.280805 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cee6fe0-b3e4-494c-807b-c755dc0ffddc tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/611231985" status: 202 len: 0 microversion: 2.1 time: 0.055901 Sep 14 09:16:02.288161 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 32/94] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:16:02 2022] DELETE /compute/v2.1/flavors/611231985 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:02.294925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5993f8ee-c390-41a9-83fe-3a6ca22a1bd7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.324223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5993f8ee-c390-41a9-83fe-3a6ca22a1bd7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034466 Sep 14 09:16:02.325571 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 63/95] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:02.351704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bc46e63-5a72-4564-a84a-27f95ef81df6 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1823806303", "id": 914535202, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:02.422354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bc46e63-5a72-4564-a84a-27f95ef81df6 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.075055 Sep 14 09:16:02.437141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:02.437976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:02.441247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 33/96] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:02 2022] POST /compute/v2.1/flavors => generated 436 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:02.465543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.467386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.470236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:02.473458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:02.474508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:02.477281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.150938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.160547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a08e3625-0d37-434d-84a7-ea67030c8b06 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.731561 Sep 14 09:16:03.166757 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 64/97] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:02 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.198208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.199131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:03.231243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.233705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.235662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.238187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:03.239628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:03.241044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:03.482299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bc94ba8-3eee-477a-be90-31f34ae1aa8f tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:03.488810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8bc94ba8-3eee-477a-be90-31f34ae1aa8f tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '21bc763c0d2648caa03c85da54e44c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef42493bf114527936e661af4a0184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bc94ba8-3eee-477a-be90-31f34ae1aa8f tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Request method failure captured: Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/flavors/914535202/action HTTP/1.1 Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 67 Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvKbH7K9_K4_jsBgSZr1tpbBtk05xf76vHPY0j9SUOkwtbY3aBUHvIHn2gofSNV57XVZpIJAGJxHxfCTWT26QzH7K_uUxxGDCBLThuzh13RyB91STBEgGnUoHDPKvRDaMwrggqOen1-JkWLJ7baXbsuU-TH2T3wmtB89_PDUgyF_EQ Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 5ef42493bf114527936e661af4a0184c Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:03.507195 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5ef42493bf114527936e661af4a0184c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5ef42493bf114527936e661af4a0184c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5ef42493bf114527936e661af4a0184c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5ef42493bf114527936e661af4a0184c"}]}] Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 5ef42493bf114527936e661af4a0184c Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FlavorsAccessNegativeTestJSON-1113735130-project Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 21bc763c0d2648caa03c85da54e44c3a Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130-project Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} Sep 14 09:16:03.509118 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '914535202', 'body': {'addTenantAccess': {'tenant': '5ef42493bf114527936e661af4a0184c'}}} Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:03.510097 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 14 09:16:03.514973 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:03.529281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:03.541635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bc94ba8-3eee-477a-be90-31f34ae1aa8f tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:03.555711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8bc94ba8-3eee-477a-be90-31f34ae1aa8f tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] 10.222.0.90 "POST /compute/v2.1/flavors/914535202/action" status: 403 len: 130 microversion: 2.1 time: 1.100032 Sep 14 09:16:03.561252 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 34/98] 10.222.0.90 () {60 vars in 1197 bytes} [Wed Sep 14 09:16:02 2022] POST /compute/v2.1/flavors/914535202/action => generated 130 bytes in 1119 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:03.583557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-538e7964-fb00-4acb-9934-eef18b253a91 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.587807 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac45985c-6c94-49f3-b20e-e45265077ee9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1295 microversion: 2.1 time: 0.411366 Sep 14 09:16:03.591776 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 65/99] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:03 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1295 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.651346 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-538e7964-fb00-4acb-9934-eef18b253a91 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/914535202" status: 202 len: 0 microversion: 2.1 time: 0.082136 Sep 14 09:16:03.657557 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 35/100] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:16:03 2022] DELETE /compute/v2.1/flavors/914535202 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:03.664753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd0bbe8a-da86-4290-b7c2-a60ee8286fb4 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:03.750342 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd0bbe8a-da86-4290-b7c2-a60ee8286fb4 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089754 Sep 14 09:16:03.757058 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 66/101] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:03.778484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de2db984-78fd-4989-87ae-8f43568a2ca7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1731231752", "id": 2014588168, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:03.831293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de2db984-78fd-4989-87ae-8f43568a2ca7 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.056060 Sep 14 09:16:03.842783 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 36/102] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:03 2022] POST /compute/v2.1/flavors => generated 439 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:03.861988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8412982d-bbbc-4e59-91b8-500b278725b6 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:03.944529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da522c4-e422-4ce1-8f10-65ba7ccd8fe1", "tag": "92871a70-fbc8-4fdb-bb29-dcb09e0c4dec"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:04.004943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.006274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.007187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.042447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Creating event network-changed:92871a70-fbc8-4fdb-bb29-dcb09e0c4dec for instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 on n-h1-851028-12 Sep 14 09:16:04.043443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:16:04.044198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b85739a-589a-4e6b-b90f-2291adc0b1ec req-6919a2f6-e3ed-4e35-a35b-28db11de64a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:16:04.045951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.046758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.047826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.050598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.051599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.052781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.071526 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.compute.rpcapi [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 09:16:04.073762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] Releasing lock "compute-rpcapi-router" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:16:04.097117 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e7066a0-783b-4b65-8fa0-41ea5540c1da None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289968 Sep 14 09:16:04.100668 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 67/103] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:04.203008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:04.206412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:04.233178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.233671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.238281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.243545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:04.245767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:04.246885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:04.482449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=10 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:04.498048 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8412982d-bbbc-4e59-91b8-500b278725b6 tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/2014588168/action" status: 200 len: 97 microversion: 2.1 time: 0.641620 Sep 14 09:16:04.500541 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 37/104] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:16:03 2022] POST /compute/v2.1/flavors/2014588168/action => generated 97 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:04.510760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0df71ed-2833-4cfc-8d7c-402e46007d02 tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:04.525749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e0df71ed-2833-4cfc-8d7c-402e46007d02 tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '21bc763c0d2648caa03c85da54e44c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef42493bf114527936e661af4a0184c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0df71ed-2833-4cfc-8d7c-402e46007d02 tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Request method failure captured: Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/flavors/2014588168/action HTTP/1.1 Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 70 Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvKbH7K9_K4_jsBgSZr1tpbBtk05xf76vHPY0j9SUOkwtbY3aBUHvIHn2gofSNV57XVZpIJAGJxHxfCTWT26QzH7K_uUxxGDCBLThuzh13RyB91STBEgGnUoHDPKvRDaMwrggqOen1-JkWLJ7baXbsuU-TH2T3wmtB89_PDUgyF_EQ Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 5ef42493bf114527936e661af4a0184c Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:04.534776 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5ef42493bf114527936e661af4a0184c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5ef42493bf114527936e661af4a0184c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5ef42493bf114527936e661af4a0184c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5ef42493bf114527936e661af4a0184c"}]}] Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 5ef42493bf114527936e661af4a0184c Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130 Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FlavorsAccessNegativeTestJSON-1113735130-project Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 21bc763c0d2648caa03c85da54e44c3a Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1113735130-project Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: {"removeTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} Sep 14 09:16:04.536490 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2014588168', 'body': {'removeTenantAccess': {'tenant': '5ef42493bf114527936e661af4a0184c'}}} Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can( Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:04.537545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 14 09:16:04.538944 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:04.541344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0df71ed-2833-4cfc-8d7c-402e46007d02 tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:04.547189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0df71ed-2833-4cfc-8d7c-402e46007d02 tempest-FlavorsAccessNegativeTestJSON-1113735130 tempest-FlavorsAccessNegativeTestJSON-1113735130-project] 10.222.0.90 "POST /compute/v2.1/flavors/2014588168/action" status: 403 len: 133 microversion: 2.1 time: 0.038221 Sep 14 09:16:04.555210 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 38/105] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:16:04 2022] POST /compute/v2.1/flavors/2014588168/action => generated 133 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:04.584279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9517d2c-acb8-406e-9076-fe7270f9d8ce tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5ef42493bf114527936e661af4a0184c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:05.032419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:05.054250 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-00877a41-90a4-4a2e-8c87-00bc06d596a7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.862319 Sep 14 09:16:05.057601 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 68/106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:04 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:05.073087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.074585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:05.094879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.096326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.097318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.098231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:05.100026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:05.100701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:05.244704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9517d2c-acb8-406e-9076-fe7270f9d8ce tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/2014588168/action" status: 200 len: 21 microversion: 2.1 time: 0.685800 Sep 14 09:16:05.248302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 39/107] 10.222.0.90 () {60 vars in 1200 bytes} [Wed Sep 14 09:16:04 2022] POST /compute/v2.1/flavors/2014588168/action => generated 21 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:05.278891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85d99cd0-8bf8-4d75-aee8-f34f0b735a0a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.352955 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85d99cd0-8bf8-4d75-aee8-f34f0b735a0a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/2014588168" status: 202 len: 0 microversion: 2.1 time: 0.092568 Sep 14 09:16:05.357327 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 40/108] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:16:05 2022] DELETE /compute/v2.1/flavors/2014588168 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:05.385275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7937a45b-b5f0-44cf-80d2-e0c3eb6fcb0a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:05.479995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7937a45b-b5f0-44cf-80d2-e0c3eb6fcb0a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.109792 Sep 14 09:16:05.483851 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 41/109] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:05.519031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36b0be4d-a509-429a-9bfd-0fb60cae825f tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-852762428", "id": 680176086, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:05.551585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:05.572366 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-218f4946-afb6-4462-badb-ca22154d8198 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.513176 Sep 14 09:16:05.576360 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 69/110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:05 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:05.601980 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36b0be4d-a509-429a-9bfd-0fb60cae825f tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.100235 Sep 14 09:16:05.603487 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 42/111] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:05 2022] POST /compute/v2.1/flavors => generated 435 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:05.631306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d123ae9-6e5c-4d02-b316-b9f8c8d494cb tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "dbdb760d848449059eae379bccf6cd24"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:06.100544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:06.101547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:06.119923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.120444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.120882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.121623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.122398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.123017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.579433 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-5d123ae9-6e5c-4d02-b316-b9f8c8d494cb tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] HTTP exception thrown: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d123ae9-6e5c-4d02-b316-b9f8c8d494cb tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Request method failure captured: Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/flavors/680176086/action HTTP/1.1 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 70 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvM-GyF0l6g0QHWBwPDTj0XEPLzMZnVYmUC-7lC01DYix28WjoR05pXpRBvt_LQzG-Y0bdwPOa0ozQLWg8PSDFiaD6VPZyCQLOeJs_QenYL5RW8Koutf-1vys9D-1sU-5YyHVliRUj9JO7sncuWxxJTCn6fFyoSGBjQ2z1ihmjCG_U Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:16:06.588207 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_dbd8bbbd70794336bd754e4377dffa28", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/dbd8bbbd70794336bd754e4377dffa28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/dbd8bbbd70794336bd754e4377dffa28"}]}] Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: dbd8bbbd70794336bd754e4377dffa28 Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-785484950 Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3f1d788ee00f4a51b750e974ad41db9c Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: {"removeTenantAccess": {"tenant": "dbdb760d848449059eae379bccf6cd24"}} Sep 14 09:16:06.589554 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: exception: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '680176086', 'body': {'removeTenantAccess': {'tenant': 'dbdb760d848449059eae379bccf6cd24'}}} Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 14 09:16:06.590340 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:06.591461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. Sep 14 09:16:06.592695 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:06.594563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d123ae9-6e5c-4d02-b316-b9f8c8d494cb tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Returning 404 to user: Flavor access not found for 22 / dbdb760d848449059eae379bccf6cd24 combination. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:06.600862 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d123ae9-6e5c-4d02-b316-b9f8c8d494cb tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/680176086/action" status: 404 len: 124 microversion: 2.1 time: 0.974929 Sep 14 09:16:06.607927 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 70/112] 10.222.0.90 () {60 vars in 1197 bytes} [Wed Sep 14 09:16:05 2022] POST /compute/v2.1/flavors/680176086/action => generated 124 bytes in 982 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:06.619002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:06.619612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:06.633542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:06.643919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.649429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.650296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.651209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:06.652430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:06.654289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:06.661762 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-639ea9fc-9fe2-42db-aadd-4410da9a0799 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.562526 Sep 14 09:16:06.676391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 43/113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:06 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:06.697421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67cb57d1-8b86-4440-b51a-7bf6a210c09a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:06.755827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67cb57d1-8b86-4440-b51a-7bf6a210c09a tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/680176086" status: 202 len: 0 microversion: 2.1 time: 0.085752 Sep 14 09:16:06.757349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 44/114] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:16:06 2022] DELETE /compute/v2.1/flavors/680176086 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:06.777505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2fcef4d-9ace-4942-8f7b-1797f742ae7e tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:06.879527 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2fcef4d-9ace-4942-8f7b-1797f742ae7e tempest-FlavorsAccessNegativeTestJSON-785484950 tempest-FlavorsAccessNegativeTestJSON-785484950-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115504 Sep 14 09:16:06.883429 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 45/115] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:07.149542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:07.176850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bd75c012-93bf-4783-b4ea-c08a5b2d7e63 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.564528 Sep 14 09:16:07.178189 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 71/116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:06 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:07.691680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:07.693137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:07.702806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.706126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.709824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.712594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:07.715178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:07.715982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:07.954751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:08.403278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:08.424456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f488ca7c-f607-47b2-bb88-01a896a7734f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.727880 Sep 14 09:16:08.426201 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 46/117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:07 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:08.439260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.443107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:08.473890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.474811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.475965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.476872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.477524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.481213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.553715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:08.621720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6208c658-e6fc-47b5-95f2-4a1a804ca4ee tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1169454093", "id": 1540012481, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:08.672931 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6208c658-e6fc-47b5-95f2-4a1a804ca4ee tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.716025 Sep 14 09:16:08.677352 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 72/118] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:16:07 2022] POST /compute/v2.1/flavors => generated 468 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:08.907304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Calling method '.version_select at 0x7f6944285550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:08.920193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.921330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:08.922095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:08.992177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:08.993055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.000929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.043486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.046190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.049725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.074664 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e8179e0-770c-4813-aa68-a56511c637b2 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.390553 Sep 14 09:16:09.084722 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 73/119] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:09.087439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:09.102151 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-550d3e26-600e-428e-ae63-53a50bb116cb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.666640 Sep 14 09:16:09.114402 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 47/120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:08 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:09.149209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Calling method '.version_select at 0x7f69444d0dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.151519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.159664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.164567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.250241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.263394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.271396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.302525 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26a56c7c-53b0-4bf4-99f6-481953a95415 tempest-HypervisorAdminV228Test-60826095 tempest-HypervisorAdminV228Test-60826095-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.186351 Sep 14 09:16:09.307761 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 48/121] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:09.448855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.449773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:09.469520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.474972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.478003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.483072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:09.489342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:09.490025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:09.589875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-26eb85f0-5f26-412a-ac69-1c11f768e4b5 tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:09.621441 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-26eb85f0-5f26-412a-ac69-1c11f768e4b5 tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] 10.222.0.90 "GET /compute/v2.1/flavors/1540012481" status: 200 len: 468 microversion: 2.61 time: 0.534929 Sep 14 09:16:09.626948 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 74/122] 10.222.0.90 () {60 vars in 1199 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/flavors/1540012481 => generated 468 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:09.661577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f19c3213-afdf-4a2e-915a-7a763fd8e170 tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] Action: 'update', calling method: .version_select at 0x7f69456235e0>, body: {"flavor": {"description": "new"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:09.841299 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f19c3213-afdf-4a2e-915a-7a763fd8e170 tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] 10.222.0.90 "PUT /compute/v2.1/flavors/1540012481" status: 200 len: 469 microversion: 2.61 time: 0.198533 Sep 14 09:16:09.865780 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 75/123] 10.222.0.90 () {62 vars in 1219 bytes} [Wed Sep 14 09:16:09 2022] PUT /compute/v2.1/flavors/1540012481 => generated 469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:09.898715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc83483f-0f58-42ed-8683-07fc9880fa5d tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.026201 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc83483f-0f58-42ed-8683-07fc9880fa5d tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.157220 Sep 14 09:16:10.038353 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 76/124] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:10.070557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0e01ad5a-4a86-444c-a289-416a6d424cba tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.145056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0e01ad5a-4a86-444c-a289-416a6d424cba tempest-FlavorsV261TestJSON-1013237637 tempest-FlavorsV261TestJSON-1013237637-project] 10.222.0.90 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.079143 Sep 14 09:16:10.153580 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 77/125] 10.222.0.90 () {60 vars in 1166 bytes} [Wed Sep 14 09:16:10 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:10.163207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:10.163824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:10.184929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.187678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.190414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:10.194337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:10.195006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:10.197328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:11.053842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.081283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be7c56eb-85db-4579-ba95-8d188cbea027 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 1.635759 Sep 14 09:16:11.104735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 49/126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:09 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:11.124663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78002524-a379-42b9-b4f7-efcd591cbc87 tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:11.153733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=73,nova_api:DELETE=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:11.184695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78002524-a379-42b9-b4f7-efcd591cbc87 tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1540012481" status: 202 len: 0 microversion: 2.61 time: 0.072759 Sep 14 09:16:11.185357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 50/127] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Sep 14 09:16:11 2022] DELETE /compute/v2.1/flavors/1540012481 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:11.400973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:11.414349 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-654c651e-181f-4425-8bdb-e903ee692e1f tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 1.259142 Sep 14 09:16:11.416793 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 78/128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:10 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:11.428622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0c7e304-29ef-4d30-8dc2-dfc424e8c75c tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:11.498378 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0c7e304-29ef-4d30-8dc2-dfc424e8c75c tempest-FlavorsV261TestJSON-1683488881 tempest-FlavorsV261TestJSON-1683488881-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.078848 Sep 14 09:16:11.499318 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 79/129] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:11.856507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e06a8c9d-36f4-4871-803a-a88e4a96c20e", "tag": "9557ab1b-ea1a-46bd-ac09-a3d31c0c5548"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:11.913354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:11.916276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:11.918991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.042651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Creating event network-changed:9557ab1b-ea1a-46bd-ac09-a3d31c0c5548 for instance e06a8c9d-36f4-4871-803a-a88e4a96c20e on n-h2-851028-12 Sep 14 09:16:12.043750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:16:12.044421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ac90282-ec5a-4de6-976c-4a799ff7b163 req-055eb717-d238-47b2-b04d-c056a8999e1b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:16:12.046068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.049184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.049884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.053089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.053739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.056550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.096292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.rpcapi [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 14 09:16:12.097775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] Releasing lock "compute-rpcapi-router" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:16:12.108718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.109615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.126568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.129408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.130626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.134978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.135724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.137353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.146172 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca4b41dc-2738-4406-b713-882dc0df004d None None] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.952695 Sep 14 09:16:12.152041 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 51/130] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:12.447631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:12.448557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:12.462767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.465221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:12.470482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:12.472707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.473661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.473930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:12.474447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:12.479090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ac53acf-23b4-4f62-a279-86e470011c26 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.374234 Sep 14 09:16:12.483658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:12.503458 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 80/131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:13.508584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:13.510140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:13.523958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.526569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.527011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.527727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:13.532452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:13.538685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:13.654378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.664815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-63824848-04db-4550-9296-0c59e11ccfe8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 1.222471 Sep 14 09:16:13.668598 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 52/132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:12 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:13.977588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:13.993026 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-32d8e57e-be60-45b7-b619-5feda0e93b27 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.486028 Sep 14 09:16:14.004277 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 81/133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:13 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:14.693843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:14.694822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:14.704049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:14.705893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:14.708460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:14.709489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:14.710154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:14.712620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.022152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:15.024543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:15.034027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:15.037488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.038261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.039005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.042142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:15.043192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:15.044453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:15.227631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.245513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bdb7638-5325-4369-a4c7-6ac57b804a45 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.556050 Sep 14 09:16:15.246713 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 53/134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:14 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:15.472210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:15.481836 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8341a240-fd21-4ac9-9287-0f19c805c340 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.466446 Sep 14 09:16:15.485245 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 82/135] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:15 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:16.280630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.280630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.283713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.288571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.289276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.291059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.291857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.292564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.511016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:16.512294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:16.521070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.522828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.526795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.528748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:16.529473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:16.530063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:16.868279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.883612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:16.896548 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-309fc271-61db-4e8c-b736-f7e803da8fe2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.389951 Sep 14 09:16:16.896875 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae1fc52f-6f61-433c-a09f-d460f5310108 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.624842 Sep 14 09:16:16.898607 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 83/137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:16.898779 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 54/137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:16 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:17.930193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.931423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.931722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:17.932828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:17.949612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.951824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.953211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.953647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.954783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.955603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.956506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.957556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:17.958449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.958972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:17.959535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:17.960539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:18.403187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:18.417485 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed848471-2aa3-46ef-83b6-b2780f37f885 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.494709 Sep 14 09:16:18.417634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:18.419049 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 55/138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:18.428468 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d78ba6da-b2e1-4cad-bd31-4650769b7be3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.509116 Sep 14 09:16:18.429692 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 84/139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:17 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:18.669066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a115154b-e2b9-4260-a455-c5b90035a3f8 tempest-InstanceUsageAuditLogTestJSON-852595707 tempest-InstanceUsageAuditLogTestJSON-852595707-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:18.713662 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a115154b-e2b9-4260-a455-c5b90035a3f8 tempest-InstanceUsageAuditLogTestJSON-852595707 tempest-InstanceUsageAuditLogTestJSON-852595707-project-admin] 10.222.0.90 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14 09:16:18" status: 200 len: 318 microversion: 2.1 time: 0.292090 Sep 14 09:16:18.723826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 56/140] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:16:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2009%3A16%3A18 => generated 318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:18.728212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-760a4577-dc38-4b54-b039-98dcaa5a3313 tempest-InstanceUsageAuditLogTestJSON-852595707 tempest-InstanceUsageAuditLogTestJSON-852595707-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:18.767092 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-760a4577-dc38-4b54-b039-98dcaa5a3313 tempest-InstanceUsageAuditLogTestJSON-852595707 tempest-InstanceUsageAuditLogTestJSON-852595707-project-admin] 10.222.0.90 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.043040 Sep 14 09:16:18.778397 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 85/141] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:16:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:19.261713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Calling method '.version_select at 0x7f69444e14c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.268040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.268894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.282164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.301892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.302647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.312233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.366238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.366731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.367162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.397175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.400279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.400722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.432571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:19.443596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.445366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.446116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:19.452626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.453084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.460082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.460908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.461802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.464036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.465920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.467292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.471725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b73a5f1f-4e1c-4799-ae4a-125098d8ef13 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.508730 Sep 14 09:16:19.484458 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 57/142] 10.222.0.90 () {60 vars in 1243 bytes} [Wed Sep 14 09:16:18 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:19.498146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.498791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:19.511552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.512334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.513077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.514243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.515156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.515850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.769476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.784979 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff822eae-0bba-49a9-bc91-618796b29f3d tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.344448 Sep 14 09:16:19.796310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 86/143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:19.817718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Calling method '.version_select at 0x7f694420b820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.818822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:19.825241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.827491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.828142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.340952 Sep 14 09:16:19.829253 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 58/144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:19.831124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.832427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b4691145-0129-4f40-8a15-103dae4c2686 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001927 Sep 14 09:16:19.832574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.840251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 59/145] 10.222.0.90 () {56 vars in 886 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:16:19.860265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.860695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.862116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.903236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.903732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.904261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.916104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:19.917414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.917897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.918558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.941055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.941540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.942142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:19.961299 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e8e7b5f0-3a4e-40f7-a3c6-8ecc587cbe7c tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.160183 Sep 14 09:16:19.962637 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 87/146] 10.222.0.90 () {60 vars in 1222 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:19.975994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Calling method '.version_select at 0x7f694451a550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:19.985737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:19.990015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:19.990571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.016481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.017110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.017768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.025171 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9bc8a352-ad51-413b-b625-d18f2588f2a1 tempest-HypervisorAdminV253TestBase-1478342097 tempest-HypervisorAdminV253TestBase-1478342097-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/ecb6efdd-8d1e-4809-9dac-1c0a9840203a" status: 200 len: 794 microversion: 2.53 time: 0.052765 Sep 14 09:16:20.026126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 60/147] 10.222.0.90 () {60 vars in 1298 bytes} [Wed Sep 14 09:16:19 2022] GET /compute/v2.1/os-hypervisors/ecb6efdd-8d1e-4809-9dac-1c0a9840203a => generated 794 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:16:20.336357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da522c4-e422-4ce1-8f10-65ba7ccd8fe1", "name": "network-vif-plugged", "status": "completed", "tag": "92871a70-fbc8-4fdb-bb29-dcb09e0c4dec"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:20.353442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.354035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.354874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.369314 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] Creating event network-vif-plugged:92871a70-fbc8-4fdb-bb29-dcb09e0c4dec for instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 on n-h1-851028-12 Sep 14 09:16:20.375282 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-09254473-deaa-4678-9ff9-f395009ba0a7 req-d8ed1525-95b9-4ae4-8de4-efa54f83376e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387570 Sep 14 09:16:20.376409 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 88/148] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:20.821956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.822645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.836513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.837296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.837880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.838835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.839203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.839625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.855594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:20.857096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:20.874738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.876901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.879871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:20.882069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:20.884921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:20.886071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:21.306329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.329797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1685bdd-4f2a-4aab-88d7-51c0a016801f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.511245 Sep 14 09:16:21.345038 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 61/149] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:21.429765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:21.442036 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e2bddd3d-43fe-4eaa-be2d-e80a3ca63594 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.593052 Sep 14 09:16:21.443391 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 89/150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:20 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:22.360627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:22.361764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:22.365638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:22.372319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.372746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.373191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.373902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.374356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.374784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.466985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:22.468437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:22.478643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.482132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.483857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.488994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:22.489928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:22.491240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:22.856474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:22.879401 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c8c4c55-bbe8-4259-98c6-d61613ccbc1b tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1320 microversion: 2.1 time: 0.524439 Sep 14 09:16:22.882163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 62/151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:22 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:22.916332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:22.926632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-efc67a04-42e9-4ec9-abce-01c6f0bc9feb tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.463912 Sep 14 09:16:22.928202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 90/152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:22 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:23.223714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06a8c9d-36f4-4871-803a-a88e4a96c20e", "name": "network-vif-plugged", "status": "completed", "tag": "9557ab1b-ea1a-46bd-ac09-a3d31c0c5548"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:23.234560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.235382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.236613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.251474 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] Creating event network-vif-plugged:9557ab1b-ea1a-46bd-ac09-a3d31c0c5548 for instance e06a8c9d-36f4-4871-803a-a88e4a96c20e on n-h2-851028-12 Sep 14 09:16:23.260925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-34e3e546-1d5b-4778-9b47-3b51699f1361 req-6fed9b6d-c65f-41b7-a10f-c2d22ef551de service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042369 Sep 14 09:16:23.262195 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 63/153] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:23.915633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:23.916660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:23.933180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.933820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.935368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.937176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.937999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:23.938927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:23.955998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:23.958636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:23.998659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:23.999436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.000968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.008493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:24.008917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:24.010016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:24.386192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.398255 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9f757bd-8a2f-4b80-9c4b-11891d5ae7bc tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1470 microversion: 2.1 time: 0.492909 Sep 14 09:16:24.399518 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 91/154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:23 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:24.436057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:24.447554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-845f9061-5145-40e2-a31c-78644ed250e9 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.500613 Sep 14 09:16:24.448730 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 64/155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:23 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:25.192886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.193678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:25.211973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.212447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.213652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.216376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.217115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.218802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.387187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:25.478472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.480117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:25.489115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.490547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.491196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.492285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:25.493087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:25.493992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:25.742068 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-00d81cd7-06f2-4c95-aa79-c50da8d84bcc tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] 10.222.0.90 "DELETE /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 204 len: 0 microversion: 2.1 time: 1.315510 Sep 14 09:16:25.742724 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 92/156] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:24 2022] DELETE /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 0 bytes in 1320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:16:25.758470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:25.760751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:26.112319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.113920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.117228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.118126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:26.124705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:26.126318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:26.141858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.158978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6a7ac3a-d9b4-43d5-a84d-98f454d44f60 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1337 microversion: 2.1 time: 0.687989 Sep 14 09:16:26.163370 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 65/157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:25 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1337 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:26.650639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:26.687341 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a248f771-5127-4406-813e-d632e94ef1cb tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1476 microversion: 2.1 time: 0.936641 Sep 14 09:16:26.689684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 93/158] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:25 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1476 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:27.217120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:27.220021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:27.230424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-319348cf-d49e-4148-865d-667722dc8a06 tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] Calling method '.version_select at 0x7f69444b8700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:27.254583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.258929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.260735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:27.264406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:27.268003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:27.269437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.058312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-319348cf-d49e-4148-865d-667722dc8a06 tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] 10.222.0.90 "GET /compute/v2.1/os-networks" status: 200 len: 3319 microversion: 2.1 time: 1.502808 Sep 14 09:16:28.060348 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 66/159] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:16:26 2022] GET /compute/v2.1/os-networks => generated 3319 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:28.073216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.073722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.082744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.083570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.084548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.085504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.086440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.087075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.242606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.263689 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6096d80e-a039-4576-b966-0a3b6fe9c8c4 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1487 microversion: 2.1 time: 1.066379 Sep 14 09:16:28.266283 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 94/160] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:27 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1487 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:28.299283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd1c63c8-e612-4ba6-bb82-2c32e3f931aa tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] Calling method '.version_select at 0x7f69442cae50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.441671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:28.450395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a363ed2-c16d-4123-a9ae-9cbd651fcdc1 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 200 len: 1434 microversion: 2.1 time: 0.388771 Sep 14 09:16:28.451288 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 67/161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 1434 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:28.703443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:28.768859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:28.768859 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd1c63c8-e612-4ba6-bb82-2c32e3f931aa tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] 10.222.0.90 "GET /compute/v2.1/os-networks/76214266-b29b-429f-97e6-62240ee2e9e9" status: 200 len: 652 microversion: 2.1 time: 0.468146 Sep 14 09:16:28.768859 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 95/162] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/os-networks/76214266-b29b-429f-97e6-62240ee2e9e9 => generated 652 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:28.769281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.769817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:28.783802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.784333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.784970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.798136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.800059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.801439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.889056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Calling method '.version_select at 0x7f69444a18b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:28.890897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.891383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.891814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.931122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.933244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.935126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.958144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.958882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.959493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:28.969583 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2deac0f7-8dff-4a61-b389-7e43c1f375a9 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.516950 Sep 14 09:16:28.970154 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 68/163] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:28.976504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da522c4-e422-4ce1-8f10-65ba7ccd8fe1", "name": "network-vif-deleted", "tag": "92871a70-fbc8-4fdb-bb29-dcb09e0c4dec"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:28.988151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:28.988866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:28.989458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.004497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] Creating event network-vif-deleted:92871a70-fbc8-4fdb-bb29-dcb09e0c4dec for instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 on n-h1-851028-12 Sep 14 09:16:29.011425 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-372e85a2-863b-442b-bea1-ed1a0bca200e req-9ea3ca0a-8388-47e3-a04a-917ec29eb1eb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039361 Sep 14 09:16:29.025052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 69/164] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:29.031165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1761d343-e76a-4046-8ca6-edec38c729ed tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] Calling method '.version_select at 0x7f69443b5ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.322052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1761d343-e76a-4046-8ca6-edec38c729ed tempest-NetworksTest-1343468808 tempest-NetworksTest-1343468808-project-admin] 10.222.0.90 "GET /compute/v2.1/os-networks" status: 200 len: 3319 microversion: 2.1 time: 0.295302 Sep 14 09:16:29.327615 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 70/165] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-networks => generated 3319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:29.494426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f69444525e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.498424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.498922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.499356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.500146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.500583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.501005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.535520 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1d890fe-5249-4dbe-b0e4-dff0aca6e6cf tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.205998 Sep 14 09:16:29.536652 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 71/166] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:29.542845 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94008e4e-77c6-4355-907a-5691a45cb0a0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1640 microversion: 2.1 time: 0.778392 Sep 14 09:16:29.550034 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 96/167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:28 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1640 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:29.568677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.569457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.577300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.577807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.578265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.581807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.582515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.584708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.594710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:29.607301 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 HTTP/1.1 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:29.610674 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:29.612939 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3da522c4-e422-4ce1-8f10-65ba7ccd8fe1'} Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:29.614239 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:29.619274 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.623232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:29.623232 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ddcfdfe-50e3-4cc9-a896-ee4497a87917 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 404 len: 111 microversion: 2.1 time: 0.061029 Sep 14 09:16:29.628597 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 97/168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:29.639519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f69441de9d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.645448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.646146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.646779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.647878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.648644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.649078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.688473 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-249d0665-e108-44cd-99ca-7c8894a45904 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.057044 Sep 14 09:16:29.695782 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 98/169] 10.222.0.90 () {58 vars in 1139 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:29.696770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.697115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:29.711815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.718433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.719338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.720447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.721274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.721919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.760798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:29.763478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e72638ce-cb16-458a-8e58-d67054b083f5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Calling method '.version_select at 0x7f6944416ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.765744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e72638ce-cb16-458a-8e58-d67054b083f5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '28ed351d705745fa8edc1a33fd45b3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c6558b8f414437b7a7961e8a47dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e72638ce-cb16-458a-8e58-d67054b083f5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Request method failure captured: Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/n-h2-851028-12/search HTTP/1.1 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvqXdk9qeRBUpgEV25ksKlb2Ghg7eUtTghUwj0WaePKIVZUMg1D6F7rq-Jn2epkYzCTDSNehHhM8b3ptq_OaSedDR4129n3ypcpyEkDipFx046N1-Ps7JIDvqZ6w8J5wpY54l5TcN8C-xAXysHLMiAD_Bt5DyQFv_2U7wiBm22lg7o Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 64c6558b8f414437b7a7961e8a47dbe2 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:29.769233 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_64c6558b8f414437b7a7961e8a47dbe2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/64c6558b8f414437b7a7961e8a47dbe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/64c6558b8f414437b7a7961e8a47dbe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/64c6558b8f414437b7a7961e8a47dbe2"}]}] Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 64c6558b8f414437b7a7961e8a47dbe2 Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-132888919-project Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28ed351d705745fa8edc1a33fd45b3cf Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919-project Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 09:16:29.770871 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'n-h2-851028-12'} Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:29.771636 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 14 09:16:29.773537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.775691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e72638ce-cb16-458a-8e58-d67054b083f5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:29.777081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e72638ce-cb16-458a-8e58-d67054b083f5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/n-h2-851028-12/search" status: 403 len: 117 microversion: 2.1 time: 0.239285 Sep 14 09:16:29.780971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 72/170] 10.222.0.90 () {58 vars in 1212 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-12/search => generated 117 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:29.807212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f69444524c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.819983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.820463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.821622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.824653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.826258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.828075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.895037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b3cbf20-2727-44e4-8869-8f967385c9a8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.112831 Sep 14 09:16:29.902014 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 73/171] 10.222.0.90 () {58 vars in 1145 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:29.910173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Calling method '.version_select at 0x7f6944452310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:29.912837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:29.916709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:29.917291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:29.936348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Request method failure captured: Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvrsNO15JrtCcAh5_-4lZImaZMqOcGqebQBQ4HaP0USSUaAp05SS0q3aJccSLzd2EXue8XOe9JPWM-VyGO4xsEQcwgpNurjYNVfAl-1fMl8Dxw4neeu0ZGlEJNBvnlbpUQxJfjnPsEJdW3t7v3HGs3clNWSyGViexJVfN3ymJ-1JLQ Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a4115dadf1ff4cd39d71ccce45432360 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:29.939286 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a4115dadf1ff4cd39d71ccce45432360", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a4115dadf1ff4cd39d71ccce45432360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a4115dadf1ff4cd39d71ccce45432360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a4115dadf1ff4cd39d71ccce45432360"}]}] Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a4115dadf1ff4cd39d71ccce45432360 Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b6390a7dd56540f894734deb803165ca Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 09:16:29.940970 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:29.941669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:29.942852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77053a57-c21b-45cf-bc5e-aac46b041ab4 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.038232 Sep 14 09:16:29.943918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 74/172] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:16:29 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:29.958687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-492670316", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:30.006967 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9c694aa-b49e-4983-8822-c973ffcf68f1 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 204 len: 0 microversion: 2.1 time: 0.313360 Sep 14 09:16:30.007585 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 99/173] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:29 2022] DELETE /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:30.029283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Calling method '.version_select at 0x7f6944137820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.032231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.032827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.034651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.056985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:30.060294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.061082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.061679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.074620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.075457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.076250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.086670 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-369f299b-464f-48c4-93ed-612f1c212f4c tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.069627 Sep 14 09:16:30.095707 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 100/174] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:30.103127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.104396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:30.113313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.114541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.115713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.117104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.118136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.118933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.421626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:30.438724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f6ab887a-c4b1-438e-ba78-6312101ab529 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1493 microversion: 2.1 time: 0.340805 Sep 14 09:16:30.441467 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 101/175] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1493 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:30.450405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4948801b-c7ab-45d0-83fa-75c21d4ac0c5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Calling method '.version_select at 0x7f6945a76670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.454201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4948801b-c7ab-45d0-83fa-75c21d4ac0c5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '28ed351d705745fa8edc1a33fd45b3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c6558b8f414437b7a7961e8a47dbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4948801b-c7ab-45d0-83fa-75c21d4ac0c5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Request method failure captured: Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvqXdk9qeRBUpgEV25ksKlb2Ghg7eUtTghUwj0WaePKIVZUMg1D6F7rq-Jn2epkYzCTDSNehHhM8b3ptq_OaSedDR4129n3ypcpyEkDipFx046N1-Ps7JIDvqZ6w8J5wpY54l5TcN8C-xAXysHLMiAD_Bt5DyQFv_2U7wiBm22lg7o Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 64c6558b8f414437b7a7961e8a47dbe2 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:30.458769 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_64c6558b8f414437b7a7961e8a47dbe2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/64c6558b8f414437b7a7961e8a47dbe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/64c6558b8f414437b7a7961e8a47dbe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/64c6558b8f414437b7a7961e8a47dbe2"}]}] Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 64c6558b8f414437b7a7961e8a47dbe2 Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919 Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-132888919-project Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 28ed351d705745fa8edc1a33fd45b3cf Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-132888919-project Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 09:16:30.461490 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '1'} Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:30.463183 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 14 09:16:30.465413 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.467397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4948801b-c7ab-45d0-83fa-75c21d4ac0c5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:30.467397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4948801b-c7ab-45d0-83fa-75c21d4ac0c5 tempest-HypervisorAdminNegativeUnderV252Test-132888919 tempest-HypervisorAdminNegativeUnderV252Test-132888919-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.020380 Sep 14 09:16:30.471470 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 102/176] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:30.481365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:30.482513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:30.482513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:30.482849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:30.482998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:30.497375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.498454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.498454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.499097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.499723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.500338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.526847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Getting quotas for project a3b1d50d5a294b7dbb4872750404dce6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:30.532432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Getting quotas for user 1847a213fbac4b75a751337e7ddd6ddf and project a3b1d50d5a294b7dbb4872750404dce6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:30.557676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:16:30.563172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:16:30.660755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aedeed4b-983e-4af3-a3c5-82f21b469b3e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715105 Sep 14 09:16:30.662609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 75/177] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:16:30.671222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-659052718", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b41e49db-121e-4bc1-879b-5eb8e9fa3036"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:30.671732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Calling method '.version_select at 0x7f69444521f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.675562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:30.676435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:30.677209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:30.689728 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] HTTP exception thrown: No hypervisor matching '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7' could be found. Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Request method failure captured: Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/8012e585-37c4-4a9e-8d55-6ebbc4e42eb7/servers HTTP/1.1 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvrsNO15JrtCcAh5_-4lZImaZMqOcGqebQBQ4HaP0USSUaAp05SS0q3aJccSLzd2EXue8XOe9JPWM-VyGO4xsEQcwgpNurjYNVfAl-1fMl8Dxw4neeu0ZGlEJNBvnlbpUQxJfjnPsEJdW3t7v3HGs3clNWSyGViexJVfN3ymJ-1JLQ Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a4115dadf1ff4cd39d71ccce45432360 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:30.692643 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a4115dadf1ff4cd39d71ccce45432360", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a4115dadf1ff4cd39d71ccce45432360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a4115dadf1ff4cd39d71ccce45432360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a4115dadf1ff4cd39d71ccce45432360"}]}] Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a4115dadf1ff4cd39d71ccce45432360 Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739 Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b6390a7dd56540f894734deb803165ca Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: exception: No hypervisor matching '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7' could be found. Sep 14 09:16:30.693838 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7'} Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7' could be found. Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.694486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7' could be found. Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] Returning 404 to user: No hypervisor matching '8012e585-37c4-4a9e-8d55-6ebbc4e42eb7' could be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:30.695492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e63f76b-ec02-492f-8f84-21e8b0c65636 tempest-HypervisorAdminNegativeUnderV252Test-497772739 tempest-HypervisorAdminNegativeUnderV252Test-497772739-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/8012e585-37c4-4a9e-8d55-6ebbc4e42eb7/servers" status: 404 len: 123 microversion: 2.1 time: 0.031005 Sep 14 09:16:30.696796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 76/178] 10.222.0.90 () {58 vars in 1281 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/os-hypervisors/8012e585-37c4-4a9e-8d55-6ebbc4e42eb7/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:30.710358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd3fd7ca-5663-46ab-a61e-995d9d758224 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:30.712089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd3fd7ca-5663-46ab-a61e-995d9d758224 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:30.866549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] validate_networks() for [('b41e49db-121e-4bc1-879b-5eb8e9fa3036', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:30.967428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd3fd7ca-5663-46ab-a61e-995d9d758224 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:30.993660 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd3fd7ca-5663-46ab-a61e-995d9d758224 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1219 microversion: 2.1 time: 0.292990 Sep 14 09:16:30.995321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 77/179] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:30 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1219 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:31.467881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:31.468997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:31.477360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.478263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.478919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.479821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:31.480667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:31.482028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:31.923084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:31.940040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd8a5932-7a8f-4e1f-9f9f-79ec5aeeeac5 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1493 microversion: 2.1 time: 0.478664 Sep 14 09:16:31.941361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 78/180] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:31 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1493 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:32.021063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.021695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.038287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.040464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.041806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.045398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.046316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.046963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.391634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:32.409211 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1130ce3-3998-4400-a15a-23431b344c36 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1271 microversion: 2.1 time: 0.388453 Sep 14 09:16:32.410099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 79/181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1271 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:32.628674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:32.629923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:32.630605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:32.631266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:32.633260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:32.658971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.659828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.662173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.663158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.667242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.668902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.695157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:32.702370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for user c92c2abda1124946b2adcb0b0560fd0c and project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:32.717175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:16:32.722279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:16:32.797049 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-96941202-3524-4d23-9613-049b6111143a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.324144 Sep 14 09:16:32.798672 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 103/182] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:16:32.811116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.811722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.971698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:32.972468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:32.985340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.986999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.989766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:32.991077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:32.991973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:32.993454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.028872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.047840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.052220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.053958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38002f62-3a97-4fed-ae61-3309baca266d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1261 microversion: 2.25 time: 0.247319 Sep 14 09:16:33.055069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 80/183] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1261 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:33.452789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:33.455220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:33.471161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.483044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.483603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.484500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:33.484988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:33.485420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:33.815171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.826610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-425af48d-6e9b-4d27-a098-47b5b9069a44 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1277 microversion: 2.1 time: 0.384232 Sep 14 09:16:33.827220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 81/184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:33 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1277 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:33.903031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:33.917196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-522b9dba-1ad9-405e-a6e9-b87a866322a3 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1493 microversion: 2.1 time: 0.951603 Sep 14 09:16:33.920996 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 104/185] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:32 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1493 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:34.086745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.087371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:34.104317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.105043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.105638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.106968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.109511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.110300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.319726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:34.338475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:34.340299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:34.351766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-303230c1-e901-4a38-b51f-421f57d98ee1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1265 microversion: 2.25 time: 0.262423 Sep 14 09:16:34.354152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 82/186] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:34 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:34.553507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e06a8c9d-36f4-4871-803a-a88e4a96c20e", "name": "network-vif-deleted", "tag": "9557ab1b-ea1a-46bd-ac09-a3d31c0c5548"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:34.570121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.571198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.571849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.585427 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] Creating event network-vif-deleted:9557ab1b-ea1a-46bd-ac09-a3d31c0c5548 for instance e06a8c9d-36f4-4871-803a-a88e4a96c20e on n-h2-851028-12 Sep 14 09:16:34.591790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-bbe7148f-3a28-4c96-8f7b-b5078568f5a3 req-b3add822-f8b9-4eff-a958-5b61d5e3a44d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046774 Sep 14 09:16:34.593169 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 105/187] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:34.857258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.857882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:34.866455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.870911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.872706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.874458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.876601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.879961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.949473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:34.951510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:34.970922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.971414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.971848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:34.972638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:34.973088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:34.973544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.117661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.118581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.119515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.121263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lazy-loading 'fault' on Instance uuid e06a8c9d-36f4-4871-803a-a88e4a96c20e {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:35.366584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.378634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d411b50c-0bcf-4fda-ac26-b7cb62c0deb2 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.523516 Sep 14 09:16:35.381212 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 83/188] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:34 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:35.390783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '765f8ca2a67742c9899851ae8bad8d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d71b76895c448f7a8f219badb96d77c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.410096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:35.411005 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d7d6f30-fda8-4bc2-bb6d-f1d170f210b8 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 200 len: 1327 microversion: 2.1 time: 0.467122 Sep 14 09:16:35.414610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:35.416669 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 106/189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:34 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 1327 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:35.432282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.433114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.433647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.434628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.435521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.436029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.573016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.590288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.596371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:35.601513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73b7068e-1545-4224-aba7-ad50c2643f40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1319 microversion: 2.25 time: 0.217452 Sep 14 09:16:35.604017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 84/190] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:35 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:35.901676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cd9b8a6-9771-4733-9538-47e8997305d4", "tag": "13330de3-50d1-420a-ad5f-1d1b4de5f82a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:35.924388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:35.925229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:35.926963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:35.951992 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] Creating event network-changed:13330de3-50d1-420a-ad5f-1d1b4de5f82a for instance 4cd9b8a6-9771-4733-9538-47e8997305d4 on n-h1-851028-12 Sep 14 09:16:35.960052 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e4a4171b-8222-448f-a275-0c55b16b1928 req-2ec656a2-595c-46f5-9d79-43e8e9875c0b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062705 Sep 14 09:16:35.961076 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 107/191] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:36.405254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.405875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.417604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.425982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.426715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.427928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.428622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.429760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.450389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.453020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.462373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:36.475867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.481004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.481731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.482684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.483351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.483954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.521986 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] HTTP exception thrown: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Request method failure captured: Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e HTTP/1.1 Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFLdjt6p0nVHsuJZb-LXihNac6gArTlopA1OlM491_3X5xEqZ6_XV5t3cSHyisNLHwfW9Ndc2HX2H55_ZqJQpyXD0E9huzY9iVn-1WWnN8lEdmbDekHSMwr0a0voluZQ6pV69bXdz2UDZvhJ2hESwfYmjvX8AbIGT30ZrhUJvdgdA Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:36.528110 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2d71b76895c448f7a8f219badb96d77c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2d71b76895c448f7a8f219badb96d77c"}]}] Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 765f8ca2a67742c9899851ae8bad8d40 Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:36.529556 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e06a8c9d-36f4-4871-803a-a88e4a96c20e'} Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:36.530376 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:36.531676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:36.534445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Returning 404 to user: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:36.539206 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a432312-4f43-4d6f-bf50-91d3e35a2ff6 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 404 len: 111 microversion: 2.1 time: 0.102348 Sep 14 09:16:36.542744 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 108/192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:36 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:16:36.552360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5778826d-83ae-4ce8-8dbf-267579bcfe5e tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:36.567002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5778826d-83ae-4ce8-8dbf-267579bcfe5e tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.567794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5778826d-83ae-4ce8-8dbf-267579bcfe5e tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.568446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5778826d-83ae-4ce8-8dbf-267579bcfe5e tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.773624 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5778826d-83ae-4ce8-8dbf-267579bcfe5e tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 297 microversion: 2.1 time: 0.228093 Sep 14 09:16:36.779988 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 109/193] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:16:36 2022] POST /compute/v2.1/os-aggregates/2/action => generated 297 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:36.779988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:36.780496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:36.788023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.788586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.789031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.789866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:36.790323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:36.790798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:36.985111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:36.995232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c17bda9-0d42-47e0-b707-09256688d898 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.594397 Sep 14 09:16:37.000017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 85/194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:36 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:37.062579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.072404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.073950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:37.075255 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e55d24b7-2c54-41a6-8e57-85a9381fd873 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.299264 Sep 14 09:16:37.087930 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 110/195] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:36 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:37.087930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d1b1aaa1-969b-457b-9e8f-89379436747d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.126300 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d1b1aaa1-969b-457b-9e8f-89379436747d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.048595 Sep 14 09:16:37.127317 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 111/196] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:37 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:37.151165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2aca37dc-b71d-42a5-b334-57c109abcb5d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-881753945"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.156605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-2aca37dc-b71d-42a5-b334-57c109abcb5d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid 977b9070-4ec6-4a0c-aa93-aeb323ed01bb for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:37.190180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2aca37dc-b71d-42a5-b334-57c109abcb5d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044282 Sep 14 09:16:37.193383 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 112/197] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:37.205183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9c73354e-fee2-4b4d-aaef-02a127bd78eb tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.223932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c73354e-fee2-4b4d-aaef-02a127bd78eb tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.225024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c73354e-fee2-4b4d-aaef-02a127bd78eb tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.225659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c73354e-fee2-4b4d-aaef-02a127bd78eb tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.248000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:37.406888 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9c73354e-fee2-4b4d-aaef-02a127bd78eb tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.205595 Sep 14 09:16:37.409818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 113/198] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:16:37 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:37.425834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c1ce9e15-846e-43b8-b1de-f762c885b7fd tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.460418 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c1ce9e15-846e-43b8-b1de-f762c885b7fd tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.036264 Sep 14 09:16:37.464450 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 114/199] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:37.476498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cc768e44-aea4-4893-8af5-1195f034bbd2 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.507686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc768e44-aea4-4893-8af5-1195f034bbd2 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.511544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc768e44-aea4-4893-8af5-1195f034bbd2 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.512646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc768e44-aea4-4893-8af5-1195f034bbd2 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.513841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Action: 'update', calling method: .version_select at 0x7f6944416ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.721110 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cc768e44-aea4-4893-8af5-1195f034bbd2 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.251058 Sep 14 09:16:37.722478 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 115/200] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:16:37 2022] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:37.804605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31cbc7dc-13c8-4da5-9ca6-36fa5631d839 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.809935 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-31cbc7dc-13c8-4da5-9ca6-36fa5631d839 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31cbc7dc-13c8-4da5-9ca6-36fa5631d839 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin] Request method failure captured: Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZv1BLZ-SHkHY7hviaR8p57_SgMyj8_yNPDhHVzb6GpyIakTe6_OGQL-huP8s-dnJlfLaY4aMMzzr5s8vVBHj0WxWQYDJBgPBJ6uUwevTt8h-FNwfZCet1zI6FhogxShog5gKETaCAuJxWGVpAVbg87bwiDVtNx1TVPnCgk_7g1m2GA Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 79df25267eb542f39727e2a7cd160e86 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:16:37.816417 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_79df25267eb542f39727e2a7cd160e86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/79df25267eb542f39727e2a7cd160e86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/79df25267eb542f39727e2a7cd160e86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/79df25267eb542f39727e2a7cd160e86"}]}] Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 79df25267eb542f39727e2a7cd160e86 Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: a1a078b092ad4a1b939a33d26b72197b Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:37.817607 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid timestamp for date invalid_time Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'invalid_time'} Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:37.818232 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 14 09:16:37.819370 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:37.821730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31cbc7dc-13c8-4da5-9ca6-36fa5631d839 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:37.822662 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31cbc7dc-13c8-4da5-9ca6-36fa5631d839 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283 tempest-InstanceUsageAuditLogNegativeTestJSON-1434456283-project-admin] 10.222.0.90 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.098438 Sep 14 09:16:37.828774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 116/201] 10.222.0.90 () {58 vars in 1224 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:16:37.833884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e511a14-5958-4459-b9ce-fef73682e888", "tag": "32931be0-7f56-4e3a-bd97-cb563ad853a6"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:37.862058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.872544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.873010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.880821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.881314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.881749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.882482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:37.882936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:37.883361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:37.885489 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] Creating event network-changed:32931be0-7f56-4e3a-bd97-cb563ad853a6 for instance 2e511a14-5958-4459-b9ce-fef73682e888 on n-h1-851028-12 Sep 14 09:16:37.892854 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-b82e68a8-6ac7-408f-bc74-8f9551d53666 req-4b21d143-1480-470a-80f8-d49dff6d22e0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067741 Sep 14 09:16:37.893781 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 117/202] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:37.899020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfe209ac-a8b5-4636-addb-e02a98a6c45d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:37.929544 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfe209ac-a8b5-4636-addb-e02a98a6c45d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.034532 Sep 14 09:16:37.933089 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 118/203] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:37 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:38.026313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:38.030052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e722e92-19f9-43e1-b41f-fb39591f72b8 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f" status: 200 len: 240 microversion: 2.36 time: 1.032719 Sep 14 09:16:38.038991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 86/204] 10.222.0.90 () {62 vars in 1303 bytes} [Wed Sep 14 09:16:36 2022] PUT /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f => generated 240 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:38.038991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89d5c6f5-8754-4a78-bb0a-47d9654812f3 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-856097249"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:38.042314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-89d5c6f5-8754-4a78-bb0a-47d9654812f3 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid f84d48a6-2a5d-4f83-b13b-4c22dc02a36a for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:38.067861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89d5c6f5-8754-4a78-bb0a-47d9654812f3 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.033876 Sep 14 09:16:38.068508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 87/205] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:38 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:38.074337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.075503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:38.082965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.083511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.083989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.084757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.085225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.085843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.101690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ccebe833-68c5-48f9-af10-2c6971f1ab20 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.103499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ccebe833-68c5-48f9-af10-2c6971f1ab20 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0722c0fe7f784ac387fa7d428b4b8574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b3a451991454e8006d896c3811cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ccebe833-68c5-48f9-af10-2c6971f1ab20 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Request method failure captured: Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZv0RJLlOzbK753NruXHBLA7sr_G93-bl_6-GY3Qu5F1PvbjK3Y3q6prkqydTWMtBe76xW8DVP2oC4izh37NYZljTKnjckItQ-HlExMMgPXZHe_KkPMol0xwELJacsxfKNTNjBp7PRsEItoWy-97xv-4lfo7aA3iAFiq0tTgS9uECkM Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6c5b3a451991454e8006d896c3811cd6 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:38.105699 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6c5b3a451991454e8006d896c3811cd6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c5b3a451991454e8006d896c3811cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c5b3a451991454e8006d896c3811cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6c5b3a451991454e8006d896c3811cd6"}]}] Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6c5b3a451991454e8006d896c3811cd6 Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0722c0fe7f784ac387fa7d428b4b8574 Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project Sep 14 09:16:38.107063 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:38.107638 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 14 09:16:38.113998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.115265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ccebe833-68c5-48f9-af10-2c6971f1ab20 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:38.115265 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ccebe833-68c5-48f9-af10-2c6971f1ab20 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] 10.222.0.90 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.172909 Sep 14 09:16:38.115265 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 119/206] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:16:37 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:38.115534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Calling method '.version_select at 0x7f693fffc0d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.190654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.191139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.191577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.192344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.192793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.193346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.215681 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5cd07710-fee8-4fa8-abe5-73669bcdf1d0 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f/detail" status: 200 len: 672 microversion: 2.36 time: 0.106625 Sep 14 09:16:38.216377 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 120/207] 10.222.0.90 () {60 vars in 1304 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f/detail => generated 672 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:38.220992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5c96e024-1060-4f72-b2a0-92c8b7f5529d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:38.238645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c96e024-1060-4f72-b2a0-92c8b7f5529d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.239483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c96e024-1060-4f72-b2a0-92c8b7f5529d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.240231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c96e024-1060-4f72-b2a0-92c8b7f5529d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.318834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.328112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1479aa97-5433-48fd-8d49-3599e235ea23 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.258334 Sep 14 09:16:38.329210 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 88/208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:38.335533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.336367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:38.343313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.346975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.347421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.348282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.348629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.349051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.418232 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5c96e024-1060-4f72-b2a0-92c8b7f5529d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.200809 Sep 14 09:16:38.418921 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 121/209] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:16:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:38.425682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d93ebfb1-1ca1-4645-a1d6-4a644bec0659 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.427853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d93ebfb1-1ca1-4645-a1d6-4a644bec0659 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0722c0fe7f784ac387fa7d428b4b8574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5b3a451991454e8006d896c3811cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d93ebfb1-1ca1-4645-a1d6-4a644bec0659 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Request method failure captured: Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2009:16:38 HTTP/1.1 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZv0RJLlOzbK753NruXHBLA7sr_G93-bl_6-GY3Qu5F1PvbjK3Y3q6prkqydTWMtBe76xW8DVP2oC4izh37NYZljTKnjckItQ-HlExMMgPXZHe_KkPMol0xwELJacsxfKNTNjBp7PRsEItoWy-97xv-4lfo7aA3iAFiq0tTgS9uECkM Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6c5b3a451991454e8006d896c3811cd6 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:38.429524 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6c5b3a451991454e8006d896c3811cd6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c5b3a451991454e8006d896c3811cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c5b3a451991454e8006d896c3811cd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6c5b3a451991454e8006d896c3811cd6"}]}] Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6c5b3a451991454e8006d896c3811cd6 Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0722c0fe7f784ac387fa7d428b4b8574 Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project Sep 14 09:16:38.430999 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '2022-09-14 09:16:38'} Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:38.431633 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 14 09:16:38.432739 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:38.435005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d93ebfb1-1ca1-4645-a1d6-4a644bec0659 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:38.435005 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d93ebfb1-1ca1-4645-a1d6-4a644bec0659 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024 tempest-InstanceUsageAuditLogNegativeTestJSON-386956024-project] 10.222.0.90 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14 09:16:38" status: 403 len: 128 microversion: 2.1 time: 0.010953 Sep 14 09:16:38.435005 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 122/210] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-14%2009%3A16%3A38 => generated 128 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:38.436102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Action: 'update', calling method: .version_select at 0x7f694419dd30>, body: {"quota_set": {"ram": "2048"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:38.510891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.511702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.512391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.513116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.513271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.513702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.514224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.523862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.526448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:38.528517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4f4ddd3-e38c-49c1-ac66-af6ea8e923e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.197274 Sep 14 09:16:38.529485 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 89/211] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:38.558999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.559639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.560215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.561055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.561736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.562297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.563783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e33d15f5-53dc-4bd5-8b8d-27d97d5b859a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.572440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e33d15f5-53dc-4bd5-8b8d-27d97d5b859a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.026610 Sep 14 09:16:38.573361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 90/212] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:38.593741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb5e16a1-b100-4477-95e8-31d471793939 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:38.606241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb5e16a1-b100-4477-95e8-31d471793939 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:38.606884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb5e16a1-b100-4477-95e8-31d471793939 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:38.607447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb5e16a1-b100-4477-95e8-31d471793939 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:38.637452 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2df6d6db-3bfd-469a-b0e8-feadc256c971 tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f?user_id=5607fc8ccf8244cfb9d423718603837b" status: 200 len: 240 microversion: 2.36 time: 0.204951 Sep 14 09:16:38.638210 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 123/213] 10.222.0.90 () {62 vars in 1384 bytes} [Wed Sep 14 09:16:38 2022] PUT /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f?user_id=5607fc8ccf8244cfb9d423718603837b => generated 240 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:38.650954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40d79eff-b872-433e-ad25-6d6870cbacdc tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] Calling method '.version_select at 0x7f69441ded30>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:38.986378 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40d79eff-b872-433e-ad25-6d6870cbacdc tempest-QuotasAdminTestV236-1560839711 tempest-QuotasAdminTestV236-1560839711-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f?user_id=5607fc8ccf8244cfb9d423718603837b" status: 200 len: 282 microversion: 2.36 time: 0.338993 Sep 14 09:16:38.999108 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 124/214] 10.222.0.90 () {60 vars in 1364 bytes} [Wed Sep 14 09:16:38 2022] GET /compute/v2.1/os-quota-sets/4f241f57547148dcb8820a2fa588a29f?user_id=5607fc8ccf8244cfb9d423718603837b => generated 282 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:16:39.108814 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb5e16a1-b100-4477-95e8-31d471793939 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.522329 Sep 14 09:16:39.118468 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 91/215] 10.222.0.90 () {60 vars in 1191 bytes} [Wed Sep 14 09:16:38 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:39.123723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-892d5247-14e1-49c4-be0f-b70758b894f0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.170716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-892d5247-14e1-49c4-be0f-b70758b894f0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.050720 Sep 14 09:16:39.172759 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 125/216] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:39 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 14 09:16:39.184662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d066361-823a-47ea-86ee-444a47c14d6d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-534166845"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:39.189332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-4d066361-823a-47ea-86ee-444a47c14d6d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid f3ed9d76-bfe2-4c30-9b4d-18a241c6b4d9 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:39.216825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d066361-823a-47ea-86ee-444a47c14d6d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037092 Sep 14 09:16:39.217690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 92/217] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:39.235175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-820418e6-5821-47c2-9a29-625f7e8a440d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:39.250560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-820418e6-5821-47c2-9a29-625f7e8a440d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.251056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-820418e6-5821-47c2-9a29-625f7e8a440d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.252307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-820418e6-5821-47c2-9a29-625f7e8a440d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.360479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.360479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:39.391518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.413572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.414614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.415266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.421054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.421831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.493483 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-820418e6-5821-47c2-9a29-625f7e8a440d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.263395 Sep 14 09:16:39.495178 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 126/218] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:39.508069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9e893fe7-eea7-4cf5-a62a-e5e3078a85e4 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:39.526474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e893fe7-eea7-4cf5-a62a-e5e3078a85e4 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.527197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e893fe7-eea7-4cf5-a62a-e5e3078a85e4 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.527942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e893fe7-eea7-4cf5-a62a-e5e3078a85e4 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.689452 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9e893fe7-eea7-4cf5-a62a-e5e3078a85e4 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.185859 Sep 14 09:16:39.690622 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 127/219] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:39 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:39.697528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:39.698433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:39.707343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.708452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.709208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:39.710207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:39.710796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:39.711544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.000095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.010091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94ec081a-8abf-4e0c-8be8-9701da6c2a85 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.656144 Sep 14 09:16:40.026843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 93/220] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:39 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:16:40.031875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-213497ff-0cd0-4175-ab32-7ee4366038f0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.067999 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-213497ff-0cd0-4175-ab32-7ee4366038f0 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.039697 Sep 14 09:16:40.074571 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 94/221] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:40.083816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d2dfa59-00c9-43b7-9797-c38d69e2ae6b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2050423528"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.088672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-7d2dfa59-00c9-43b7-9797-c38d69e2ae6b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid ae57d7a3-5097-4443-8c8e-5079b925011d for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:40.124873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d2dfa59-00c9-43b7-9797-c38d69e2ae6b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047910 Sep 14 09:16:40.132410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 95/222] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.139403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f69444288b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.151008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.151708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.152466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.153238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.153697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.154114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.192049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.199687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1293dfcc-75bf-4cbb-8e64-15def9ebc265 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.065921 Sep 14 09:16:40.200499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 96/223] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.206426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.209106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c3ff280a-a60e-470b-9b0f-26f64987dc60 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.209237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.210501 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-108860cf-33f2-4ee2-8ce8-83967e38121a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.518385 Sep 14 09:16:40.211139 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 128/224] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:39 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:40.215561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f693ff46f70>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.219717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.220795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.221778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.223154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.224878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.225517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.262178 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-608b6da2-c24b-4f6a-a9d8-70d893e5bac8 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.049826 Sep 14 09:16:40.263043 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 129/225] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.277425 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c3ff280a-a60e-470b-9b0f-26f64987dc60 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.073697 Sep 14 09:16:40.280900 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 97/226] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:40.284347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f693fffc8b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.289066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.289901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.290449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.291377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.291962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.292524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.297714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3ef-93f9-48b1-9182-9645e9886da9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.301245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:40.318812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3f4ed3ef-93f9-48b1-9182-9645e9886da9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3ef-93f9-48b1-9182-9645e9886da9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Request method failure captured: Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvHQ7h06G82AUPW9jf8adqNdbSVDRHAHAnnrL3W7QTL6_AOfx525EQfmLUdc9D2ewRmMTetOjPHHxIgM9NcIBPyQYa7qa3a2_qzVODp1X_xuvsg6bgkF4tC7Sx01Q8Aia1N3wzmsISxWr5AQQHyftFGQsTB-xUxLlUkFZpqY9jcGyU Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:40.323259 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_04426387d57c409f89d9a197a217e6a9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/04426387d57c409f89d9a197a217e6a9"}]}] Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 60cba5e45e2a47e6bdef209d92d0f8da Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: exception: Aggregate 11 could not be found. Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '11'} Sep 14 09:16:40.326138 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.327742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 14 09:16:40.331872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.336378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f4ed3ef-93f9-48b1-9182-9645e9886da9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:40.336378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f4ed3ef-93f9-48b1-9182-9645e9886da9 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.040100 Sep 14 09:16:40.336378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 98/227] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:16:40.343506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-155370a1-779e-4587-9db7-4f7a76539d89 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.348022 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-041fd2fc-8bde-4d03-a59a-c54d30468a88 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.074015 Sep 14 09:16:40.349253 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 130/228] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.361745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f69441ded30>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.365689 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-155370a1-779e-4587-9db7-4f7a76539d89 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-155370a1-779e-4587-9db7-4f7a76539d89 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Request method failure captured: Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvHQ7h06G82AUPW9jf8adqNdbSVDRHAHAnnrL3W7QTL6_AOfx525EQfmLUdc9D2ewRmMTetOjPHHxIgM9NcIBPyQYa7qa3a2_qzVODp1X_xuvsg6bgkF4tC7Sx01Q8Aia1N3wzmsISxWr5AQQHyftFGQsTB-xUxLlUkFZpqY9jcGyU Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:40.368278 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_04426387d57c409f89d9a197a217e6a9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/04426387d57c409f89d9a197a217e6a9"}]}] Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 60cba5e45e2a47e6bdef209d92d0f8da Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: exception: Aggregate 11 could not be found. Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '11'} Sep 14 09:16:40.370685 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:40.374281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.378211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.382335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-155370a1-779e-4587-9db7-4f7a76539d89 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:40.383254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.383461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-155370a1-779e-4587-9db7-4f7a76539d89 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.036415 Sep 14 09:16:40.383650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.383650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.384022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 99/229] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:16:40.384022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42bed435-32e8-4edb-801c-0f968bc9503c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-825852553"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.384920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-42bed435-32e8-4edb-801c-0f968bc9503c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 9434ae63-cead-4e2b-981f-204b433b29c6 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:40.391535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.392732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.393268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.402348 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9744208-49d5-47b8-904a-0a4d043416db tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-h2-851028-12" status: 200 len: 335 microversion: 2.1 time: 0.044645 Sep 14 09:16:40.403937 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 131/230] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-hosts/n-h2-851028-12 => generated 335 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:40.407812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b54ff0b0-9dc8-4dc0-8603-68cc6d855c4d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-55444781", "name": "tempest-test_aggregate-605396494"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.411563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-b54ff0b0-9dc8-4dc0-8603-68cc6d855c4d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid 5703da8e-9549-4c59-8433-19465c6b80f6 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:40.434992 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42bed435-32e8-4edb-801c-0f968bc9503c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058481 Sep 14 09:16:40.436990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 100/231] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.439787 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b54ff0b0-9dc8-4dc0-8603-68cc6d855c4d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.035325 Sep 14 09:16:40.440716 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 132/232] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.457913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Calling method '.version_select at 0x7f6944428b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.458192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-88307046-ea33-4ec4-a2ba-47f6efc69869 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.465943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=5 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:40.466334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.467225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.467540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.474389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88307046-ea33-4ec4-a2ba-47f6efc69869 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.475039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88307046-ea33-4ec4-a2ba-47f6efc69869 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.475568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88307046-ea33-4ec4-a2ba-47f6efc69869 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.486404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.487092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.487698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.556019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ca5b3b8-8256-46f7-83e3-667c72f86979 tempest-HostsAdminTestJSON-1011727925 tempest-HostsAdminTestJSON-1011727925-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hosts/n-h1-851028-12" status: 200 len: 603 microversion: 2.1 time: 0.105280 Sep 14 09:16:40.567619 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 101/233] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-hosts/n-h1-851028-12 => generated 603 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.578750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73b5aa63-3e35-47b1-b2f8-c9edce7b83ea tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.639439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73b5aa63-3e35-47b1-b2f8-c9edce7b83ea tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.069678 Sep 14 09:16:40.641168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 102/234] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:40.652362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1d12a4f-e463-4d59-a5d5-0598bd3f5a47 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.665411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a1d12a4f-e463-4d59-a5d5-0598bd3f5a47 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1d12a4f-e463-4d59-a5d5-0598bd3f5a47 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Request method failure captured: Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvHQ7h06G82AUPW9jf8adqNdbSVDRHAHAnnrL3W7QTL6_AOfx525EQfmLUdc9D2ewRmMTetOjPHHxIgM9NcIBPyQYa7qa3a2_qzVODp1X_xuvsg6bgkF4tC7Sx01Q8Aia1N3wzmsISxWr5AQQHyftFGQsTB-xUxLlUkFZpqY9jcGyU Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:40.669410 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_04426387d57c409f89d9a197a217e6a9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/04426387d57c409f89d9a197a217e6a9"}]}] Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 60cba5e45e2a47e6bdef209d92d0f8da Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: exception: Aggregate 13 could not be found. Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '13'} Sep 14 09:16:40.672028 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.674272 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 14 09:16:40.676597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.679973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1d12a4f-e463-4d59-a5d5-0598bd3f5a47 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:40.679973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1d12a4f-e463-4d59-a5d5-0598bd3f5a47 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.025507 Sep 14 09:16:40.679973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 103/235] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:16:40.685878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfd278f8-4448-417d-af32-c51cead36f05 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.721466 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-dfd278f8-4448-417d-af32-c51cead36f05 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfd278f8-4448-417d-af32-c51cead36f05 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Request method failure captured: Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvHQ7h06G82AUPW9jf8adqNdbSVDRHAHAnnrL3W7QTL6_AOfx525EQfmLUdc9D2ewRmMTetOjPHHxIgM9NcIBPyQYa7qa3a2_qzVODp1X_xuvsg6bgkF4tC7Sx01Q8Aia1N3wzmsISxWr5AQQHyftFGQsTB-xUxLlUkFZpqY9jcGyU Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:40.725724 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_04426387d57c409f89d9a197a217e6a9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04426387d57c409f89d9a197a217e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/04426387d57c409f89d9a197a217e6a9"}]}] Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 04426387d57c409f89d9a197a217e6a9 Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1545492415 Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 60cba5e45e2a47e6bdef209d92d0f8da Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminTestJSON-1545492415-project-admin Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: exception: Aggregate 13 could not be found. Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '13'} Sep 14 09:16:40.727216 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:40.728213 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.729505 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.730852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.730852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:40.730852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:40.730852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 14 09:16:40.730852 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.731196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-88307046-ea33-4ec4-a2ba-47f6efc69869 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.281047 Sep 14 09:16:40.731196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 133/236] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.733050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfd278f8-4448-417d-af32-c51cead36f05 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:40.742521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dfd278f8-4448-417d-af32-c51cead36f05 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.055841 Sep 14 09:16:40.742903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1bea0f49-739a-4070-9484-e732466620d1 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.748670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 104/237] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:40 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:16:40.752055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1bea0f49-739a-4070-9484-e732466620d1 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cee79e71a6e644a1843597827c87a67b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7711885e75ed43beb48851ef41f920db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1bea0f49-739a-4070-9484-e732466620d1 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Request method failure captured: Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 43 Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFYPGnWsKnZxMyinTnmhie7FiDbN1Cgu04WqMbNYMIpY_HCsg8Dfg8XFCNj-bVJN0nPehG1ut6GwMmkDPwego-L5vAM18gr3j6MeU7aYwko8OSxhdMQcqGEqEp0Q_p4GXKBjS1HBciCRrUwhjPnlzywG6gxux3lTW_vIYw0swR8oY Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:40.755341 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7711885e75ed43beb48851ef41f920db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7711885e75ed43beb48851ef41f920db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7711885e75ed43beb48851ef41f920db"}]}] Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7711885e75ed43beb48851ef41f920db Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-92402851 Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: cee79e71a6e644a1843597827c87a67b Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-92402851-project Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: {"remove_host": {"host": "n-h2-851028-12"}} Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:40.756622 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-851028-12'}}} Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:40.757348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 14 09:16:40.758377 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:40.759369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1bea0f49-739a-4070-9484-e732466620d1 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:40.762188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-666f5875-8603-4601-9b78-4f33c28cef2d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2069731301"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.762600 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1bea0f49-739a-4070-9484-e732466620d1 tempest-AggregatesAdminNegativeTestJSON-92402851 tempest-AggregatesAdminNegativeTestJSON-92402851-project] 10.222.0.90 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.026625 Sep 14 09:16:40.765811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-666f5875-8603-4601-9b78-4f33c28cef2d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid 5d9e9d15-39d4-46e8-9871-b8ac15bdfbfe for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:40.767386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 134/238] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:40.786721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-91510cce-99cf-48d3-830d-3422bf6f1b40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.807603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91510cce-99cf-48d3-830d-3422bf6f1b40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:40.809425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91510cce-99cf-48d3-830d-3422bf6f1b40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:40.810446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91510cce-99cf-48d3-830d-3422bf6f1b40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:40.843847 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-666f5875-8603-4601-9b78-4f33c28cef2d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.091050 Sep 14 09:16:40.844608 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 105/239] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.864013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5a10533-4dc2-490a-adac-cd8e3d73a55a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:40.874385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5a10533-4dc2-490a-adac-cd8e3d73a55a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.014953 Sep 14 09:16:40.880561 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 106/240] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.896070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-554bfbe4-f420-48ce-a1b5-892a005cea24 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:40.961677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-554bfbe4-f420-48ce-a1b5-892a005cea24 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.076348 Sep 14 09:16:40.962996 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 107/241] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:40.991489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ada1a45-837b-4611-b035-c523dd629523 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.006649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ada1a45-837b-4611-b035-c523dd629523 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.034409 Sep 14 09:16:41.008197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 108/242] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:16:40 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.029492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab3bc5a5-4e98-4e4f-8e6b-b3342d36461b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.053190 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-91510cce-99cf-48d3-830d-3422bf6f1b40 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.283811 Sep 14 09:16:41.061727 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 135/243] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.073313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.073922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.077176 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab3bc5a5-4e98-4e4f-8e6b-b3342d36461b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.060729 Sep 14 09:16:41.078277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 109/244] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:41 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:41.086859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6d87369-41ff-458b-a5f2-ed3489644a9c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.093743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.094239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.094674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.096019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.096464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.096897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.132229 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6d87369-41ff-458b-a5f2-ed3489644a9c tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.052785 Sep 14 09:16:41.137721 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 110/245] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:41 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:41.154460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-620a4310-aa6d-4af1-9aba-f3f8982ec29b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1938529934", "availability_zone": "tempest-test_az-1999946204"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.205371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-620a4310-aa6d-4af1-9aba-f3f8982ec29b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid 7ee4b2b1-5522-4adc-acca-15fa0236ee08 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:41.273574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-620a4310-aa6d-4af1-9aba-f3f8982ec29b tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.130221 Sep 14 09:16:41.284349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 111/246] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Sep 14 09:16:41 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.288007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a6f6f90-03fe-4d37-94a3-cc08070c2755 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1437981250"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.292728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-0a6f6f90-03fe-4d37-94a3-cc08070c2755 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Generated uuid 8d623259-c2f6-4ab7-84dc-5b8989f9000d for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:41.305117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=11 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:41.331115 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a6f6f90-03fe-4d37-94a3-cc08070c2755 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.047781 Sep 14 09:16:41.332357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 112/247] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.340352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-63b49728-c3f6-47a9-92d0-512f3635a821 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-310569537"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.346616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.aggregate [None req-63b49728-c3f6-47a9-92d0-512f3635a821 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Generated uuid 4be6401a-6cf8-424a-bff0-1d3c99a8b888 for aggregate {{(pid=122444) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:41.376328 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-63b49728-c3f6-47a9-92d0-512f3635a821 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.042489 Sep 14 09:16:41.377596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 113/248] 10.222.0.90 () {62 vars in 1205 bytes} [Wed Sep 14 09:16:41 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:41.390475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.391363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:41.403698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.405414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.406354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.409795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.410432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.411396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.421189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.437853 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-42ac04d1-9b38-467c-adc5-241fda022531 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.374504 Sep 14 09:16:41.439579 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 136/249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:41.460704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9af89c4-2b48-4730-8d28-912d8952f857 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1938529934_new", "availability_zone": "tempest-test_az-1999946204_new"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.622741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.666368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.672534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:41.674210 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c07ae282-3a16-4425-b3bf-4217ee12ad32 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.294614 Sep 14 09:16:41.675055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 114/250] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:41.685503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.701012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9af89c4-2b48-4730-8d28-912d8952f857 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.702499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9af89c4-2b48-4730-8d28-912d8952f857 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.704426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9af89c4-2b48-4730-8d28-912d8952f857 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.724590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.726000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.727124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.744231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:41.747050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:41.749229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:41.766679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.compute.aggregates [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 14 09:16:41.768517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Request method failure captured: Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 42 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvH0XZMCusEHLViH6drfg7ys8VHuhl5XnLETld8dJ8g1otqgsD9vKqGYg0erOXBumQybZQB5C4kujoBPvKDp83kJTpE2sW2N9RK9WcrsnN4BrGegz2zw4kpcEYbWYfNOsvPPQPLWoDJqyYBvLr7V5yieT-n78q0vYITyUW9AXlCPY4 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:16:41.773582 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_281155dd4c8a44248f058a7d92147f24", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/281155dd4c8a44248f058a7d92147f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/281155dd4c8a44248f058a7d92147f24"}]}] Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 281155dd4c8a44248f058a7d92147f24 Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787 Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ea85581cd4634d3a9b7506e1909ed713 Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: {"remove_host": {"host": "nonexist_host"}} Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:41.775666 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot remove host nonexist_host in aggregate 16 Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 14 09:16:41.778657 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 14 09:16:41.781093 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.783955 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Sep 14 09:16:41.786277 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:41.790157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:41.790735 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-acf17582-6e3b-464d-b6fa-07b762777754 tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.113456 Sep 14 09:16:41.793566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 115/251] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:16:41 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:16:41.810031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6131dad8-7ab5-4cbc-bd7f-98ab9a4d95d8 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1331610736"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:41.835826 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9af89c4-2b48-4730-8d28-912d8952f857 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 337 microversion: 2.1 time: 0.394724 Sep 14 09:16:41.846971 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 137/252] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:16:41 2022] PUT /compute/v2.1/os-aggregates/15 => generated 337 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.857151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56ab05e0-832f-4aab-b3ff-ca6d5c3d35ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.916519 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56ab05e0-832f-4aab-b3ff-ca6d5c3d35ec tempest-AggregatesAdminNegativeTestJSON-1028156787 tempest-AggregatesAdminNegativeTestJSON-1028156787-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.065829 Sep 14 09:16:41.917618 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 138/253] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:41 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:41.926812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18efb1ed-89aa-4724-922f-52fde33f4932 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:41.953084 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18efb1ed-89aa-4724-922f-52fde33f4932 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 200 len: 554 microversion: 2.1 time: 0.030703 Sep 14 09:16:41.960506 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 139/254] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:16:41 2022] GET /compute/v2.1/os-aggregates => generated 554 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:41.981437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07dff723-c6ef-4724-b926-20a44ef9775d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.048322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07dff723-c6ef-4724-b926-20a44ef9775d tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.077839 Sep 14 09:16:42.056499 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 140/255] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:41 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:16:42.073860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-81d859ce-90e0-40dc-a0ee-33a4812cb324 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-501180591"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:42.085664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-81d859ce-90e0-40dc-a0ee-33a4812cb324 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Generated uuid 9ef288ad-8fe0-4457-9ecd-7c20b60ae992 for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:16:42.154815 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-81d859ce-90e0-40dc-a0ee-33a4812cb324 tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.092184 Sep 14 09:16:42.168782 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 141/256] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:16:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:42.180621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78e0a5d9-1a5d-4a21-b9ea-cbba5236502f tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.207156 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78e0a5d9-1a5d-4a21-b9ea-cbba5236502f tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 200 len: 444 microversion: 2.1 time: 0.034383 Sep 14 09:16:42.207943 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 142/257] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/os-aggregates => generated 444 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:42.226232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d403524-938d-47ec-8130-b72f8ab18a3a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.285399 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d403524-938d-47ec-8130-b72f8ab18a3a tempest-AggregatesAdminTestJSON-1545492415 tempest-AggregatesAdminTestJSON-1545492415-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.062721 Sep 14 09:16:42.286832 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 143/258] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:16:42 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 14 09:16:42.298925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.299824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.309626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.310269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.310957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.312490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.313228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.313765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.318525 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6131dad8-7ab5-4cbc-bd7f-98ab9a4d95d8 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 300 microversion: 2.41 time: 0.522057 Sep 14 09:16:42.324639 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 116/259] 10.222.0.90 () {62 vars in 1213 bytes} [Wed Sep 14 09:16:41 2022] PUT /compute/v2.1/os-aggregates/17 => generated 300 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:42.331291 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] HTTP exception thrown: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.331886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cecec0a6-3241-4860-9201-87e199afd7fa tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Request method failure captured: Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e HTTP/1.1 Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFLdjt6p0nVHsuJZb-LXihNac6gArTlopA1OlM491_3X5xEqZ6_XV5t3cSHyisNLHwfW9Ndc2HX2H55_ZqJQpyXD0E9huzY9iVn-1WWnN8lEdmbDekHSMwr0a0voluZQ6pV69bXdz2UDZvhJ2hESwfYmjvX8AbIGT30ZrhUJvdgdA Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:42.333263 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2d71b76895c448f7a8f219badb96d77c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2d71b76895c448f7a8f219badb96d77c"}]}] Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 765f8ca2a67742c9899851ae8bad8d40 Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.336481 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e06a8c9d-36f4-4871-803a-a88e4a96c20e'} Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:42.337866 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.339143 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.340493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Returning 404 to user: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:42.340493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a78529e-bac0-4c8d-aa60-5fc890dd8f94 tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 404 len: 111 microversion: 2.1 time: 0.042834 Sep 14 09:16:42.340493 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 144/260] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:42 2022] DELETE /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:42.346590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.347307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] [instance: e06a8c9d-36f4-4871-803a-a88e4a96c20e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.348317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cecec0a6-3241-4860-9201-87e199afd7fa tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/17" status: 200 len: 300 microversion: 2.41 time: 0.021098 Sep 14 09:16:42.355083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.355647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.356177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.356762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 117/261] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/os-aggregates/17 => generated 300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:42.357153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.357454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.358020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.374693 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] HTTP exception thrown: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.377047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68358435-9bee-42c1-a0b4-47489d26acb3 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Request method failure captured: Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e HTTP/1.1 Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZvFLdjt6p0nVHsuJZb-LXihNac6gArTlopA1OlM491_3X5xEqZ6_XV5t3cSHyisNLHwfW9Ndc2HX2H55_ZqJQpyXD0E9huzY9iVn-1WWnN8lEdmbDekHSMwr0a0voluZQ6pV69bXdz2UDZvhJ2hESwfYmjvX8AbIGT30ZrhUJvdgdA Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:42.379998 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2d71b76895c448f7a8f219badb96d77c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2d71b76895c448f7a8f219badb96d77c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2d71b76895c448f7a8f219badb96d77c"}]}] Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2d71b76895c448f7a8f219badb96d77c Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-770921888 Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 765f8ca2a67742c9899851ae8bad8d40 Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AggregatesAdminTestJSON-770921888-project Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.381482 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e06a8c9d-36f4-4871-803a-a88e4a96c20e'} Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:42.382275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. Sep 14 09:16:42.383582 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:42.385245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] Returning 404 to user: Instance e06a8c9d-36f4-4871-803a-a88e4a96c20e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:42.385245 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b6d5d771-4eee-42b4-9235-1bf77667c10a tempest-AggregatesAdminTestJSON-770921888 tempest-AggregatesAdminTestJSON-770921888-project] 10.222.0.90 "GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e" status: 404 len: 111 microversion: 2.1 time: 0.041589 Sep 14 09:16:42.385245 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 145/262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/e06a8c9d-36f4-4871-803a-a88e4a96c20e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:42.400099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68358435-9bee-42c1-a0b4-47489d26acb3 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.400660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68358435-9bee-42c1-a0b4-47489d26acb3 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.401172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68358435-9bee-42c1-a0b4-47489d26acb3 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.464268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.464927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.481289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.484541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.486720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.489499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.489967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.490843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.638878 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68358435-9bee-42c1-a0b4-47489d26acb3 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 316 microversion: 2.41 time: 0.279394 Sep 14 09:16:42.639557 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 118/263] 10.222.0.90 () {62 vars in 1235 bytes} [Wed Sep 14 09:16:42 2022] POST /compute/v2.1/os-aggregates/17/action => generated 316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:42.653272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2376d754-4c44-4ea5-92eb-546b78a0304a tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:42.675671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376d754-4c44-4ea5-92eb-546b78a0304a tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.676486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376d754-4c44-4ea5-92eb-546b78a0304a tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.678105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376d754-4c44-4ea5-92eb-546b78a0304a tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.799671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:42.819721 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5851db7-b80c-4528-a966-239c3acad63f tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.359832 Sep 14 09:16:42.822028 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 146/264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:42.838977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.841047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:42.858774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.859356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.860048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.861181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:42.861841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:42.862541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:42.921501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2376d754-4c44-4ea5-92eb-546b78a0304a tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 300 microversion: 2.41 time: 0.272963 Sep 14 09:16:42.922727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 119/265] 10.222.0.90 () {62 vars in 1235 bytes} [Wed Sep 14 09:16:42 2022] POST /compute/v2.1/os-aggregates/17/action => generated 300 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:42.935500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37713f28-ba36-4f07-a11b-5bb61797db80 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:42.965724 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37713f28-ba36-4f07-a11b-5bb61797db80 tempest-AggregatesAdminTestV241-1261327204 tempest-AggregatesAdminTestV241-1261327204-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.41 time: 0.034100 Sep 14 09:16:42.966851 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 120/266] 10.222.0.90 () {60 vars in 1196 bytes} [Wed Sep 14 09:16:42 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:16:43.066116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:43.087491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:43.100521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:43.101905 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d4502a8e-f014-43fa-9ee2-1b89139cdbda tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.276703 Sep 14 09:16:43.115924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 147/267] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:42 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:43.610694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd9b8a6-9771-4733-9538-47e8997305d4", "name": "network-vif-plugged", "status": "completed", "tag": "13330de3-50d1-420a-ad5f-1d1b4de5f82a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:43.639961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.640870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.641517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.666884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] Creating event network-vif-plugged:13330de3-50d1-420a-ad5f-1d1b4de5f82a for instance 4cd9b8a6-9771-4733-9538-47e8997305d4 on n-h1-851028-12 Sep 14 09:16:43.675687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-dc72308e-02ec-491d-b493-21111712846f req-774cc834-12b1-49a8-85b4-ed2607f2fc9b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069574 Sep 14 09:16:43.677540 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 121/268] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:43.850058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:43.850873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:43.867939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.870898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.871287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:43.875097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:43.875962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:43.876612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.134810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:44.136119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:44.147457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.149577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.153478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.156238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:44.158491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:44.160456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:44.302182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.325683 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9992cefc-665e-4987-af0b-e0c999defe57 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1319 microversion: 2.1 time: 0.480810 Sep 14 09:16:44.326511 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 148/269] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:43 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:44.522673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.538636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.541255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:44.544898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fae250b9-6bc6-4093-8e63-58d9580cb32c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.417726 Sep 14 09:16:44.560204 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 122/270] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:44 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:45.356069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.357561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.364601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.365403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.366180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.367105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.367785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.368348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.575473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.576743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.579242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.589488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b72125a2-6e32-4214-9bc5-8f1e82df9710 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1469 microversion: 2.1 time: 0.240471 Sep 14 09:16:45.589798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.591424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.592775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.593651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.594644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.597811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.602149 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 149/271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:45.615247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:45.620059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.641159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.641653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.642149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.645119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.659773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.661148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.788589 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7b466d5-1983-4a59-9fc3-520fae7bc14e tempest-DeleteServersAdminTestJSON-1001248933 tempest-DeleteServersAdminTestJSON-1001248933-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4/action" status: 202 len: 0 microversion: 2.1 time: 0.178489 Sep 14 09:16:45.789453 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 150/272] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:16:45 2022] POST /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:16:45.796538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e511a14-5958-4459-b9ce-fef73682e888", "name": "network-vif-plugged", "status": "completed", "tag": "32931be0-7f56-4e3a-bd97-cb563ad853a6"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:45.818374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.819032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.819626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.834571 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] Creating event network-vif-plugged:32931be0-7f56-4e3a-bd97-cb563ad853a6 for instance 2e511a14-5958-4459-b9ce-fef73682e888 on n-h1-851028-12 Sep 14 09:16:45.844106 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-10d5a2be-0b3c-4426-b183-6f54c137d7cc req-df6ccab3-f6d7-4014-8fe5-d8f75cd66cdd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053055 Sep 14 09:16:45.847330 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 151/273] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:45.848762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.854751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:45.855461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:45.863759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.867049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.867486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.868064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.868566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:45.869135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.869829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.870086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f114d53a-5844-40f7-ae2d-b4e9e44915ee tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.300593 Sep 14 09:16:45.870425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.870797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 123/274] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:45.923456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:45.933828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:45.934899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:45.935603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lazy-loading 'fault' on Instance uuid 4cd9b8a6-9771-4733-9538-47e8997305d4 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:46.158332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:46.171167 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34cac374-0f77-4e0d-96a4-543d2c0d2d21 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1452 microversion: 2.1 time: 0.322641 Sep 14 09:16:46.172329 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 152/275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:45 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1452 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:46.199304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:46.200446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:46.213552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.214711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.216321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.218688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.219165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.219606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.261783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:16:46.423549 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5601bf1-f18a-4b49-9b7a-b2323e3fba6e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 204 len: 0 microversion: 2.1 time: 0.228849 Sep 14 09:16:46.424600 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 124/276] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:46 2022] DELETE /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:46.433627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:46.434715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:46.443222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.443978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.444555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.445269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.445714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.446318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.485603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.486288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.486787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.487439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lazy-loading 'fault' on Instance uuid 4cd9b8a6-9771-4733-9538-47e8997305d4 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:46.666762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:46.675672 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3e43441f-40ac-4062-83e7-1b3b9dbb9c73 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1458 microversion: 2.1 time: 0.246574 Sep 14 09:16:46.677557 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 153/277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:46 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1458 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:46.916391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:46.918653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:46.937004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.937481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.937921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:46.939795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:46.940166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:46.940825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.121701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:47.131202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:47.132808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:47.133968 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c8833a7-09fb-4c44-a0f7-9938c65ee14c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1361 microversion: 2.25 time: 0.241090 Sep 14 09:16:47.134979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 125/278] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:46 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:47.702755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:47.705258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:47.719534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.720157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.721059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.724122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.724796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.725549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.773332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:47.773615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:47.773883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:47.774333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lazy-loading 'fault' on Instance uuid 4cd9b8a6-9771-4733-9538-47e8997305d4 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:47.970839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:47.994708 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03f64345-c07d-449c-a931-0df1a514b51e tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1458 microversion: 2.1 time: 0.298638 Sep 14 09:16:48.000386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 154/279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:47 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1458 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:48.164956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:48.168134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:48.176154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:48.204090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.209772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.211974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.217257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:48.220386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:48.221115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:48.564313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:48.580132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:48.582398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:48.584273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-729b8b98-f7f2-414f-9006-68c68318e2bd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1557 microversion: 2.25 time: 0.428128 Sep 14 09:16:48.602184 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 126/280] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:48 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1557 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:48.972192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=24 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:49.272439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:49.273059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:49.286954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.287456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.287926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.288639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.289092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.289494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.542544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 2e511a14-5958-4459-b9ce-fef73682e888 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:49.622474 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b4e6c1b1-a381-4963-8016-f8d34b3cacbe tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 2051 microversion: 2.25 time: 1.005570 Sep 14 09:16:49.623707 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 155/281] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:48 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 2051 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:16:49.631582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cd9b8a6-9771-4733-9538-47e8997305d4", "name": "network-vif-deleted", "tag": "13330de3-50d1-420a-ad5f-1d1b4de5f82a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:49.674272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.674272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.674272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.674673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7257f147-25bc-4af3-95c7-2a48e0cc8f7a tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Calling method '.version_select at 0x7f69442f15e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:49.679647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:49.698550 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] Creating event network-vif-deleted:13330de3-50d1-420a-ad5f-1d1b4de5f82a for instance 4cd9b8a6-9771-4733-9538-47e8997305d4 on n-h1-851028-12 Sep 14 09:16:49.709732 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-81af1e15-a95d-490b-84be-43518e061da0 req-3c3601fd-1b38-4890-aa07-8e770bd0f399 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083141 Sep 14 09:16:49.711353 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 156/282] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:49.723284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:49.724570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:49.743550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.744494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.745625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.747231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.748085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.748719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.800124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.800660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.801673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.802328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lazy-loading 'fault' on Instance uuid 4cd9b8a6-9771-4733-9538-47e8997305d4 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:49.908896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847a213fbac4b75a751337e7ddd6ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b1d50d5a294b7dbb4872750404dce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:49.922347 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4db865de-4982-4991-97ce-d57918f58aea tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 200 len: 1309 microversion: 2.1 time: 0.208940 Sep 14 09:16:49.924291 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 157/283] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:49 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:49.933492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:49.935049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:49.945848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.946983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.948047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:49.949593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:49.950641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:49.951641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.226969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 2e511a14-5958-4459-b9ce-fef73682e888 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:50.260465 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-72fdfc14-a468-4e37-a3d5-26a1ca2bcddb tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 2051 microversion: 2.25 time: 0.334303 Sep 14 09:16:50.261219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 158/284] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:49 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 2051 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:50.289502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:50.294043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.294527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.295205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.296175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.296842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.297748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.329023 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ab00515-db32-45c6-8b17-1522ffee0a65 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.044383 Sep 14 09:16:50.330109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 159/285] 10.222.0.90 () {60 vars in 1217 bytes} [Wed Sep 14 09:16:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:16:50.349518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": "auto"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:50.352444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:50.361019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.362052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.362926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.364000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:50.364461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:50.364968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:50.478837 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7257f147-25bc-4af3-95c7-2a48e0cc8f7a tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 371 microversion: 2.1 time: 1.617781 Sep 14 09:16:50.480257 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 127/286] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:16:48 2022] GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 371 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:50.491816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'flavor' on Instance uuid 2e511a14-5958-4459-b9ce-fef73682e888 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:16:50.496597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f694429d040>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:50.559601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122443) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:16:51.461382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.461953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.464098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.465380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.465862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.466287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.546572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9d3da48-57c2-475c-b5bf-aba157c3954f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 328 microversion: 2.1 time: 1.055665 Sep 14 09:16:51.559932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 128/287] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:16:50 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 328 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:51.559932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:51.559932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:51.568306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.569294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.570198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.571568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.572552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.573462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.603265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 HTTP/1.1 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:51.606393 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.607665 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4cd9b8a6-9771-4733-9538-47e8997305d4'} Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:51.608393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.609771 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.616679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:51.617786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00f04190-8a46-4bea-9393-0f977538400a tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 404 len: 111 microversion: 2.1 time: 0.068201 Sep 14 09:16:51.618558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 129/288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:51 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:51.629579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:51.630264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:51.638077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.638577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.639000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.639711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.640216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.640632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.648091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:51.664871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 HTTP/1.1 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:51.666468 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.667654 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4cd9b8a6-9771-4733-9538-47e8997305d4'} Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:51.668394 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.669445 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.670598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:51.670598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de61ca01-9f03-4b19-b86d-3f126887e2c7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 404 len: 111 microversion: 2.1 time: 0.042909 Sep 14 09:16:51.672039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 130/289] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:51 2022] DELETE /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:51.683072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:51.683850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 4cd9b8a6-9771-4733-9538-47e8997305d4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:51.692944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.693446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.693887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.694654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:51.695117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:51.695543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:51.726855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 HTTP/1.1 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:51.730027 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.731412 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4cd9b8a6-9771-4733-9538-47e8997305d4'} Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:51.732211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. Sep 14 09:16:51.733247 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:51.736919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 4cd9b8a6-9771-4733-9538-47e8997305d4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:51.738798 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65d23dc5-585c-4a6b-8eb7-02e3b2848ad7 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4" status: 404 len: 111 microversion: 2.1 time: 0.063484 Sep 14 09:16:51.740353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 131/290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:51 2022] GET /compute/v2.1/servers/4cd9b8a6-9771-4733-9538-47e8997305d4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:52.267993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ee665b7-3249-415b-b2dd-572f02367da2 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Action: 'create', calling method: .version_select at 0x7f6944338670>, body: {"keypair": {"name": "tempest-keypair-233946415", "type": "ssh", "user_id": "2f6df28e10304683a98db38d0af23ebb", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLu4GgecKf5VDCVMKiljaYqiZ5w2vw60+8RGyLx9v9DTcQJ1d4t5Hgtv6x9df+bOBIZoiseUhXMF6Ez1xpcvSiJoNjybbMZ97HWRdGL6fMJK+4cS/wOe+ryQqthHKr/cKg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:52.301428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8ee665b7-3249-415b-b2dd-572f02367da2 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:52.306745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8ee665b7-3249-415b-b2dd-572f02367da2 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for user 671720bc4040430bb3ec432203cc639a and project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:52.346357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ee665b7-3249-415b-b2dd-572f02367da2 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.604217 Sep 14 09:16:52.346976 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 132/291] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:16:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 606 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:16:52.352737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:52.353200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:52.374435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:52.374927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:52.375464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:52.376898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:52.377810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:52.382491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:52.396320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 HTTP/1.1 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:52.398093 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:52.399293 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3da522c4-e422-4ce1-8f10-65ba7ccd8fe1'} Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:52.399998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:52.401407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:52.402686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:52.402686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f13ab41-5669-43bf-b515-2e04c12b5bad tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 404 len: 111 microversion: 2.1 time: 0.051777 Sep 14 09:16:52.402686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 133/292] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:16:52 2022] DELETE /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:52.750736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1787622636", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:52.832252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:53.087867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:53.088323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:53.089397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:53.090551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:53.090901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:53.094222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:53.106457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:53.107470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:53.108329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.109305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:53.110059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:53.111228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.120673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=15 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:53.133631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:53.137757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for user f61f629c0dc64b7aa6c780cb4dab8299 and project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:53.150409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.utils [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] cores quota exceeded for ae01c31d8d2a4223b7766344fbab8de2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122444) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 09:16:53.151332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Request method failure captured: Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 145 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZv-H2ZszspIhnEhIHVKyzHs5e8Pena1uY7wgZjlNOUXEAAVbTwJ21yBO3ZVEwGCf28KOGouHlA9acBb2Y2feTyfsOhdaE3VPCdhxMdRXqUxbU_Sb0i4-W7AN3Su6ffSbifeMAE9wFBK2icZw6ntKtma2-Z-ext7buciC8o9MEn9ew0 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:53.160805 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ae01c31d8d2a4223b7766344fbab8de2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ae01c31d8d2a4223b7766344fbab8de2"}]}] Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: f61f629c0dc64b7aa6c780cb4dab8299 Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1787622636", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} Sep 14 09:16:53.162075 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1787622636', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452'}}} Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 09:16:53.162765 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:53.163749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.166514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:53.169195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db179fe7-7ed8-48ea-aab6-1c052910947a tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.766451 Sep 14 09:16:53.174844 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 134/293] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:52 2022] POST /compute/v2.1/servers => generated 111 bytes in 773 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:53.183427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-863f35da-59cf-4d9a-bd09-00f91491a2a5 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Action: 'create', calling method: .version_select at 0x7f6944270310>, body: {"keypair": {"name": "tempest-keypair-1481287597", "type": "ssh", "user_id": "2f6df28e10304683a98db38d0af23ebb", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVzsfK5OdMPpJN+Vfpctv5Rivkf2aHq3jQVcvHw6e1fQCZ3DFeE7ExpRhBMNOYzOYxoXYN0aRA/ZhDVpBTiSw7HZbmf0xaqLcsHhHgqvyRHcra7ExTZ1Jevt7r8CfC0nQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:53.208105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-863f35da-59cf-4d9a-bd09-00f91491a2a5 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:53.212162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-863f35da-59cf-4d9a-bd09-00f91491a2a5 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for user 671720bc4040430bb3ec432203cc639a and project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:53.256852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-863f35da-59cf-4d9a-bd09-00f91491a2a5 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.079359 Sep 14 09:16:53.258850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 135/294] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:16:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:16:53.268581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:53.269539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] [instance: 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:53.287757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:53.288692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:53.289403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.290407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:53.291045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:53.291478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:53.313045 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] HTTP exception thrown: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Request method failure captured: Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 HTTP/1.1 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvDgsvdhbHDgKceLlssBvRXTaatooLOzY3FNBmf3-TV63z6y7rxQw7L6dxVkg_-My7rTvKnt8UHh1SEnx-L_9HQD74a7yfU8FDuRJqxG5evq7HsoeCpwSPcVC-rj85hZSJO7rZEfnYe__Tx_aLa2KEwfFq2c-mWsTxXEpqh3sFUS3k Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:16:53.315727 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a3b1d50d5a294b7dbb4872750404dce6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a3b1d50d5a294b7dbb4872750404dce6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a3b1d50d5a294b7dbb4872750404dce6"}]}] Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a3b1d50d5a294b7dbb4872750404dce6 Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1048709049 Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1847a213fbac4b75a751337e7ddd6ddf Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersAdminTestJSON-1048709049-project Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:53.316996 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3da522c4-e422-4ce1-8f10-65ba7ccd8fe1'} Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:53.317691 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. Sep 14 09:16:53.319113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:16:53.320185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] Returning 404 to user: Instance 3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:53.320185 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d0b7e81d-4017-48be-b868-0618ce8ab3a0 tempest-DeleteServersAdminTestJSON-1048709049 tempest-DeleteServersAdminTestJSON-1048709049-project] 10.222.0.90 "GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1" status: 404 len: 111 microversion: 2.1 time: 0.057012 Sep 14 09:16:53.320185 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 136/295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:53 2022] GET /compute/v2.1/servers/3da522c4-e422-4ce1-8f10-65ba7ccd8fe1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:53.890062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1847238109", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:53.968441 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-603e7c92-c1c7-45b5-b20a-befd13d97fa2 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888/action" status: 202 len: 0 microversion: 2.25 time: 3.625942 Sep 14 09:16:53.969879 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 160/296] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:16:50 2022] POST /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888/action => generated 0 bytes in 3630 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:53.974540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:53.984670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f693fe24a60>, body: {"quota_set": {"cores": 20}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:54.566006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:54.566428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:54.566895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:54.567362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:54.567782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:54.592051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.593595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.594080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.594567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.596150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.596789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.597414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.597642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.600788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.602935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.604540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.605410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.629191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Getting quotas for project a61c927000b6453d8bce8a064217a771. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:54.636985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Getting quotas for user 4fc03ddff0b24da2bcdf9c5e332dde93 and project a61c927000b6453d8bce8a064217a771. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:54.647103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:54.665864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:16:54.670491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:16:54.724578 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0358a67e-f459-47ec-a034-26d076be4412 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 329 microversion: 2.1 time: 0.752208 Sep 14 09:16:54.725676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 161/297] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:16:53 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 329 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:54.776380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd12b23d-7567-4ff4-b2ca-3c5c9cd81aed tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457211 Sep 14 09:16:54.777066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 137/298] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:16:54.786562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b4a687b9-231c-41a6-ae90-8ba56268c819 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Calling method '.version_select at 0x7f6944270af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:54.811256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b4a687b9-231c-41a6-ae90-8ba56268c819 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "GET /compute/v2.1/os-keypairs/tempest-keypair-233946415?user_id=2f6df28e10304683a98db38d0af23ebb" status: 200 len: 511 microversion: 2.10 time: 0.031463 Sep 14 09:16:54.813536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 138/299] 10.222.0.90 () {60 vars in 1337 bytes} [Wed Sep 14 09:16:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-233946415?user_id=2f6df28e10304683a98db38d0af23ebb => generated 511 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:54.837873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:54.840987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:54.855410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.856391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.857669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:54.858502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:54.859050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:54.859590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:55.205442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:55.207104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:55.207104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:55.207104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:55.207530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:55.207736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:55.208398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:55.224639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=20 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:55.276735 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a43d47e8-6a42-4214-baf2-25b82df0d157 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] 10.222.0.90 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.549062 Sep 14 09:16:55.305161 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 162/300] 10.222.0.90 () {58 vars in 1164 bytes} [Wed Sep 14 09:16:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:16:55.313085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a17453d7-1acf-4e0b-89c4-26ea8411b51f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Calling method '.version_select at 0x7f693fd8fdc0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:55.392282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:55.413324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:55.416848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:55.418788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6add6a03-bcc5-4d52-a488-a43424c4b386 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.603124 Sep 14 09:16:55.420085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 139/301] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:54 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:55.427497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80849707-de7e-4842-90b0-97570de97fea tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:55.429238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80849707-de7e-4842-90b0-97570de97fea tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:55.570740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80849707-de7e-4842-90b0-97570de97fea tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:55.584022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80849707-de7e-4842-90b0-97570de97fea tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1223 microversion: 2.1 time: 0.162482 Sep 14 09:16:55.584718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 140/302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:55 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:55.607687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1a491b4-3f2b-4e3c-8db1-f5d93761bc45 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Action: 'create', calling method: .version_select at 0x7f6944428550>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2086522042", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx7HEqM6K9xDSsNDNCSQv2VDjEY5ziNHJuz+Y6rdgm+/z+y8EnrpCXGD6uOUK307DrrBaEqSVuBAoLPbx2D+7/jF0GD7IVirdioQLfmRH791T8r4LhfK+0ViYFc+jZ07Q=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:55.652911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f1a491b4-3f2b-4e3c-8db1-f5d93761bc45 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:55.665379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f1a491b4-3f2b-4e3c-8db1-f5d93761bc45 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Getting quotas for user 671720bc4040430bb3ec432203cc639a and project 42c8d098b52c422eb1d883542d639340. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:55.740386 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1a491b4-3f2b-4e3c-8db1-f5d93761bc45 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.146060 Sep 14 09:16:55.741704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 141/303] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:16:55 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:16:55.750783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:55.756479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:55.758174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:55.759282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:55.760957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:55.762289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:55.769182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:55.836818 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61021757-6bd6-436f-9d54-c87945b25272 tempest-AZAdminV2TestJSON-1789302658 tempest-AZAdminV2TestJSON-1789302658-project-admin] 10.222.0.90 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.092983 Sep 14 09:16:55.849115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 142/304] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:16:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:56.035957 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a17453d7-1acf-4e0b-89c4-26ea8411b51f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 371 microversion: 2.1 time: 0.726042 Sep 14 09:16:56.036629 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 163/305] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:16:55 2022] GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 371 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:56.047375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af625508-e3b3-48f7-9413-38a2ba15af77 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Calling method '.version_select at 0x7f693fd93e50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:56.059792 n-d-851028-12 devstack@n-api.service[122443]: WARNING oslo_db.sqlalchemy.utils [None req-af625508-e3b3-48f7-9413-38a2ba15af77 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:16:56.080982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af625508-e3b3-48f7-9413-38a2ba15af77 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "GET /compute/v2.1/os-keypairs?user_id=2f6df28e10304683a98db38d0af23ebb" status: 200 len: 725 microversion: 2.10 time: 0.041800 Sep 14 09:16:56.081671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 164/306] 10.222.0.90 () {60 vars in 1259 bytes} [Wed Sep 14 09:16:56 2022] GET /compute/v2.1/os-keypairs?user_id=2f6df28e10304683a98db38d0af23ebb => generated 725 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:56.098861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f693fd9ea60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:56.275478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2116745863", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:56.390716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:56.857404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:56.858073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:56.858467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:56.858866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:56.859491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:56.875159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:56.877930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:56.879580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:56.882068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:56.883738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:56.885218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:56.885762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:56.886529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:56.887078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:56.888033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:56.891057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:56.891675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:56.944091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Getting quotas for project 4f7c8c34482c413795cf068d9dc47820. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:56.963986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Getting quotas for user eb15ea3eacc54f439db99d1413ff2d70 and project 4f7c8c34482c413795cf068d9dc47820. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:57.025819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:16:57.040450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:16:57.179535 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f46a6b88-19fc-4ba0-a2ce-3ca8e401941f tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 328 microversion: 2.1 time: 1.095474 Sep 14 09:16:57.208716 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 165/307] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:16:56 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 328 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:57.226730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c57d877a-b39b-4232-9813-596b0fb48f6e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375455 Sep 14 09:16:57.229969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 143/308] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:16:57.240523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:57.241925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:57.244075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9afe91cf-ab19-47fd-b73e-d69fea35b2d6 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Calling method '.version_select at 0x7f693fd93430>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:57.254880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:57.255717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:57.257858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:57.260321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:57.260714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:57.263104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:57.346977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9afe91cf-ab19-47fd-b73e-d69fea35b2d6 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2086522042" status: 204 len: 0 microversion: 2.10 time: 0.132556 Sep 14 09:16:57.353347 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 166/309] 10.222.0.90 () {60 vars in 1325 bytes} [Wed Sep 14 09:16:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2086522042 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:16:57.368195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:57.369365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:57.387242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:57.393234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:57.394286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:57.395431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:57.396137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:57.397327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:57.543760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:57.559544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:57.563445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:57.569729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41041a6d-3353-429d-977c-387c93b9c01a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.337891 Sep 14 09:16:57.570823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 144/310] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:57 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:57.761025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:57.788196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-145d2bf3-5a3a-4b89-9f46-e203653bc87c tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1281 microversion: 2.1 time: 0.425319 Sep 14 09:16:57.789879 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 167/311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:57 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:57.796163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e511a14-5958-4459-b9ce-fef73682e888", "name": "network-vif-unplugged", "status": "completed", "tag": "32931be0-7f56-4e3a-bd97-cb563ad853a6"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:57.829237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:57.830404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:57.831338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:57.867427 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] Creating event network-vif-unplugged:32931be0-7f56-4e3a-bd97-cb563ad853a6 for instance 2e511a14-5958-4459-b9ce-fef73682e888 on n-h1-851028-12 Sep 14 09:16:57.900969 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-133cc423-86a6-46e5-acbc-ae1d225b837f req-fdd69e40-0dad-4513-9e8b-6c99411f0835 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106803 Sep 14 09:16:57.904857 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 168/312] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:16:57.927177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f73cf2bd-427f-4e65-a36f-d30a34539cb2 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:57.930350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f73cf2bd-427f-4e65-a36f-d30a34539cb2 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:58.063249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f73cf2bd-427f-4e65-a36f-d30a34539cb2 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:58.086225 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f73cf2bd-427f-4e65-a36f-d30a34539cb2 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1222 microversion: 2.1 time: 0.174999 Sep 14 09:16:58.089884 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 169/313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:57 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:58.113690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0c45e8c-ef76-4eb6-86ad-97c565c5b31d tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Calling method '.version_select at 0x7f693fdbf160>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:58.169855 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0c45e8c-ef76-4eb6-86ad-97c565c5b31d tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481287597?user_id=2f6df28e10304683a98db38d0af23ebb" status: 204 len: 0 microversion: 2.10 time: 0.078181 Sep 14 09:16:58.173060 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 170/314] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:16:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481287597?user_id=2f6df28e10304683a98db38d0af23ebb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:16:58.193603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-229651307", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:58.367037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:16:58.414278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9d46c7f-f9c0-421a-9e22-74b3ffdd576a tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-629720096", "id": 1439078272, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:58.456117 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9d46c7f-f9c0-421a-9e22-74b3ffdd576a tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.870107 Sep 14 09:16:58.472421 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 145/315] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:16:57 2022] POST /compute/v2.1/flavors => generated 470 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:16:58.479124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2b720bc-d5ea-4e7a-97fa-c1862072e300 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] Calling method '.version_select at 0x7f6944270820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:58.522383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2b720bc-d5ea-4e7a-97fa-c1862072e300 tempest-KeyPairsV210TestJSON-1685981890 tempest-KeyPairsV210TestJSON-1685981890-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233946415?user_id=2f6df28e10304683a98db38d0af23ebb" status: 204 len: 0 microversion: 2.10 time: 0.046003 Sep 14 09:16:58.524385 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 146/316] 10.222.0.90 () {60 vars in 1340 bytes} [Wed Sep 14 09:16:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233946415?user_id=2f6df28e10304683a98db38d0af23ebb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:16:58.542645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba9d7f8b-557e-4892-87a4-7eab636c6a58 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:58.703402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:16:58.704570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:16:58.705595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:16:58.706405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:16:58.707467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:16:58.743626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:58.744514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:58.745182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:58.746146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:58.749523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:58.750729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:58.806845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:16:58.815465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for user f61f629c0dc64b7aa6c780cb4dab8299 and project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:16:58.842634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.utils [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] instances quota exceeded for ae01c31d8d2a4223b7766344fbab8de2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122443) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 09:16:58.843885 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Request method failure captured: Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 144 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZv-H2ZszspIhnEhIHVKyzHs5e8Pena1uY7wgZjlNOUXEAAVbTwJ21yBO3ZVEwGCf28KOGouHlA9acBb2Y2feTyfsOhdaE3VPCdhxMdRXqUxbU_Sb0i4-W7AN3Su6ffSbifeMAE9wFBK2icZw6ntKtma2-Z-ext7buciC8o9MEn9ew0 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:16:58.852324 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ae01c31d8d2a4223b7766344fbab8de2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ae01c31d8d2a4223b7766344fbab8de2"}]}] Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: f61f629c0dc64b7aa6c780cb4dab8299 Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-229651307", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} Sep 14 09:16:58.853594 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-229651307', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452'}}} Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 09:16:58.854283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:58.855287 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.857201 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 14 09:16:58.859072 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:16:58.860858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:16:58.862239 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24a68bf4-7150-4e1d-a1fa-2a6abf44f5ab tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.684803 Sep 14 09:16:58.866861 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 171/317] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:16:58 2022] POST /compute/v2.1/servers => generated 119 bytes in 690 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:16:58.873384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:58.874107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:58.896450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:58.897300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:58.897946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:58.898923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:58.899581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:58.900233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.131311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=11,nova_api:DELETE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:16:59.136555 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba9d7f8b-557e-4892-87a4-7eab636c6a58 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1439078272/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.610301 Sep 14 09:16:59.140953 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 147/318] 10.222.0.90 () {62 vars in 1265 bytes} [Wed Sep 14 09:16:58 2022] POST /compute/v2.1/flavors/1439078272/os-extra_specs => generated 62 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:59.148687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:59.160080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:59.162767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:59.164362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:59.167330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:59.171639 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b78b8b7e-3509-4e34-b27a-1f2f8c69f3f0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.300571 Sep 14 09:16:59.185244 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 172/319] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:16:58 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:59.194906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:59.194906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:59.194906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.194906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:59.195758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:59.195758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.200787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f6945a769d0>, body: {"quota_set": {"instances": 10}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:59.476187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:59.490101 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aeb48498-b416-4f72-a56a-e41dc75503c5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.346329 Sep 14 09:16:59.492444 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 148/320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:59 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:59.512905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:59.513933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:16:59.524756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:59.525724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:59.526399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.527666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:59.530042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:59.531150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.672579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:16:59.696705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eac85692-ffad-4991-99cb-153c50841a56 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1274 microversion: 2.1 time: 0.193604 Sep 14 09:16:59.697702 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 149/321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:16:59 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:16:59.719108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1881afd-2160-42d5-879c-b1c30c00beb1 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:59.762481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1881afd-2160-42d5-879c-b1c30c00beb1 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1439078272" status: 202 len: 0 microversion: 2.86 time: 0.059308 Sep 14 09:16:59.765777 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 150/322] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Sep 14 09:16:59 2022] DELETE /compute/v2.1/flavors/1439078272 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:16:59.785038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29872b2d-44ef-4899-86df-173e64b3cf45 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:16:59.863112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29872b2d-44ef-4899-86df-173e64b3cf45 tempest-FlavorMetadataValidation-1825443462 tempest-FlavorMetadataValidation-1825443462-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.091173 Sep 14 09:16:59.864917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 151/323] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:16:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:16:59.928362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e511a14-5958-4459-b9ce-fef73682e888", "tag": "32931be0-7f56-4e3a-bd97-cb563ad853a6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:16:59.956444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:16:59.957350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:16:59.962551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:16:59.997487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] Creating event network-changed:32931be0-7f56-4e3a-bd97-cb563ad853a6 for instance 2e511a14-5958-4459-b9ce-fef73682e888 on n-h1-851028-12 Sep 14 09:17:00.018536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-03637e47-7d67-4ca8-9ffc-13563f2a7787 req-bff8faeb-fb55-42f4-9c13-f485d7028972 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096059 Sep 14 09:17:00.019737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 152/324] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:00.202665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:00.203542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:00.213377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.215350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.215694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.216459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.216955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.219212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.495493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.496279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.499097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.501923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.503688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.505023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.723647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:00.753854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:00.761355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:00.763784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0dc027e1-2c09-42a4-9788-e1132770cdb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.565432 Sep 14 09:17:00.769893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 153/325] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:00 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:00.793437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8286f153-54a7-410c-84e7-50b9fe983ac6", "tag": "a6327aa4-d808-445b-904b-e5599496fd66"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:00.835928 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd558800-c01e-4785-ab00-87fac76affbe tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 329 microversion: 2.1 time: 1.648821 Sep 14 09:17:00.837761 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 173/326] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:16:59 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 329 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:00.840845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.841339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.841774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.851965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:00.853725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:00.868371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.869771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.870968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.872599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.874692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.875728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.890508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] Creating event network-changed:a6327aa4-d808-445b-904b-e5599496fd66 for instance 8286f153-54a7-410c-84e7-50b9fe983ac6 on n-h2-851028-12 Sep 14 09:17:00.906062 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2972b1fb-45d6-45f3-bb0f-c27a17c6c0cb req-91ccd974-fcff-408c-bf24-5a6345ccb3b5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132014 Sep 14 09:17:00.906799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 154/327] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:00.919473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:00.920593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:00.950941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.952904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.955307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:00.956592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:00.960691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:00.961389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:01.206879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:01.218218 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-036e5163-b457-474d-8435-2eacc8ac8ea8 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1280 microversion: 2.1 time: 0.307360 Sep 14 09:17:01.221262 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 155/328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:00 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:01.227370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01642719-a167-47a2-aa9b-cafef1c20c68 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Calling method '.version_select at 0x7f69443cf1f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:01.483748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:01.499054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a514fee7-8e6b-48c4-a6c5-053fe885fa34 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.656807 Sep 14 09:17:01.507869 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 174/329] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:00 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:01.831751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-671de8aa-62d9-40f8-b33e-eea87d06f861 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-243568784", "ram": 512, "vcpus": 1, "disk": 10, "id": 1678558235, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:01.834374 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01642719-a167-47a2-aa9b-cafef1c20c68 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 371 microversion: 2.1 time: 0.611914 Sep 14 09:17:01.843375 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 156/330] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:17:01 2022] GET /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 371 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:01.850310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:01.851135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:01.861306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:01.861809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:01.862607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:01.863503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:01.863997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:01.864706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:01.868630 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-671de8aa-62d9-40f8-b33e-eea87d06f861 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.281646 Sep 14 09:17:01.869848 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 175/331] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:01 2022] POST /compute/v2.1/flavors => generated 415 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:01.874705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f693fd93a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:02.234889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:02.252254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:02.255040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:02.257517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fa3b1356-b457-4d7f-9d59-d4702e568025 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.412995 Sep 14 09:17:02.260141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 157/332] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:01 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:02.425756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.426859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.427531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.428810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.429480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.430128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.500972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:02.530013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bdd3e371-c4a4-43d4-838b-17a7c0a19167 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 325 microversion: 2.1 time: 0.658858 Sep 14 09:17:02.535161 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 176/333] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:17:01 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 325 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:02.545925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:02.549040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:02.567218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.568203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.570497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.571986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.574397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.575006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.796879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc3542dc-2788-49be-b5c8-5555de7006a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:02.817643 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bc3542dc-2788-49be-b5c8-5555de7006a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] HTTP exception thrown: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc3542dc-2788-49be-b5c8-5555de7006a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Request method failure captured: Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwK3RLECwvGOsvagCMzHDAlmGQ9HeRcZIHT1BrIdUUi7H9zXT3eUEzWLmh9_BbrwCbeTCI-3SxHo_dUSNAXWYnQfHc4OVekwTZb9BbkmFcrB_kIt8GpeYMnHdpXdvhGRcPY2-a7CB1LDO6aeivpF-ClySwDevnF8puQmqTupj6qT2g Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:02.822452 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9dbd327f850444cd82e0dce2d4d31688", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9dbd327f850444cd82e0dce2d4d31688"}]}] Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 905ebe17fd77454392c1452d6f9848b9 Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:02.823752 n-d-851028-12 devstack@n-api.service[122444]: exception: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'flavor_id': '1678558235', 'id': 'hw:cpu_thread_policy'} Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:02.824439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:02.825649 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.828359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc3542dc-2788-49be-b5c8-5555de7006a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Returning 404 to user: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:02.834763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc3542dc-2788-49be-b5c8-5555de7006a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] 10.222.0.90 "GET /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.572036 Sep 14 09:17:02.836139 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 158/334] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:17:02 2022] GET /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:02.852536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:02.855153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:02.869199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.873717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.874321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.875971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:02.880050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:02.880822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:02.895298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:02.909099 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3ff1ae9-967a-41e8-95e5-783efa120417 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 0.368930 Sep 14 09:17:02.927939 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 177/335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:02 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:02.927939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e62536e7-3ffd-43a3-b46f-78af784eef03 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:02.927939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e62536e7-3ffd-43a3-b46f-78af784eef03 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '905ebe17fd77454392c1452d6f9848b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbd327f850444cd82e0dce2d4d31688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e62536e7-3ffd-43a3-b46f-78af784eef03 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Request method failure captured: Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/flavors/1678558235/os-extra_specs HTTP/1.1 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 66 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwK3RLECwvGOsvagCMzHDAlmGQ9HeRcZIHT1BrIdUUi7H9zXT3eUEzWLmh9_BbrwCbeTCI-3SxHo_dUSNAXWYnQfHc4OVekwTZb9BbkmFcrB_kIt8GpeYMnHdpXdvhGRcPY2-a7CB1LDO6aeivpF-ClySwDevnF8puQmqTupj6qT2g Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:02.960741 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9dbd327f850444cd82e0dce2d4d31688", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9dbd327f850444cd82e0dce2d4d31688"}]}] Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 905ebe17fd77454392c1452d6f9848b9 Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 14 09:17:02.962240 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'flavor_id': '1678558235', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:02.963162 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 14 09:17:02.964447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:02.966133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e62536e7-3ffd-43a3-b46f-78af784eef03 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:02.973747 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e62536e7-3ffd-43a3-b46f-78af784eef03 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] 10.222.0.90 "POST /compute/v2.1/flavors/1678558235/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.052975 Sep 14 09:17:02.980028 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 178/336] 10.222.0.90 () {60 vars in 1224 bytes} [Wed Sep 14 09:17:02 2022] POST /compute/v2.1/flavors/1678558235/os-extra_specs => generated 124 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:02.987602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5c45fcda-f099-44e3-bc10-daee5cde9d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:03.085429 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5c45fcda-f099-44e3-bc10-daee5cde9d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1678558235/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102811 Sep 14 09:17:03.087049 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 179/337] 10.222.0.90 () {60 vars in 1224 bytes} [Wed Sep 14 09:17:02 2022] POST /compute/v2.1/flavors/1678558235/os-extra_specs => generated 66 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:03.113408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b5a7e8b7-8503-4913-82cc-92a025c8243f tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:03.122085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b5a7e8b7-8503-4913-82cc-92a025c8243f tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '905ebe17fd77454392c1452d6f9848b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbd327f850444cd82e0dce2d4d31688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b5a7e8b7-8503-4913-82cc-92a025c8243f tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Request method failure captured: Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwK3RLECwvGOsvagCMzHDAlmGQ9HeRcZIHT1BrIdUUi7H9zXT3eUEzWLmh9_BbrwCbeTCI-3SxHo_dUSNAXWYnQfHc4OVekwTZb9BbkmFcrB_kIt8GpeYMnHdpXdvhGRcPY2-a7CB1LDO6aeivpF-ClySwDevnF8puQmqTupj6qT2g Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:03.124473 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9dbd327f850444cd82e0dce2d4d31688", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9dbd327f850444cd82e0dce2d4d31688"}]}] Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 905ebe17fd77454392c1452d6f9848b9 Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:03.126585 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'flavor_id': '1678558235', 'id': 'hw:numa_nodes'} Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:03.128275 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:03.131453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b5a7e8b7-8503-4913-82cc-92a025c8243f tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:03.134551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b5a7e8b7-8503-4913-82cc-92a025c8243f tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] 10.222.0.90 "DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.040626 Sep 14 09:17:03.137050 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 180/338] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:17:03 2022] DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes => generated 124 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:03.146904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-954919489", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:03.249273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:03.392587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:03.404484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e23decc1-af60-4621-98f0-a8db1497afb7 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.565454 Sep 14 09:17:03.405676 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 159/339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:02 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:03.412209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e859d426-043f-46b5-88f1-ba99afe57b32 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:03.462578 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e859d426-043f-46b5-88f1-ba99afe57b32 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors/1678558235/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055198 Sep 14 09:17:03.469006 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 160/340] 10.222.0.90 () {60 vars in 1224 bytes} [Wed Sep 14 09:17:03 2022] POST /compute/v2.1/flavors/1678558235/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:03.476606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:03.477583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:03.490216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:03.490998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:03.491608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:03.495150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:03.496522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:03.497606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.053719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:04.054261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:04.054690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:04.055121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:04.055538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:04.074553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.074960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.075393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.076155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.076611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.077036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.131396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:04.131732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:04.140130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Getting quotas for user f61f629c0dc64b7aa6c780cb4dab8299 and project ae01c31d8d2a4223b7766344fbab8de2. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:04.149794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:04.151284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:04.152457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e155e9d-a3ac-450b-9fbc-6d4d6539252e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.682289 Sep 14 09:17:04.153021 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 161/341] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:03 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:04.165329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.utils [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] ram quota exceeded for ae01c31d8d2a4223b7766344fbab8de2, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122443) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 14 09:17:04.166210 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Request method failure captured: Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 144 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZv-H2ZszspIhnEhIHVKyzHs5e8Pena1uY7wgZjlNOUXEAAVbTwJ21yBO3ZVEwGCf28KOGouHlA9acBb2Y2feTyfsOhdaE3VPCdhxMdRXqUxbU_Sb0i4-W7AN3Su6ffSbifeMAE9wFBK2icZw6ntKtma2-Z-ext7buciC8o9MEn9ew0 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:04.168966 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ae01c31d8d2a4223b7766344fbab8de2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ae01c31d8d2a4223b7766344fbab8de2"}]}] Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: f61f629c0dc64b7aa6c780cb4dab8299 Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-954919489", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} Sep 14 09:17:04.170157 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-954919489', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452'}}} Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 09:17:04.170804 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.171840 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.173953 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:04.175646 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aeb88a87-a586-426b-ac53-1fa138f1f4e3 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.032519 Sep 14 09:17:04.176790 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 181/342] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 1038 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:04.181858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58ddf363-c30a-4fd3-a17e-9bdccea8fb13 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:04.187438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:04.188103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:04.196985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.197794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.198337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.199143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.199669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.200152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.202058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58ddf363-c30a-4fd3-a17e-9bdccea8fb13 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '905ebe17fd77454392c1452d6f9848b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbd327f850444cd82e0dce2d4d31688', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58ddf363-c30a-4fd3-a17e-9bdccea8fb13 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Request method failure captured: Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 22 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwK3RLECwvGOsvagCMzHDAlmGQ9HeRcZIHT1BrIdUUi7H9zXT3eUEzWLmh9_BbrwCbeTCI-3SxHo_dUSNAXWYnQfHc4OVekwTZb9BbkmFcrB_kIt8GpeYMnHdpXdvhGRcPY2-a7CB1LDO6aeivpF-ClySwDevnF8puQmqTupj6qT2g Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:04.205760 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9dbd327f850444cd82e0dce2d4d31688", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9dbd327f850444cd82e0dce2d4d31688"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9dbd327f850444cd82e0dce2d4d31688"}]}] Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9dbd327f850444cd82e0dce2d4d31688 Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 905ebe17fd77454392c1452d6f9848b9 Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: {"hw:numa_nodes": "1"} Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:04.206979 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'flavor_id': '1678558235', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:04.207678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 14 09:17:04.208743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.209759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58ddf363-c30a-4fd3-a17e-9bdccea8fb13 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:04.209759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58ddf363-c30a-4fd3-a17e-9bdccea8fb13 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712 tempest-FlavorsExtraSpecsNegativeTestJSON-1633480712-project] 10.222.0.90 "PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.053883 Sep 14 09:17:04.219127 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 162/343] 10.222.0.90 () {60 vars in 1265 bytes} [Wed Sep 14 09:17:04 2022] PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes => generated 124 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:04.226815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Action: 'update', calling method: .version_select at 0x7f69441b94c0>, body: {"quota_set": {"ram": 51200}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:04.601129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:04.617999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a306f199-4b32-4ab1-93c7-34b6fd4b258c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 0.441041 Sep 14 09:17:04.619974 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 182/344] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:04 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:04.629467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16be6019-3ba9-4521-a18c-39b39a792225 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:04.643329 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-16be6019-3ba9-4521-a18c-39b39a792225 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] HTTP exception thrown: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16be6019-3ba9-4521-a18c-39b39a792225 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Request method failure captured: Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwNccy_JyIMfCsONevgrBeWHjRIwbzsd75DPQM8FGPsB_QwcydWmZaGWPOnY4hN8t_AypqXyOAU7gxR8Iq1RVz2DO5y9sUrYo6ixIeqjsOnpGnWsuzl69Bw8SStHcb_v22kb1xdOxckF2mZm-6LBhUgSxYDM7t8s7k2OJssktBSsyQ Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:04.653131 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_77b4a25d35f44f648506f65456c95583", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/77b4a25d35f44f648506f65456c95583"}]}] Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 726d92e3c2b94534ba42bc7d8620a72b Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:04.654673 n-d-851028-12 devstack@n-api.service[122443]: exception: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'flavor_id': '1678558235', 'id': 'hw:cpu_thread_policy'} Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:04.655442 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. Sep 14 09:17:04.656888 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:04.659548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16be6019-3ba9-4521-a18c-39b39a792225 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Returning 404 to user: Flavor 1678558235 has no extra specs with key hw:cpu_thread_policy. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:04.661681 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-16be6019-3ba9-4521-a18c-39b39a792225 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.040437 Sep 14 09:17:04.663467 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 183/345] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:17:04 2022] DELETE /compute/v2.1/flavors/1678558235/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:04.674503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:04.676716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:04.698607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.699380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.700525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.703177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.709334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.710186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.794900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.795430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.795850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.796618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.797072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.799884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:04.942102 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67598f84-6f12-4606-bf48-e9aa888429f6 tempest-QuotasAdminNegativeTest-761066221 tempest-QuotasAdminNegativeTest-761066221-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 200 len: 329 microversion: 2.1 time: 0.720839 Sep 14 09:17:04.942697 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 163/346] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:17:04 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 329 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:04.951844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "913eff35-bbfe-4b66-ae71-dbc288038c7f", "tag": "db2a2562-b619-4836-aaee-379b0ebbd3f0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:04.978118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:04.979594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:04.983500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:05.009153 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] Creating event network-changed:db2a2562-b619-4836-aaee-379b0ebbd3f0 for instance 913eff35-bbfe-4b66-ae71-dbc288038c7f on n-h1-851028-12 Sep 14 09:17:05.020288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-97266441-9a02-49ab-b66b-0e99bd38f26f req-2edb73db-d5a4-43be-a374-0b936aae6edb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075729 Sep 14 09:17:05.022570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 164/347] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:05.039475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8467b9ee-3409-45b8-8efe-d2705f7a9ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:05.043120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-8467b9ee-3409-45b8-8efe-d2705f7a9ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8467b9ee-3409-45b8-8efe-d2705f7a9ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Request method failure captured: Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 27 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwNccy_JyIMfCsONevgrBeWHjRIwbzsd75DPQM8FGPsB_QwcydWmZaGWPOnY4hN8t_AypqXyOAU7gxR8Iq1RVz2DO5y9sUrYo6ixIeqjsOnpGnWsuzl69Bw8SStHcb_v22kb1xdOxckF2mZm-6LBhUgSxYDM7t8s7k2OJssktBSsyQ Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:17:05.044625 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_77b4a25d35f44f648506f65456c95583", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/77b4a25d35f44f648506f65456c95583"}]}] Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 726d92e3c2b94534ba42bc7d8620a72b Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: {"hw:cpu_policy": "shared"} Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:05.045901 n-d-851028-12 devstack@n-api.service[122444]: exception: Request body and URI mismatch Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'flavor_id': '1678558235', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.046692 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.047830 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:05.047830 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:05.047830 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 14 09:17:05.047830 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.055564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8467b9ee-3409-45b8-8efe-d2705f7a9ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:05.057879 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8467b9ee-3409-45b8-8efe-d2705f7a9ccd tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.030774 Sep 14 09:17:05.061508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 165/348] 10.222.0.90 () {60 vars in 1265 bytes} [Wed Sep 14 09:17:05 2022] PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:17:05.065427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:05.073288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2af20af2-0b50-4d19-aae8-07ccf6c15ab6 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Action: 'update', calling method: .version_select at 0x7f69442705e0>, body: {"quota_set": {"ram": 0}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:05.078582 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afb7b131-eca9-4961-90c6-32b902bad72d tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.412738 Sep 14 09:17:05.086819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2af20af2-0b50-4d19-aae8-07ccf6c15ab6 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f61f629c0dc64b7aa6c780cb4dab8299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae01c31d8d2a4223b7766344fbab8de2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2af20af2-0b50-4d19-aae8-07ccf6c15ab6 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Request method failure captured: Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 HTTP/1.1 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 25 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZv-H2ZszspIhnEhIHVKyzHs5e8Pena1uY7wgZjlNOUXEAAVbTwJ21yBO3ZVEwGCf28KOGouHlA9acBb2Y2feTyfsOhdaE3VPCdhxMdRXqUxbU_Sb0i4-W7AN3Su6ffSbifeMAE9wFBK2icZw6ntKtma2-Z-ext7buciC8o9MEn9ew0 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:05.089788 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ae01c31d8d2a4223b7766344fbab8de2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ae01c31d8d2a4223b7766344fbab8de2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ae01c31d8d2a4223b7766344fbab8de2"}]}] Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ae01c31d8d2a4223b7766344fbab8de2 Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-421091750 Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: f61f629c0dc64b7aa6c780cb4dab8299 Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-QuotasAdminNegativeTest-421091750-project Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: {"quota_set": {"ram": 0}} Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 09:17:05.092382 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ae01c31d8d2a4223b7766344fbab8de2', 'body': {'quota_set': {'ram': 0}}} Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:05.094038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.097742 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2af20af2-0b50-4d19-aae8-07ccf6c15ab6 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:05.101623 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2af20af2-0b50-4d19-aae8-07ccf6c15ab6 tempest-QuotasAdminNegativeTest-421091750 tempest-QuotasAdminNegativeTest-421091750-project] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2" status: 403 len: 116 microversion: 2.1 time: 0.026033 Sep 14 09:17:05.103606 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 184/349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:04 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:05.104015 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 166/350] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:17:05 2022] PUT /compute/v2.1/os-quota-sets/ae01c31d8d2a4223b7766344fbab8de2 => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:05.117836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e1a4a33-147c-4e4d-89b8-325202be3569 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e1a4a33-147c-4e4d-89b8-325202be3569 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Request method failure captured: Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 49 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwNccy_JyIMfCsONevgrBeWHjRIwbzsd75DPQM8FGPsB_QwcydWmZaGWPOnY4hN8t_AypqXyOAU7gxR8Iq1RVz2DO5y9sUrYo6ixIeqjsOnpGnWsuzl69Bw8SStHcb_v22kb1xdOxckF2mZm-6LBhUgSxYDM7t8s7k2OJssktBSsyQ Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:05.122347 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_77b4a25d35f44f648506f65456c95583", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/77b4a25d35f44f648506f65456c95583"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/77b4a25d35f44f648506f65456c95583"}]}] Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 77b4a25d35f44f648506f65456c95583 Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 726d92e3c2b94534ba42bc7d8620a72b Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 14 09:17:05.124811 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'flavor_id': '1678558235', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance: Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 14 09:17:05.126326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.129769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e1a4a33-147c-4e4d-89b8-325202be3569 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7e1a4a33-147c-4e4d-89b8-325202be3569 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.029297 Sep 14 09:17:05.134058 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 185/351] 10.222.0.90 () {60 vars in 1265 bytes} [Wed Sep 14 09:17:05 2022] PUT /compute/v2.1/flavors/1678558235/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:05.135098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-181957a2-69e8-460a-8cba-e341d15ba9fb tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:05.184676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:05.184676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:05.195450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-181957a2-69e8-460a-8cba-e341d15ba9fb tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1678558235" status: 202 len: 0 microversion: 2.1 time: 0.065879 Sep 14 09:17:05.200165 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 167/352] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:17:05 2022] DELETE /compute/v2.1/flavors/1678558235 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:05.207198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b186647e-9307-4535-b38c-af86f27354ad tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:05.214230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:05.222010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:05.223180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:05.226804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:05.229884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:05.233161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:05.293418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b186647e-9307-4535-b38c-af86f27354ad tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115 tempest-FlavorsExtraSpecsNegativeTestJSON-1102542115-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076211 Sep 14 09:17:05.298734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 168/353] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:05.674475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:05.676245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:05.694805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:05.701180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:05.702354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:05.705262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:05.717086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:05.718850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:05.938127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:05.961467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:05.965674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:05.973808 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5dba8392-a25a-4ea1-8fec-eca69e15b046 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1567 microversion: 2.25 time: 0.794165 Sep 14 09:17:05.976213 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 186/354] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:05 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1567 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:06.121584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:06.123344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:06.133641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:06.136020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:06.136817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:06.138209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:06.139021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:06.139751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:06.587415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:06.609531 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66da3e4f-37fb-4450-8406-02c16d5f0a61 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 0.942117 Sep 14 09:17:06.623522 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 169/355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:05 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:06.830255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:06.835559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:06.845113 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-93557e8a-07b9-44f1-a618-cf0bbb9b858f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.733312 Sep 14 09:17:06.861041 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 187/356] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:06 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:07.027000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:07.028237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:07.043639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:07.046693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:07.047687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:07.052574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:07.053940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:07.056854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:07.638085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:07.639770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:07.658996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:07.663591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:07.666671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:07.670013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:07.674853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:07.676352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:07.984820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:07.998249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:08.004882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:08.006185 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c459f0b-f34a-4d2d-b6c0-434c7cd94d45 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 1557 microversion: 2.25 time: 0.985219 Sep 14 09:17:08.006799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 170/357] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:07 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 1557 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:08.341123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-300972533", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:08.499514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:08.906043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:08.923697 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-66a15006-99dd-4e54-88fe-cb23bccaba1a tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 1.289839 Sep 14 09:17:08.926042 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 188/358] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:07 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:08.941049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:08.946727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:08.986000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:08.987462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:08.988339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.000828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.003288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.005495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.467597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:09.469229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:09.469720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:09.471206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:09.471947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:09.489404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.489897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.490337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.491072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.491529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.491981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.522840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Getting quotas for project 21ec556cdc15433d8f77662f79e19b03. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:09.530053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Getting quotas for user 6a8f8c3be15942768efca8f028b8fa0b and project 21ec556cdc15433d8f77662f79e19b03. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:09.556370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:09.559429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:09.624719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20280aad-3699-4b07-8cbc-4d003d33232f tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611231 Sep 14 09:17:09.638039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 171/359] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:09.643252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18787d16-f2f3-4dec-bf4c-2a68c2502521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '.version_select at 0x7f69442f1550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:09.648759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18787d16-f2f3-4dec-bf4c-2a68c2502521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.650650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18787d16-f2f3-4dec-bf4c-2a68c2502521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.651116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18787d16-f2f3-4dec-bf4c-2a68c2502521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.688074 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18787d16-f2f3-4dec-bf4c-2a68c2502521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 440 microversion: 2.25 time: 0.048178 Sep 14 09:17:09.689192 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 172/360] 10.222.0.90 () {60 vars in 1184 bytes} [Wed Sep 14 09:17:09 2022] GET /compute/v2.1/os-migrations => generated 440 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:09.761036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:09.771399 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-351c71cb-34c0-4d94-ac15-703f177e3149 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.843719 Sep 14 09:17:09.774302 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 189/361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:08 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:09.796586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8286f153-54a7-410c-84e7-50b9fe983ac6", "name": "network-vif-plugged", "status": "completed", "tag": "a6327aa4-d808-445b-904b-e5599496fd66"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:09.828286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:09.828856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:09.829568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:09.857885 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] Creating event network-vif-plugged:a6327aa4-d808-445b-904b-e5599496fd66 for instance 8286f153-54a7-410c-84e7-50b9fe983ac6 on n-h2-851028-12 Sep 14 09:17:09.865676 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0a2d57fe-5d7d-4e24-8084-e2ece2c1b896 req-07488f06-b1c9-4bd0-94f4-c1833ad1b1b0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090255 Sep 14 09:17:09.876385 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 190/362] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:09.881997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e8e78ffa-bd67-4d05-a50e-e48ec0d3362b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:09.882950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e8e78ffa-bd67-4d05-a50e-e48ec0d3362b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:10.057451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e8e78ffa-bd67-4d05-a50e-e48ec0d3362b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:10.078092 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e8e78ffa-bd67-4d05-a50e-e48ec0d3362b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1213 microversion: 2.1 time: 0.189735 Sep 14 09:17:10.079467 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 191/363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:09 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1213 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:10.084980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:10.085827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:10.098848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:10.099541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:10.101741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:10.104033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:10.105488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:10.108375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:10.418540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1abcfb33-8f43-4954-9ce8-0abdd0b65426 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Calling method '.version_select at 0x7f6944131820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:10.420655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1abcfb33-8f43-4954-9ce8-0abdd0b65426 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '1c735f9b47274158b7ced3c235414b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958b9627876c4b67b9cd3a476b7dc4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1abcfb33-8f43-4954-9ce8-0abdd0b65426 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Request method failure captured: Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwTS-vE1ngQfclyxxXwavaIx74iIICJPYYtsqg0LCJ-5IpLN_w2Nbi38BHI1fY3W6xU-0NEtcbjnrfIMG4Oj7JaThRhgRvROSityJTIVeXx_ofLfG0azHvB5DJDF8YwJ4hAybtbTmzMVPu0DEZEMmobeL8ZhCgUaeh9x2qUjfiY4ZU Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:10.422418 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_958b9627876c4b67b9cd3a476b7dc4f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/958b9627876c4b67b9cd3a476b7dc4f5"}]}] Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1c735f9b47274158b7ced3c235414b1a Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:17:10.424873 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:10.426618 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 14 09:17:10.429520 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.430886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1abcfb33-8f43-4954-9ce8-0abdd0b65426 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:10.430886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1abcfb33-8f43-4954-9ce8-0abdd0b65426 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.734602 Sep 14 09:17:10.430886 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 173/364] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:17:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 738 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:10.444220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:10.447313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:10.469062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:10.470462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:10.471325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:10.473872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:10.474499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:10.480616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:10.557429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 2e511a14-5958-4459-b9ce-fef73682e888 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:10.612868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-39723ff8-7860-4efb-bc4f-c90bfe457521 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 200 len: 2051 microversion: 2.25 time: 0.531581 Sep 14 09:17:10.615069 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 192/365] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:10 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 2051 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:10.633060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99b6adc5-6e0d-4af3-91d6-80f3dc57df89 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Calling method '.version_select at 0x7f693fdbf040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:10.636147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-99b6adc5-6e0d-4af3-91d6-80f3dc57df89 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '1c735f9b47274158b7ced3c235414b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958b9627876c4b67b9cd3a476b7dc4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99b6adc5-6e0d-4af3-91d6-80f3dc57df89 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Request method failure captured: Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwTS-vE1ngQfclyxxXwavaIx74iIICJPYYtsqg0LCJ-5IpLN_w2Nbi38BHI1fY3W6xU-0NEtcbjnrfIMG4Oj7JaThRhgRvROSityJTIVeXx_ofLfG0azHvB5DJDF8YwJ4hAybtbTmzMVPu0DEZEMmobeL8ZhCgUaeh9x2qUjfiY4ZU Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:10.638517 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_958b9627876c4b67b9cd3a476b7dc4f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/958b9627876c4b67b9cd3a476b7dc4f5"}]}] Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 1c735f9b47274158b7ced3c235414b1a Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:17:10.639781 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:10.640576 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 14 09:17:10.641607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.646510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99b6adc5-6e0d-4af3-91d6-80f3dc57df89 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:10.647997 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-99b6adc5-6e0d-4af3-91d6-80f3dc57df89 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.031128 Sep 14 09:17:10.649492 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 193/366] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:10 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:10.663871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35a333e5-191e-4383-b06f-17348b8f0405 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Calling method '.version_select at 0x7f693fce2dc0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:10.666403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35a333e5-191e-4383-b06f-17348b8f0405 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '1c735f9b47274158b7ced3c235414b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958b9627876c4b67b9cd3a476b7dc4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35a333e5-191e-4383-b06f-17348b8f0405 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Request method failure captured: Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwTS-vE1ngQfclyxxXwavaIx74iIICJPYYtsqg0LCJ-5IpLN_w2Nbi38BHI1fY3W6xU-0NEtcbjnrfIMG4Oj7JaThRhgRvROSityJTIVeXx_ofLfG0azHvB5DJDF8YwJ4hAybtbTmzMVPu0DEZEMmobeL8ZhCgUaeh9x2qUjfiY4ZU Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:10.668452 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_958b9627876c4b67b9cd3a476b7dc4f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/958b9627876c4b67b9cd3a476b7dc4f5"}]}] Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 1c735f9b47274158b7ced3c235414b1a Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:17:10.670595 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:10.672640 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 14 09:17:10.676271 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:10.680573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35a333e5-191e-4383-b06f-17348b8f0405 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:10.680573 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35a333e5-191e-4383-b06f-17348b8f0405 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011799 Sep 14 09:17:10.680573 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 194/367] 10.222.0.90 () {58 vars in 1179 bytes} [Wed Sep 14 09:17:10 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:11.091260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:11.102094 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fa64f6bb-96a9-48a5-b955-c0330a3d5683 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 0.672498 Sep 14 09:17:11.104557 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 174/368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:10 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:11.130927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:11.135962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:11.156145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.164595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.164965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.165716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.168368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.168843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.178529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:11.206666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Calling method '.version_select at 0x7f693fd428b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:11.210486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.211207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.211817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.232989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.234885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.236232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.257511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.258776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.260264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.268880 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1aef8a1d-bd8b-4fa6-873b-edbdf87af5e5 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.591204 Sep 14 09:17:11.269472 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 195/369] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:11.279267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-667687996", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b41e49db-121e-4bc1-879b-5eb8e9fa3036"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:11.367234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] validate_networks() for [('b41e49db-121e-4bc1-879b-5eb8e9fa3036', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:11.579048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:11.593358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7567fb6c-ddde-4a06-a74a-fb018fedba83 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1323 microversion: 2.1 time: 0.487735 Sep 14 09:17:11.593948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 175/370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:11 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1323 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:11.611314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:11.612199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:11.629597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.631589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.632271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.635779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:11.636455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:11.637782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:11.941439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:11.950162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31858c61-adb2-40fb-b168-1f01ea03af29 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1273 microversion: 2.1 time: 0.355153 Sep 14 09:17:11.957173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 176/371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:11 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1273 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:11.963843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdfffa4a-dd2f-489e-9565-2078f20dc9eb tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Calling method '.version_select at 0x7f69441b9af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:11.965837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cdfffa4a-dd2f-489e-9565-2078f20dc9eb tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '1c735f9b47274158b7ced3c235414b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958b9627876c4b67b9cd3a476b7dc4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdfffa4a-dd2f-489e-9565-2078f20dc9eb tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Request method failure captured: Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwTS-vE1ngQfclyxxXwavaIx74iIICJPYYtsqg0LCJ-5IpLN_w2Nbi38BHI1fY3W6xU-0NEtcbjnrfIMG4Oj7JaThRhgRvROSityJTIVeXx_ofLfG0azHvB5DJDF8YwJ4hAybtbTmzMVPu0DEZEMmobeL8ZhCgUaeh9x2qUjfiY4ZU Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:11.967537 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_958b9627876c4b67b9cd3a476b7dc4f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/958b9627876c4b67b9cd3a476b7dc4f5"}]}] Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1c735f9b47274158b7ced3c235414b1a Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1'} Sep 14 09:17:11.968800 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:11.969560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 14 09:17:11.971425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:11.974283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdfffa4a-dd2f-489e-9565-2078f20dc9eb tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:11.975316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdfffa4a-dd2f-489e-9565-2078f20dc9eb tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017143 Sep 14 09:17:11.976201 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 177/372] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:17:11 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:11.994110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97dab347-56e7-4e41-90f7-9c9ce525c0d1 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Calling method '.version_select at 0x7f69441310d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:11.995930 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-97dab347-56e7-4e41-90f7-9c9ce525c0d1 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] HTTP exception thrown: Hypervisor with ID 'cd2e0d59-a933-4c94-ac93-665e108d8034' could not be found. Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97dab347-56e7-4e41-90f7-9c9ce525c0d1 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Request method failure captured: Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/cd2e0d59-a933-4c94-ac93-665e108d8034/uptime HTTP/1.1 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwUQsfhyxc5PlJlltP72ZrlXUBAKq9IoSJlsCzQwFT1aVcWDVcaHm_KNrLc3kDGveWlaMMBsshqyZDfZYGGxpa7xIZj5y-F-brNoXtTmrG-ozxyL5rCezAMDYDytpbXVjvdJ4vhdml2bw824li-dyjn9LdRkK0y6CcnguxJxJTzSNA Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b91cab42855d427393984530e82dd8f5 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:17:12.003982 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b91cab42855d427393984530e82dd8f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b91cab42855d427393984530e82dd8f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b91cab42855d427393984530e82dd8f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b91cab42855d427393984530e82dd8f5"}]}] Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b91cab42855d427393984530e82dd8f5 Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: fcfc27ab4b7e4a10bf56ddd9995fc101 Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: exception: Hypervisor with ID 'cd2e0d59-a933-4c94-ac93-665e108d8034' could not be found. Sep 14 09:17:12.005851 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cd2e0d59-a933-4c94-ac93-665e108d8034'} Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'cd2e0d59-a933-4c94-ac93-665e108d8034' Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 14 09:17:12.006678 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'cd2e0d59-a933-4c94-ac93-665e108d8034' could not be found. Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:12.008267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'cd2e0d59-a933-4c94-ac93-665e108d8034' could not be found. Sep 14 09:17:12.009614 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.010912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97dab347-56e7-4e41-90f7-9c9ce525c0d1 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Returning 404 to user: Hypervisor with ID 'cd2e0d59-a933-4c94-ac93-665e108d8034' could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:12.012008 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97dab347-56e7-4e41-90f7-9c9ce525c0d1 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/cd2e0d59-a933-4c94-ac93-665e108d8034/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029410 Sep 14 09:17:12.013118 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 178/373] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 09:17:11 2022] GET /compute/v2.1/os-hypervisors/cd2e0d59-a933-4c94-ac93-665e108d8034/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:12.021127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913eff35-bbfe-4b66-ae71-dbc288038c7f", "name": "network-vif-plugged", "status": "completed", "tag": "db2a2562-b619-4836-aaee-379b0ebbd3f0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:12.034724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.035664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.036343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.049647 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] Creating event network-vif-plugged:db2a2562-b619-4836-aaee-379b0ebbd3f0 for instance 913eff35-bbfe-4b66-ae71-dbc288038c7f on n-h1-851028-12 Sep 14 09:17:12.056269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ef4558b7-4ab0-4987-8958-1cb612f10e91 req-f71619ad-8b34-490f-8f2a-8f74e1734d77 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040865 Sep 14 09:17:12.057402 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 179/374] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:12.064449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Calling method '.version_select at 0x7f69441b9160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.066844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.067625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.068281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.081971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:12.088523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.089270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.089875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.121331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.121734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.122201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.140597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9478a305-d2d0-4f65-995e-3a20f369435c tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.081009 Sep 14 09:17:12.147832 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 180/375] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:12.153304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.154305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:12.163236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.171660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.172322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.179979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.181287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.181751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.712323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:12.729291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a3e43cc-998b-4ded-8075-aa4036e406df tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1322 microversion: 2.1 time: 0.579092 Sep 14 09:17:12.743255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 181/376] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1322 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:12.756312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37651948-b305-4d04-99e1-529cc98b8782 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Calling method '.version_select at 0x7f6944227940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.761781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-37651948-b305-4d04-99e1-529cc98b8782 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '1c735f9b47274158b7ced3c235414b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958b9627876c4b67b9cd3a476b7dc4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37651948-b305-4d04-99e1-529cc98b8782 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Request method failure captured: Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwTS-vE1ngQfclyxxXwavaIx74iIICJPYYtsqg0LCJ-5IpLN_w2Nbi38BHI1fY3W6xU-0NEtcbjnrfIMG4Oj7JaThRhgRvROSityJTIVeXx_ofLfG0azHvB5DJDF8YwJ4hAybtbTmzMVPu0DEZEMmobeL8ZhCgUaeh9x2qUjfiY4ZU Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:12.764328 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_958b9627876c4b67b9cd3a476b7dc4f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/958b9627876c4b67b9cd3a476b7dc4f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/958b9627876c4b67b9cd3a476b7dc4f5"}]}] Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 958b9627876c4b67b9cd3a476b7dc4f5 Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627 Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1c735f9b47274158b7ced3c235414b1a Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2056238627-project Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1'} Sep 14 09:17:12.766277 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:12.767283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 14 09:17:12.769727 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:12.771951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37651948-b305-4d04-99e1-529cc98b8782 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:12.771951 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37651948-b305-4d04-99e1-529cc98b8782 tempest-HypervisorAdminNegativeTestJSON-2056238627 tempest-HypervisorAdminNegativeTestJSON-2056238627-project] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021670 Sep 14 09:17:12.771951 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 182/377] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:12.777546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:12.778402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:12.790279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.792178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.794289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.796039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.796708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:12.797335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:12.963870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:12.967489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:12.968671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:12.969668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:12.973504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:12.998050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:12.999135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.000142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.002171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.003638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.004596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.046834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:13.059778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for user c92c2abda1124946b2adcb0b0560fd0c and project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:13.093850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:13.097420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:13.155524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.219696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13273e72-c4bc-4a42-81d7-8131506cc7f5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1473 microversion: 2.1 time: 0.444883 Sep 14 09:17:13.223156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 183/378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:12 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1473 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:13.251035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7eafe37d-a033-441c-b408-3c6fdee97540 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Calling method '.version_select at 0x7f6944227670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.262291 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-618c22ea-ec56-4105-bda9-99f541f0e80e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.991372 Sep 14 09:17:13.262987 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 196/379] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:17:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:17:13.270501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7eafe37d-a033-441c-b408-3c6fdee97540 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] HTTP exception thrown: Hypervisor with ID '3a363bba-c0a3-435a-a0f0-06635f7a70d6' could not be found. Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7eafe37d-a033-441c-b408-3c6fdee97540 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Request method failure captured: Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-hypervisors/3a363bba-c0a3-435a-a0f0-06635f7a70d6 HTTP/1.1 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwUQsfhyxc5PlJlltP72ZrlXUBAKq9IoSJlsCzQwFT1aVcWDVcaHm_KNrLc3kDGveWlaMMBsshqyZDfZYGGxpa7xIZj5y-F-brNoXtTmrG-ozxyL5rCezAMDYDytpbXVjvdJ4vhdml2bw824li-dyjn9LdRkK0y6CcnguxJxJTzSNA Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b91cab42855d427393984530e82dd8f5 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:17:13.279994 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b91cab42855d427393984530e82dd8f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b91cab42855d427393984530e82dd8f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b91cab42855d427393984530e82dd8f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b91cab42855d427393984530e82dd8f5"}]}] Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b91cab42855d427393984530e82dd8f5 Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072 Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: fcfc27ab4b7e4a10bf56ddd9995fc101 Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: exception: Hypervisor with ID '3a363bba-c0a3-435a-a0f0-06635f7a70d6' could not be found. Sep 14 09:17:13.281644 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3a363bba-c0a3-435a-a0f0-06635f7a70d6'} Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '3a363bba-c0a3-435a-a0f0-06635f7a70d6' Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 14 09:17:13.282497 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:17:13.283979 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '3a363bba-c0a3-435a-a0f0-06635f7a70d6' could not be found. Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '3a363bba-c0a3-435a-a0f0-06635f7a70d6' could not be found. Sep 14 09:17:13.285286 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.291326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7eafe37d-a033-441c-b408-3c6fdee97540 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] Returning 404 to user: Hypervisor with ID '3a363bba-c0a3-435a-a0f0-06635f7a70d6' could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:13.294256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7eafe37d-a033-441c-b408-3c6fdee97540 tempest-HypervisorAdminNegativeTestJSON-1030092072 tempest-HypervisorAdminNegativeTestJSON-1030092072-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/3a363bba-c0a3-435a-a0f0-06635f7a70d6" status: 404 len: 123 microversion: 2.1 time: 0.067208 Sep 14 09:17:13.296429 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 184/380] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/os-hypervisors/3a363bba-c0a3-435a-a0f0-06635f7a70d6 => generated 123 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:13.305550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.306607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.321580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.326524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.327405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.330055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.331297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.333711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.501691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.519742 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c67d7608-4fda-429d-8708-4695b8ff963c tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1271 microversion: 2.1 time: 0.221737 Sep 14 09:17:13.520285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 185/381] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:13.537192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.537690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.565883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.570159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.570864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.574030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.577108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.577828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.638657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Request method failure captured: Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6/diagnostics HTTP/1.1 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwBGfdPEVRzuxMJVOqf5eGSSzYg-utfS1Tf8jNLbs_Wx9iKS8t-XY01CeXKWGppN_rqmPF1hWka2_igctVYLihEDWydtTzqz0Sa-qI7BA90S0hgNTCYc1G-D4FCQjX0UI6bt3zGB8OMzC0PpydNVkvYjycsxnaVX5oUwUYO6vvyMqQ Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a61c927000b6453d8bce8a064217a771 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:13.640474 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a61c927000b6453d8bce8a064217a771", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a61c927000b6453d8bce8a064217a771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a61c927000b6453d8bce8a064217a771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a61c927000b6453d8bce8a064217a771"}]}] Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a61c927000b6453d8bce8a064217a771 Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiagnosticsNegativeTest-680172383-project Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4fc03ddff0b24da2bcdf9c5e332dde93 Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-680172383-project Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:13.642979 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '8286f153-54a7-410c-84e7-50b9fe983ac6'} Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:13.643834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 14 09:17:13.645476 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:13.648787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:13.650484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fcebe6a-03a4-40fc-beac-5adf0022ff6f tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.129317 Sep 14 09:17:13.651646 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 186/382] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6/diagnostics => generated 117 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:13.656699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.658379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.676837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f693fdbfa60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.678980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.679455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.679881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.713566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.714064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.714496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.747144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.747629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.748298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.759119 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0f9eae02-270b-400f-ad0a-d3317aa26962 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.486702 Sep 14 09:17:13.760325 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 197/383] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:13.769216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.770078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.784331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.784828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.790472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.793517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.794030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.794482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.820166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.832992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.836217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:13.838394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2277b9e3-a52b-4f8f-ab0d-9d3e0d7b7965 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1261 microversion: 2.25 time: 0.185497 Sep 14 09:17:13.841681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 187/384] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:13.863064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:13.864071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:13.883974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.888595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.890063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.893258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:13.895270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:13.896664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:13.899396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:14.079744 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-634062d5-3596-444c-84e4-20493c284286 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 204 len: 0 microversion: 2.1 time: 0.317189 Sep 14 09:17:14.082487 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 198/385] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:13 2022] DELETE /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:14.095497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f693fcc7280>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.100514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.101011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.103353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.134280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.135760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.136390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.176908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.177584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.178695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.187645 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-73f066cf-bb87-49a5-8d96-c08a5a00e69b tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.102616 Sep 14 09:17:14.189179 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 199/386] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:14.208169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.209344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:14.218130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.219573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.220822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.222202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.222963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.223690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.584761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:14.593330 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6153a96-5fca-4f24-8bb0-c23472ec9ae4 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1471 microversion: 2.1 time: 0.750529 Sep 14 09:17:14.608450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 188/387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:13 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1471 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:14.814899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.820228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.821377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.821985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.823221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.823834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.824444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.853375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:14.865336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85b26903-4d41-45a3-aec3-826615ccc9db tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1479 microversion: 2.1 time: 0.661657 Sep 14 09:17:14.867418 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 200/388] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1479 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:14.874699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f693fe24670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.888625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ad5ba45-8dfd-4f0b-999d-4afe6bb04acc tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.278741 Sep 14 09:17:14.889218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 189/389] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:14.895842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.896429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.896876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.901656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:14.902326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:14.911027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.911791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.912324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.913286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.914134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.914821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.932474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.932984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.933438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.958328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:14.959200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:14.959631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:14.966088 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0e782a4-2e0b-4a5a-a922-58cc9df77d67 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.095020 Sep 14 09:17:14.967947 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 201/390] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:15.364299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:15.370519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] [instance: 8d256ecf-1e28-49d3-a8d6-0aca733f2fda] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:15.378465 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] HTTP exception thrown: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Request method failure captured: Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/8d256ecf-1e28-49d3-a8d6-0aca733f2fda/action HTTP/1.1 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 15 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwHFHLgZnjhEV-KCG1bj1AAsz8-e__-neWkO1sTPh9TbxSukmJdhV0P0ayN0a47GHLNnliLCCkn2CWgv9DxtdAhbA-Be0HqgHSoiE4_E4qwEMOj5Mwen1hl967NywOMXBhs-MxF1W2cC1T7RvkwWN7lNH2jpAW0SMeB5NfR1rsvCzw Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:15.381943 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c319dc0238504269b73e6008cf2607e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c319dc0238504269b73e6008cf2607e1"}]}] Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 45cc396218f04100846f332e882f6f6d Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: {"migrate": {}} Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:15.383211 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '8d256ecf-1e28-49d3-a8d6-0aca733f2fda', 'body': {'migrate': {}}} Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:15.385334 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. Sep 14 09:17:15.386552 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:15.387616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Returning 404 to user: Instance 8d256ecf-1e28-49d3-a8d6-0aca733f2fda could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:15.387616 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f911d5a8-091d-4c67-8f16-640de456b921 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/8d256ecf-1e28-49d3-a8d6-0aca733f2fda/action" status: 404 len: 111 microversion: 2.1 time: 0.416634 Sep 14 09:17:15.396543 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 202/391] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:14 2022] POST /compute/v2.1/servers/8d256ecf-1e28-49d3-a8d6-0aca733f2fda/action => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:15.405023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.406143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:15.415714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.416601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.418225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.419154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.419853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.420476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.577934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:15.597631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:15.602523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:15.605835 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c143435b-a28a-475e-a35b-361a47be2e98 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1257 microversion: 2.25 time: 0.207182 Sep 14 09:17:15.606412 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 203/392] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1257 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:15.621620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.630225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:15.631752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.635440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.635916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.641895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.641895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.643022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.643933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-76aadf07-61d1-417c-a038-335802a83db0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.753487 Sep 14 09:17:15.647128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 190/393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:14 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:15.660770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f69442270d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.682564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.683198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:15.685239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.687113 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3911f0b-c9a5-4f54-bf7d-ceae86f90905 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.070155 Sep 14 09:17:15.688217 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 204/394] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:15.694106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-11275040", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:15.699354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.756307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.761985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.765671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.778327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:15.781570 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65f86c49-d0ae-496d-afea-b277657b4222 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.132873 Sep 14 09:17:15.783980 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 191/395] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:15.794812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.809871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.810684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.811299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.812089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.812537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.813027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.881937 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53af4ee3-7ae4-452c-a5a8-16414b1431d0 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.096477 Sep 14 09:17:15.884382 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 192/396] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:15.905300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efa4b7af-8f9f-478a-b4a4-eda1136c7507 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f6944227ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.908430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efa4b7af-8f9f-478a-b4a4-eda1136c7507 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.909229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efa4b7af-8f9f-478a-b4a4-eda1136c7507 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.909923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efa4b7af-8f9f-478a-b4a4-eda1136c7507 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.953982 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efa4b7af-8f9f-478a-b4a4-eda1136c7507 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.058356 Sep 14 09:17:15.955204 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 193/397] 10.222.0.90 () {58 vars in 1179 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:15.960516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:15.961348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:15.970609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.971582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.972441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:15.973995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:15.974851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:15.975863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:16.853434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc03ddff0b24da2bcdf9c5e332dde93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c927000b6453d8bce8a064217a771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:16.866917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85f14061-f20d-44aa-8930-fd07aac67ff5 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 200 len: 1479 microversion: 2.1 time: 0.910180 Sep 14 09:17:16.881422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 194/398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:15 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 1479 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:16.890630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:16.902688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:16.903226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:16.903755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:16.904639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:16.905221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:16.905854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:16.960470 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ca4f27c-5558-4b0f-8466-032a7e43fa0f tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?host=n-d-851028-12&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.074854 Sep 14 09:17:16.969522 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 195/399] 10.222.0.90 () {58 vars in 1196 bytes} [Wed Sep 14 09:17:16 2022] GET /compute/v2.1/os-services?host=n-d-851028-12&binary=xxx => generated 16 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:16.975290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f69441b9e50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:16.977353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:16.978018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:16.978828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.004847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.005970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.007124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.010455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:17.010960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:17.012400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:17.012918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:17.013682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:17.022276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.023489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.024123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.025221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.025862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.026556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.028426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.029616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.030836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.033487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1fae092a-4210-44bf-8bc8-5c433e9887bb tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.061403 Sep 14 09:17:17.034163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 196/400] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:17.042417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.045494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:17.053888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.054397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.054843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.055556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.056048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.057323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.076328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Getting quotas for project 4f7c8c34482c413795cf068d9dc47820. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:17.083185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Getting quotas for user eb15ea3eacc54f439db99d1413ff2d70 and project 4f7c8c34482c413795cf068d9dc47820. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:17.098934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:17.102019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:17.178789 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0f43bb2-fdfb-4688-b355-ff8fa4f5533c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487908 Sep 14 09:17:17.179438 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 205/401] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:17.190307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.190670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:17.191011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:17.205145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.205744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.206380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.207117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.207248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:17.207805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.208268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.212519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:17.216867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96a72152-dddb-42e5-a7e4-c64a97710eb6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1319 microversion: 2.25 time: 0.181223 Sep 14 09:17:17.222202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 197/402] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:17.238020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8286f153-54a7-410c-84e7-50b9fe983ac6", "name": "network-vif-deleted", "tag": "a6327aa4-d808-445b-904b-e5599496fd66"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:17.273840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.274384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.274765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.292721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] Creating event network-vif-deleted:a6327aa4-d808-445b-904b-e5599496fd66 for instance 8286f153-54a7-410c-84e7-50b9fe983ac6 on n-h2-851028-12 Sep 14 09:17:17.300536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-12b633b0-36c2-4386-93d7-60d515a7b410 req-445bda73-80f8-481b-87f2-ef2d70e64884 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076354 Sep 14 09:17:17.301582 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 198/403] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:17.308688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.314236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.315214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.321069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.322450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.322913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.323664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.364711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f7005d9-34fb-45f9-8048-370cb1cba508 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.061863 Sep 14 09:17:17.372131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 199/404] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/os-services => generated 949 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:17.382570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f6944270dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.385239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.386085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.386669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.421146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.424331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.424716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.438276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ff12f7a-aca1-46a9-a048-082010f17467 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.071227 Sep 14 09:17:17.451950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 200/405] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:17.461456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25c7ba53-dfd4-4ff6-bc3d-94884bd69865 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.464744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25c7ba53-dfd4-4ff6-bc3d-94884bd69865 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:17.621391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25c7ba53-dfd4-4ff6-bc3d-94884bd69865 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:17.642628 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25c7ba53-dfd4-4ff6-bc3d-94884bd69865 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1220 microversion: 2.1 time: 0.188461 Sep 14 09:17:17.645750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 201/406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1220 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:17.650569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.666008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.670084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.670791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.672147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.672949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.673914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.741457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cbfcca28-1b88-407c-b7d1-dea7481efa54 tempest-ServicesAdminNegativeTestJSON-1895256500 tempest-ServicesAdminNegativeTestJSON-1895256500-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.094356 Sep 14 09:17:17.742063 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 202/407] 10.222.0.90 () {58 vars in 1198 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:17.746743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f69441b9280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:17.750801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.751739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.752384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.770263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:17.771191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:17.772150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:17.783588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c353181-bf78-44d1-86af-76b40f1c0294 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.038955 Sep 14 09:17:17.796637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 203/408] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:18.154378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bc18de9-7599-4812-a6fd-f3389fad599d tempest-ServicesAdminNegativeTestJSON-429080744 tempest-ServicesAdminNegativeTestJSON-429080744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.158922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bc18de9-7599-4812-a6fd-f3389fad599d tempest-ServicesAdminNegativeTestJSON-429080744 tempest-ServicesAdminNegativeTestJSON-429080744-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '06186c6ec0ff44b785ba3d022c19a084', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2822e4a31321409e8b8da908ca4b9a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bc18de9-7599-4812-a6fd-f3389fad599d tempest-ServicesAdminNegativeTestJSON-429080744 tempest-ServicesAdminNegativeTestJSON-429080744-project] Request method failure captured: Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwYHIyFEa_FDBeXrvqWovVlvAePfmjZ91jmTzKqOOuKn049Uvdiq0ouPfsTmPB_87PFvIInV_TPk2RMJDGCR0egRqFIq1al9znHuRf2h_l9bhGdCsd3pYDD4xrQc_QAe3d-TLkx8hYg_g-9vgqKuuPvtZeciLnL458V55OTPEkDVA4 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2822e4a31321409e8b8da908ca4b9a0f Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-429080744 Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:17:18.161601 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2822e4a31321409e8b8da908ca4b9a0f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2822e4a31321409e8b8da908ca4b9a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2822e4a31321409e8b8da908ca4b9a0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2822e4a31321409e8b8da908ca4b9a0f"}]}] Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-429080744 Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2822e4a31321409e8b8da908ca4b9a0f Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-429080744 Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServicesAdminNegativeTestJSON-429080744-project Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 06186c6ec0ff44b785ba3d022c19a084 Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-429080744-project Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:18.164036 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:18.165538 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:18.168078 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.170953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bc18de9-7599-4812-a6fd-f3389fad599d tempest-ServicesAdminNegativeTestJSON-429080744 tempest-ServicesAdminNegativeTestJSON-429080744-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:18.170953 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bc18de9-7599-4812-a6fd-f3389fad599d tempest-ServicesAdminNegativeTestJSON-429080744 tempest-ServicesAdminNegativeTestJSON-429080744-project] 10.222.0.90 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.364874 Sep 14 09:17:18.179881 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 204/409] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/os-services => generated 112 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:18.188470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Calling method '.version_select at 0x7f6944227310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.191007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.194949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.195403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.219518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.220467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.221252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.227158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:18.232169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.248185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.249034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.249868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.255683 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b7c4514e-54b5-4206-99c3-ca32c0bd1dbb tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 1.074850 Sep 14 09:17:18.259787 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 206/410] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:17 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:18.269549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.270509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] [instance: 8286f153-54a7-410c-84e7-50b9fe983ac6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:18.294464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.295466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.296162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.297049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.299266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.300786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.344727 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] HTTP exception thrown: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Request method failure captured: Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 HTTP/1.1 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwBGfdPEVRzuxMJVOqf5eGSSzYg-utfS1Tf8jNLbs_Wx9iKS8t-XY01CeXKWGppN_rqmPF1hWka2_igctVYLihEDWydtTzqz0Sa-qI7BA90S0hgNTCYc1G-D4FCQjX0UI6bt3zGB8OMzC0PpydNVkvYjycsxnaVX5oUwUYO6vvyMqQ Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a61c927000b6453d8bce8a064217a771 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:18.349335 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a61c927000b6453d8bce8a064217a771", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a61c927000b6453d8bce8a064217a771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a61c927000b6453d8bce8a064217a771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a61c927000b6453d8bce8a064217a771"}]}] Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a61c927000b6453d8bce8a064217a771 Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-680172383 Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerDiagnosticsNegativeTest-680172383-project Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fc03ddff0b24da2bcdf9c5e332dde93 Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-680172383-project Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. Sep 14 09:17:18.350921 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '8286f153-54a7-410c-84e7-50b9fe983ac6'} Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:18.351791 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. Sep 14 09:17:18.353197 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:18.354414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2221d01a-87b4-4014-8326-25cfca6b10d8 tempest-HypervisorAdminTestJSON-1559097917 tempest-HypervisorAdminTestJSON-1559097917-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.168692 Sep 14 09:17:18.354414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 205/411] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:17:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:18.357160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] Returning 404 to user: Instance 8286f153-54a7-410c-84e7-50b9fe983ac6 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:18.359005 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dc44064c-6801-4d56-854e-768fbf4a2225 tempest-ServerDiagnosticsNegativeTest-680172383 tempest-ServerDiagnosticsNegativeTest-680172383-project] 10.222.0.90 "GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6" status: 404 len: 111 microversion: 2.1 time: 0.096627 Sep 14 09:17:18.362785 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 207/412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:18 2022] GET /compute/v2.1/servers/8286f153-54a7-410c-84e7-50b9fe983ac6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:18.386020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.387913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:18.401817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.403127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.404276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.405673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.406707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.407761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.594600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.617085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.618871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.620342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-908632b1-0f94-4bbc-9e39-f57eb3631830 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1319 microversion: 2.25 time: 0.264014 Sep 14 09:17:18.625769 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 206/413] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:18 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:18.671280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:18.672487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:18.681532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.682195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.682756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.683542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.684149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.684726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:18.807560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:18.826761 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3e1076c2-631a-4c89-870e-f2b6eac73a25 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1272 microversion: 2.1 time: 0.160159 Sep 14 09:17:18.828860 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 208/414] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:18 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:18.918208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cb27920-4d70-4a4b-91ff-37534d4f1d02", "tag": "d3529903-7c5a-4122-80f1-25c708c5a4f2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:18.957058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:18.962817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:18.963364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.002951 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] Creating event network-changed:d3529903-7c5a-4122-80f1-25c708c5a4f2 for instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 on n-h1-851028-12 Sep 14 09:17:19.023172 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4559b023-2783-49a3-88ba-2b8192e213f6 req-26b0094d-ebd9-4d2c-92fa-0ddc8f0aaddc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108811 Sep 14 09:17:19.031810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 207/415] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:19.306185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:19.306731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:19.322599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.323115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.323565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.330489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.331005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.335650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.648640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:19.649969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:19.658011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.659059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.659667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.660595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:19.661205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:19.661788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:19.930632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:19.944164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:19.959248 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ccdf786-4d0f-40ed-82bc-2fb0b9adb792 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.657170 Sep 14 09:17:19.973130 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 209/416] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:19 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:20.175443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Action: 'update', calling method: .version_select at 0x7f693fd8f160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:20.280005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:20.296315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:20.301191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:20.307505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b7709f36-5ef2-42cf-9f14-c36ac0ec5a66 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.659475 Sep 14 09:17:20.308450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 208/417] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:19 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:20.315847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:20.320460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:20.336210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.340651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.341111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.341911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.345992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.346626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.740817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:20.752824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d891bf2-ac09-4f51-8839-a6a64972272e tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1278 microversion: 2.1 time: 0.442482 Sep 14 09:17:20.753786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 209/418] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:20 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1278 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:20.958229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=63 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:20.966043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.969558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.971691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.972735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:20.973203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:20.973641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:20.991866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:20.993552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:21.021376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.022389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.023072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.024557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.027072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.027879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.126076 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10fc78ef-b42d-4d09-be2c-57e0ece4997e tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265" status: 200 len: 148 microversion: 2.57 time: 1.138746 Sep 14 09:17:21.128054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 210/419] 10.222.0.90 () {62 vars in 1303 bytes} [Wed Sep 14 09:17:19 2022] PUT /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265 => generated 148 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:21.139543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Calling method '.version_select at 0x7f693fd42af0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:21.599142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:21.609637 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d27b79d-af3c-4a73-88c5-7dcfc2c854a0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.622418 Sep 14 09:17:21.614548 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 210/420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:20 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:21.633650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:21.633650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:21.641899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.642516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.642960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:21.656578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:21.657175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:21.658200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.288460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.289033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.296949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.297787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.298853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.303369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.352309 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-70023832-b575-49ab-8ee9-4d57519f2add tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265/detail" status: 200 len: 463 microversion: 2.57 time: 1.217448 Sep 14 09:17:22.354031 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 211/421] 10.222.0.90 () {60 vars in 1304 bytes} [Wed Sep 14 09:17:21 2022] GET /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265/detail => generated 463 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 14 09:17:22.363832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fc6b01-f21f-416b-b181-0fbde2328d3c", "tag": "e7762d66-8887-45f8-8da3-b517f6778654"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:22.383455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.383962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.390953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.413964 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] Creating event network-changed:e7762d66-8887-45f8-8da3-b517f6778654 for instance c6fc6b01-f21f-416b-b181-0fbde2328d3c on n-h2-851028-12 Sep 14 09:17:22.436350 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3e4b3479-d066-44bf-b5b2-c2c85dda2daf req-b58e8b05-dab6-42ba-98a0-80e6db6fee7e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080877 Sep 14 09:17:22.441633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 212/422] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:22.448347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:22.452519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:22.473280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.474199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.474998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.475953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.476668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.477269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.753942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:22.772592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:22.776478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:22.778447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c88efeef-d929-40ad-913f-8145a3e099d7 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 1.162664 Sep 14 09:17:22.780642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 211/423] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:21 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:22.789570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:22.791315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:22.805962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.807572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.808265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:22.809274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:22.809938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:22.810644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.170430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:23.188749 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41002146-9ce2-4532-935d-ff6f00272c68 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.745489 Sep 14 09:17:23.189361 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 213/424] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:22 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:23.195363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Action: 'update', calling method: .version_select at 0x7f693fe24310>, body: {"quota_set": {"ram": "2048"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:23.333523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:23.351726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61f89a9c-8a3f-4f6b-86c5-ff9ee5d2542b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.566210 Sep 14 09:17:23.356143 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 212/425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:22 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:23.366671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12b89df-3c48-4741-945a-70141cadbcf2", "tag": "603d9c60-7c63-4552-976e-f915cb3ccf5b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:23.413515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.414143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.414675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.450015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.450703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.456869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.458314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.461897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.462657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.470568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] Creating event network-changed:603d9c60-7c63-4552-976e-f915cb3ccf5b for instance b12b89df-3c48-4741-945a-70141cadbcf2 on n-h2-851028-12 Sep 14 09:17:23.493874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-831f7902-c224-41e1-888e-d12cfb5d9123 req-5da76e3c-7d0b-4bf9-a303-98650c4ece74 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130968 Sep 14 09:17:23.496450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 213/426] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:23.713652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.714267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.714707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.715506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.715997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.716444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.816592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:23.817501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:23.831400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.837805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.838671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.841520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:23.844158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:23.847541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:23.908432 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8282901e-780b-4024-b22f-1057dd5a0ef3 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265?user_id=deb0d343cb3e48c184a1609a5607ba87" status: 200 len: 148 microversion: 2.57 time: 0.712726 Sep 14 09:17:23.909141 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 214/427] 10.222.0.90 () {62 vars in 1384 bytes} [Wed Sep 14 09:17:23 2022] PUT /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265?user_id=deb0d343cb3e48c184a1609a5607ba87 => generated 148 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:23.925727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b930ed94-9fbd-4b11-a3ec-f4ea1a5e50e8 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] Calling method '.version_select at 0x7f693fcc7dc0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:24.275467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.286438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.287928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.289057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e720c89-05c3-4c82-81c9-ec03502970c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.479529 Sep 14 09:17:24.304600 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 214/428] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:23 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:24.314790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:24.315556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:24.324262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.325103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.325766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.326714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.327234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.327814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.632828 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b930ed94-9fbd-4b11-a3ec-f4ea1a5e50e8 tempest-QuotasAdminTestV257-26254215 tempest-QuotasAdminTestV257-26254215-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265?user_id=deb0d343cb3e48c184a1609a5607ba87" status: 200 len: 190 microversion: 2.57 time: 0.715606 Sep 14 09:17:24.640547 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 215/429] 10.222.0.90 () {60 vars in 1364 bytes} [Wed Sep 14 09:17:23 2022] GET /compute/v2.1/os-quota-sets/325a3ff4e1574a8198d8bde6f1c44265?user_id=deb0d343cb3e48c184a1609a5607ba87 => generated 190 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:24.646873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:24.647836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:24.660528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.661521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.662159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.666909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:24.667977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:24.668631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:24.938212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:24.953381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f02c7afc-57b2-4f3e-a55f-9258721e5022 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.647587 Sep 14 09:17:24.954774 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 215/430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:24 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:25.028882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:25.041475 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb8098ca-e689-4ff9-b2b3-ed3502ec69f0 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.399135 Sep 14 09:17:25.058458 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 216/431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:24 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:25.322102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:25.323149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:25.353375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:25.354180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:25.355767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:25.357361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:25.358336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:25.359512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:25.779407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:25.798613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:25.805104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:25.807396 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cae60a5a-3e15-47e0-a6e9-a4244828220b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.491915 Sep 14 09:17:25.825165 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 216/432] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:25 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:25.981048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:25.981761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:25.991137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:25.996850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:25.997650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:26.000175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:26.000689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:26.002491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:26.068256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:26.070103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:26.082102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:26.082811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:26.084344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:26.087183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:26.093246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:26.097850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:26.978042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:26.987540 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca283f58-9c5a-4eac-bd49-5686c713c511 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 1.010594 Sep 14 09:17:26.988254 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 217/433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:25 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:27.004432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb27920-4d70-4a4b-91ff-37534d4f1d02", "name": "network-vif-plugged", "status": "completed", "tag": "d3529903-7c5a-4122-80f1-25c708c5a4f2"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:27.035835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.037822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.039652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.051441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.073626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] Creating event network-vif-plugged:d3529903-7c5a-4122-80f1-25c708c5a4f2 for instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 on n-h1-851028-12 Sep 14 09:17:27.081457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e38bb7d-c20e-4797-8443-b274743ab4d4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 1.011390 Sep 14 09:17:27.083040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 217/434] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:26 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:27.085673 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7ffcbf0a-4a7c-42da-853d-5669b8704963 req-96fd86ac-0139-4b18-be89-e288f8496064 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096172 Sep 14 09:17:27.089897 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 218/435] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:27.097665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:27.098318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:27.125987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.126769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.127219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.128551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:27.133089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:27.133782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:27.629206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=62 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:27.657726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.681062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.685896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:27.691633 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02290669-d476-405b-93c5-cac09318f1a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.602282 Sep 14 09:17:27.693469 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 218/436] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:27 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:28.014597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.015915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.034596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.043631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.044476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.046214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.046872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.047514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.106983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.108488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.112897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=21 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:28.135710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.137043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.139124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.142551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.151024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.153000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.539620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:28.548496 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a2747ec-31c3-4879-aeab-0c0aba1db5cc tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.538517 Sep 14 09:17:28.556662 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 219/437] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:28.599096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:28.617167 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcdcfa99-6400-41e6-b18d-29abab282349 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1313 microversion: 2.1 time: 0.512980 Sep 14 09:17:28.621973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 219/438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:28.723164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:28.724152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:28.740757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.742416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.744595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:28.746271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:28.749197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:28.750260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.196251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Action: 'update', calling method: .version_select at 0x7f693fced430>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:29.200206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.200703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.201144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.224455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=27 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:29.229686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.230172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.241575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.276376 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] HTTP exception thrown: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Request method failure captured: Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f HTTP/1.1 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 56 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwoH334o5xeLEGJvFGTL17cDo1c-BsdDGgXnBgQOAn_fmjtuMyU4mKuCeLKaSm7xDmcewflt5wEKmH7KIjHNT9qXv3bI5KCaG4HzciYWik_rf2NPdI9VfKGDVipDWat4CD05uidpHHVsEUKolNkpS-5Mxmydv1DKmQtiVau7E7eLAw Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:29.289237 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_821622e4f3e94ec8bbce115bbdaed389", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/821622e4f3e94ec8bbce115bbdaed389"}]}] Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 80cef14d15b041b3a29b32c2d9963234 Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:17:29.290835 n-d-851028-12 devstack@n-api.service[122443]: exception: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '229670c4-3179-4ea3-b3f2-bb99e49beb3f', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.291722 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.293481 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:29.295371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:29.295371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.295371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.298333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Returning 404 to user: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:29.302208 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10954677-9b26-416a-b755-34ddb9a480fa tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f" status: 404 len: 110 microversion: 2.53 time: 0.742624 Sep 14 09:17:29.309104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 220/439] 10.222.0.90 () {62 vars in 1309 bytes} [Wed Sep 14 09:17:28 2022] PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f => generated 110 bytes in 751 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:29.321006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Action: 'update', calling method: .version_select at 0x7f693fd2a1f0>, body: {"status": "disabled"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:29.329128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.333451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.342867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.374091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.378955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.382173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.402046 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] HTTP exception thrown: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Request method failure captured: Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f HTTP/1.1 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 22 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwoH334o5xeLEGJvFGTL17cDo1c-BsdDGgXnBgQOAn_fmjtuMyU4mKuCeLKaSm7xDmcewflt5wEKmH7KIjHNT9qXv3bI5KCaG4HzciYWik_rf2NPdI9VfKGDVipDWat4CD05uidpHHVsEUKolNkpS-5Mxmydv1DKmQtiVau7E7eLAw Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:29.412271 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_821622e4f3e94ec8bbce115bbdaed389", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/821622e4f3e94ec8bbce115bbdaed389"}]}] Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 80cef14d15b041b3a29b32c2d9963234 Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: {"status": "disabled"} Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: exception: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.413756 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '229670c4-3179-4ea3-b3f2-bb99e49beb3f', 'body': {'status': 'disabled'}} Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.414591 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:29.415735 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:29.416904 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.416904 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.419297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Returning 404 to user: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:29.426981 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f8769010-4faf-485b-b6c6-fe342cbf37da tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f" status: 404 len: 110 microversion: 2.53 time: 0.116369 Sep 14 09:17:29.430104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 221/440] 10.222.0.90 () {62 vars in 1309 bytes} [Wed Sep 14 09:17:29 2022] PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f => generated 110 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:29.446077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Action: 'update', calling method: .version_select at 0x7f693fd42ca0>, body: {"status": "enabled"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:29.477438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.479585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.487420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.518452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.534389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.541571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.578734 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] HTTP exception thrown: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Request method failure captured: Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f HTTP/1.1 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 21 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwoH334o5xeLEGJvFGTL17cDo1c-BsdDGgXnBgQOAn_fmjtuMyU4mKuCeLKaSm7xDmcewflt5wEKmH7KIjHNT9qXv3bI5KCaG4HzciYWik_rf2NPdI9VfKGDVipDWat4CD05uidpHHVsEUKolNkpS-5Mxmydv1DKmQtiVau7E7eLAw Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:29.585599 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_821622e4f3e94ec8bbce115bbdaed389", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/821622e4f3e94ec8bbce115bbdaed389"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/821622e4f3e94ec8bbce115bbdaed389"}]}] Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 821622e4f3e94ec8bbce115bbdaed389 Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236 Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 80cef14d15b041b3a29b32c2d9963234 Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: {"status": "enabled"} Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: exception: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.587315 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '229670c4-3179-4ea3-b3f2-bb99e49beb3f', 'body': {'status': 'enabled'}} Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.588350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:29.590777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:29.599559 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. Sep 14 09:17:29.599559 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:29.599559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Returning 404 to user: Service 229670c4-3179-4ea3-b3f2-bb99e49beb3f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:29.599559 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fc25d43-1961-42cb-a1a5-4c9e7616f492 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f" status: 404 len: 110 microversion: 2.53 time: 0.157789 Sep 14 09:17:29.600469 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 222/441] 10.222.0.90 () {62 vars in 1309 bytes} [Wed Sep 14 09:17:29 2022] PUT /compute/v2.1/os-services/229670c4-3179-4ea3-b3f2-bb99e49beb3f => generated 110 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:29.658180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:29.677501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:29.679231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:29.680490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a56953d-7d01-45df-9b23-ae73fcdc7c96 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.962731 Sep 14 09:17:29.688532 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 220/442] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:28 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:29.700562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:29.701371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:29.713386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.713880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.714313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:29.715026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:29.715478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:29.715918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.066149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-66314958", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:30.163019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:30.164225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:30.165040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:30.165868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:30.166551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:30.199572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.200966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.202227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.208361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.209581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.213403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.237962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.256102 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f072e5d-7b60-4b58-97db-8a14e139477b tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.561644 Sep 14 09:17:30.265663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Getting quotas for project c040b15f5387486682fe2b57aede25ec. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:30.274413 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 221/443] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:29 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:30.279202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Getting quotas for user df1f14d130ab4801ab4af77ceb1f5471 and project c040b15f5387486682fe2b57aede25ec. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:30.284039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.289605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.290219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.290670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.291415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.291865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.292991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.305862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:30.309071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:30.335153 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df1f5d3f-900f-4020-b89f-3f8a9de33399 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.058234 Sep 14 09:17:30.346486 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 222/444] 10.222.0.90 () {60 vars in 1178 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:30.356541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.357715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:30.362871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:30.368180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:30.370580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.371616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.372454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.373580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.374395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.375220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.415960 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-20ce842a-0aba-42ce-8fc4-3cff27db3449 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.812466 Sep 14 09:17:30.417171 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 223/445] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:17:30.432855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fc6b01-f21f-416b-b181-0fbde2328d3c", "name": "network-vif-plugged", "status": "completed", "tag": "e7762d66-8887-45f8-8da3-b517f6778654"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:30.462979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.463514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.464363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.483716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] Creating event network-vif-plugged:e7762d66-8887-45f8-8da3-b517f6778654 for instance c6fc6b01-f21f-416b-b181-0fbde2328d3c on n-h2-851028-12 Sep 14 09:17:30.489907 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f1cec546-d5f6-4fc5-94fd-b1951142c11a req-e77468af-ca3c-42d7-812a-a32e1a41f560 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070972 Sep 14 09:17:30.490856 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 224/446] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:30.498783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.504489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.504975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.505619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.506702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.507327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.508330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.539632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31db20cd-cd04-40aa-adf4-c778339aa529 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.046521 Sep 14 09:17:30.540898 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 225/447] 10.222.0.90 () {60 vars in 1211 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:30.556942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.558023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:30.692381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.708220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.711011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.719323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:30.730749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f04ac639-8d7d-4c9f-8783-21726134b81b tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1463 microversion: 2.1 time: 0.382777 Sep 14 09:17:30.731764 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 223/448] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1463 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:30.752063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.753813 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3bc2a4a0-c880-4446-a7dd-5a966e568351 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1450 microversion: 2.91 time: 0.189513 Sep 14 09:17:30.768100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.768100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.768100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.768584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.768584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.768584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.769987 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 226/449] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1450 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:30.772483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:30.782944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:30.784207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:30.792995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.793885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.794636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.795439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:30.796110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:30.796884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:30.818574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4683d246-49a1-4e2b-bc86-c64b2d16fe39 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.075553 Sep 14 09:17:30.830053 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 224/450] 10.222.0.90 () {60 vars in 1178 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:31.064921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Calling method '.version_select at 0x7f69440ee670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.087850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.089488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.097665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.125094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.127009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.128071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.132396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.142686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.150146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.151336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f1c54b4-f6ec-419a-8d22-4ad9ede227c9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.380105 Sep 14 09:17:31.156451 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 227/451] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:31.162985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.170777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ab5d6ac-7c03-4db8-ad49-f3a17f16d9ef tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage/21ec556cdc15433d8f77662f79e19b03?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827" status: 200 len: 690 microversion: 2.1 time: 0.339462 Sep 14 09:17:31.179254 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 225/452] 10.222.0.90 () {58 vars in 1412 bytes} [Wed Sep 14 09:17:30 2022] GET /compute/v2.1/os-simple-tenant-usage/21ec556cdc15433d8f77662f79e19b03?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827 => generated 690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:31.192713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.193508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.194160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.195166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.195384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '.version_select at 0x7f6944125700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.196170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.197073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.222407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.223736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.226210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.240840 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1207048b-661f-43e6-a14b-02b21829254c tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?host=n-d-851028-12&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.083231 Sep 14 09:17:31.242088 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 228/453] 10.222.0.90 () {60 vars in 1237 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-services?host=n-d-851028-12&binary=xxx => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:31.263442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.264023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.264885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.265289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.279136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.282087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.283566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.285115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.286718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.287798 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bef8babf-92f0-47ef-8ed1-d29a9815307a tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage/21ec556cdc15433d8f77662f79e19b03?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827" status: 200 len: 694 microversion: 2.1 time: 0.096688 Sep 14 09:17:31.288520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.302515 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 226/454] 10.222.0.90 () {58 vars in 1412 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-simple-tenant-usage/21ec556cdc15433d8f77662f79e19b03?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827 => generated 694 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:31.309112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.310897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:31.323640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.324176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.324617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.327224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.327778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.328420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.368518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b41057cf-6acf-4f42-878e-71c4c5b8bd4f tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.117645 Sep 14 09:17:31.385345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 229/455] 10.222.0.90 () {60 vars in 1178 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:17:31.392635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Calling method '.version_select at 0x7f693fd2aee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.436939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.437716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.438302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.466428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.466914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.467394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.550911 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9e0fa84b-7190-4e6b-a351-c98fc616176f tempest-TenantUsagesTestJSON-74535308 tempest-TenantUsagesTestJSON-74535308-project-admin] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827&detailed=1" status: 200 len: 4417 microversion: 2.1 time: 0.164063 Sep 14 09:17:31.569633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 230/456] 10.222.0.90 () {58 vars in 1335 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T09%3A17%3A30.750827&end=2022-09-15T09%3A17%3A30.750827&detailed=1 => generated 4417 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:31.586583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:31.605663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.611145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.612167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.612935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.613691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.614139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.614741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.624649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3bf61216-c84d-407f-bcaa-ad6daa902775 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.320283 Sep 14 09:17:31.628853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 227/457] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:31.673667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:31.677116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:31.694934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.699037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.700035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.701332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:31.702023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:31.703156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:31.708632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-61195adc-7916-4c80-9cda-0cca33e0d708 tempest-ServicesAdminNegativeV253TestJSON-2085607236 tempest-ServicesAdminNegativeV253TestJSON-2085607236-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.137974 Sep 14 09:17:31.712281 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 231/458] 10.222.0.90 () {60 vars in 1239 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:31.777304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:32.015003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f16e6a3-2ed2-4252-a828-8653bfb9931f tempest-ServicesAdminNegativeV253TestJSON-789913464 tempest-ServicesAdminNegativeV253TestJSON-789913464-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.026595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1f16e6a3-2ed2-4252-a828-8653bfb9931f tempest-ServicesAdminNegativeV253TestJSON-789913464 tempest-ServicesAdminNegativeV253TestJSON-789913464-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5f15044463204e06ade105ef2d7237c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d10cb0e1f3479c8aa1577acb2accfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f16e6a3-2ed2-4252-a828-8653bfb9931f tempest-ServicesAdminNegativeV253TestJSON-789913464 tempest-ServicesAdminNegativeV253TestJSON-789913464-project] Request method failure captured: Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwna8bQJ8cm6GBIJkhiXohyy2NSAI3PkxGEJ2KwSnYd1aFz6ydGijA35rAUuD8xZIQHXvA3Syowmly7GKxa9R-hJ5MfXcbi51PYDD983Y4sBtj7VqqjO5J_2BuXveF2oL2Lm0PwezGWrVuk6G2eOwV0-dzSHZiVGX0dQXo8Fp5QA-Q Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.53 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 61d10cb0e1f3479c8aa1577acb2accfd Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-789913464 Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:32.034240 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_61d10cb0e1f3479c8aa1577acb2accfd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/61d10cb0e1f3479c8aa1577acb2accfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/61d10cb0e1f3479c8aa1577acb2accfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/61d10cb0e1f3479c8aa1577acb2accfd"}]}] Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-789913464 Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 61d10cb0e1f3479c8aa1577acb2accfd Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-789913464 Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServicesAdminNegativeV253TestJSON-789913464-project Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 5f15044463204e06ade105ef2d7237c0 Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-789913464-project Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:32.036007 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:17:32.036949 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 14 09:17:32.038368 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:32.043009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f16e6a3-2ed2-4252-a828-8653bfb9931f tempest-ServicesAdminNegativeV253TestJSON-789913464 tempest-ServicesAdminNegativeV253TestJSON-789913464-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:32.043922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d5d3c8b-9ba4-4c05-abc8-d67578eb4afe tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 204 len: 0 microversion: 2.1 time: 0.411826 Sep 14 09:17:32.050671 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 228/459] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:31 2022] DELETE /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:32.052646 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f16e6a3-2ed2-4252-a828-8653bfb9931f tempest-ServicesAdminNegativeV253TestJSON-789913464 tempest-ServicesAdminNegativeV253TestJSON-789913464-project] 10.222.0.90 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.323076 Sep 14 09:17:32.055065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 232/460] 10.222.0.90 () {60 vars in 1178 bytes} [Wed Sep 14 09:17:31 2022] GET /compute/v2.1/os-services => generated 112 bytes in 334 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:17:32.088670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.092797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.094279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:32.097754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:32.129661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.130479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.131386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.157915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.161060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.161972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.179747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.180391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.051s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.180847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.182848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.184720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.185941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.600386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.615879 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9b8051b5-42bb-495d-8db1-83a90a055f41 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1469 microversion: 2.1 time: 0.554198 Sep 14 09:17:32.619268 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 233/461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1469 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:32.626950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.628795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:32.636841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.663104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.666135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.668772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:32.670712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.676495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.677823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.678545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.679452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.703015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e858bd16-a79e-456f-a035-1147d021f0b4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1502 microversion: 2.91 time: 0.640273 Sep 14 09:17:32.707048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 229/462] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1502 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:32.744646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:32.745936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:32.769654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.773430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.774561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:32.776957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:32.779879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:32.782050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.240873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.257290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.261918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.263857 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5f872abc-b7fb-4684-8ebd-ababe51f3d72 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1361 microversion: 2.25 time: 0.643271 Sep 14 09:17:33.268401 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 234/463] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:33.322988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:33.336180 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc4f9d83-fff8-497f-98ae-e21edc3c7c40 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.614998 Sep 14 09:17:33.347669 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 230/464] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:32 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:33.573837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12b89df-3c48-4741-945a-70141cadbcf2", "name": "network-vif-plugged", "status": "completed", "tag": "603d9c60-7c63-4552-976e-f915cb3ccf5b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:33.631344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.647619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:33.648794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:33.655174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.661437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.684507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.689260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.695365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.703066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.706416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.709206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.731739 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] Creating event network-vif-plugged:603d9c60-7c63-4552-976e-f915cb3ccf5b for instance b12b89df-3c48-4741-945a-70141cadbcf2 on n-h2-851028-12 Sep 14 09:17:33.768821 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-98920b1e-7228-40fa-8ef8-4bb7df8be9af req-079177dd-e450-42de-a056-ce6c4d30401d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195011 Sep 14 09:17:33.773338 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 235/465] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:33.800279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:33.801020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:33.841347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.844207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.845357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:33.846386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:33.851130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:33.851873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.300685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.310380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.322866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.330610 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afef6ab2-b10c-4cc9-b551-34694fe8681e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1510 microversion: 2.91 time: 0.552270 Sep 14 09:17:34.331762 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 236/466] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:33 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:34.342315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.342958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.361653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.362859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.363476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.364429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.365213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.365817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.461476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:34.485961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed600048-e11d-4dfc-9ad4-c5cb9a20bee4 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1469 microversion: 2.1 time: 0.839475 Sep 14 09:17:34.489395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 231/467] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:33 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1469 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:34.508769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:34.512541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:34.533911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.537777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.538504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:34.539872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:34.540443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:34.543858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.079581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.091225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70535ba9-1b0a-4187-a195-8e15fba636fe tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1320 microversion: 2.1 time: 0.599591 Sep 14 09:17:35.108178 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 232/468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:35.111716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.128211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.131228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.142005 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47853834-c0aa-4a26-8979-1041af5963ce tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1557 microversion: 2.25 time: 0.809321 Sep 14 09:17:35.187109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 237/469] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:34 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1557 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:35.201838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:35.204540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:35.221179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.221981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.224919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.225891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.226497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.229093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.488102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fc7a493-8e96-448f-a589-ddef756557b6 tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] Action: 'create', calling method: .version_select at 0x7f6944066280>, body: {"security_group": {"name": "tempest-securitygroup-1767425116", "description": "tempest-description-234663831"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:35.688462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:35.755646 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-130b2edb-d8b8-4fdd-9f85-ddc706015f63 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 2051 microversion: 2.25 time: 0.565794 Sep 14 09:17:35.757291 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 238/470] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:35 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 2051 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:35.762840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:35.763445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:35.790207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.791151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.791810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.793325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:35.794148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:35.794737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:35.822973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:35.913266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.927476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.930542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:35.955430 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1cb61a18-ae43-4f58-8437-70c4ddf9064e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1508 microversion: 2.91 time: 0.193713 Sep 14 09:17:35.956141 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 239/471] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:35 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:35.981869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:35.985109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:36.005647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.006148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.006587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.007292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.009360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.029932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.128661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.129367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.130066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.130613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lazy-loading 'fault' on Instance uuid 0cb27920-4d70-4a4b-91ff-37534d4f1d02 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:36.310286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a8f8c3be15942768efca8f028b8fa0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21ec556cdc15433d8f77662f79e19b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:36.326552 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3034e2f-838d-4a11-a89d-94e1e6919d6d tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 200 len: 1303 microversion: 2.1 time: 0.364594 Sep 14 09:17:36.328609 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 240/472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:35 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 1303 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:36.340631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cb27920-4d70-4a4b-91ff-37534d4f1d02", "name": "network-vif-deleted", "tag": "d3529903-7c5a-4122-80f1-25c708c5a4f2"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:36.356380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fc7a493-8e96-448f-a589-ddef756557b6 tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.214449 Sep 14 09:17:36.356990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 233/473] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:17:35 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:36.366025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:36.366025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:36.366323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.366825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.367269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.381042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.381541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.381979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.382689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.383143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.383571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.400945 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] Creating event network-vif-deleted:d3529903-7c5a-4122-80f1-25c708c5a4f2 for instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 on n-h1-851028-12 Sep 14 09:17:36.417262 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9684d609-9b00-4a53-8576-af8012aee380 req-d773c77a-79e9-4bd0-9ebf-ee1c1a04c0be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085210 Sep 14 09:17:36.421139 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 241/474] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:36.873104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51983056-1335-4eab-a7a0-ea517166a7c1 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:36.884676 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51983056-1335-4eab-a7a0-ea517166a7c1 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.461181 Sep 14 09:17:36.889207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 242/475] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:36.908385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:36.914072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:36.948810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.949837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.950468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.951412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:36.952192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:36.952779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:36.994761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:37.148850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a18711d0-f3c1-4dc9-ae55-f8657eef4536 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 2051 microversion: 2.25 time: 0.790522 Sep 14 09:17:37.159505 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 234/476] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:36 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 2051 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:37.171204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08e63cf2-c253-4f91-aca0-ab5cb83f0b3d tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] Action: 'create', calling method: .version_select at 0x7f694408b280>, body: {"security_group": {"name": "tempest-securitygroup-611911748", "description": "tempest-description-373999016"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:37.200736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.215049 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-230259ee-4231-44f9-ae68-653790466491 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1470 microversion: 2.1 time: 0.322255 Sep 14 09:17:37.222482 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 243/477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:36 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:37.442260 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08e63cf2-c253-4f91-aca0-ab5cb83f0b3d tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.280907 Sep 14 09:17:37.447951 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 235/478] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:37.453839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.454756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.475884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.476900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.477492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.479051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.479686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.480330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.544762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56ff78d5-03c1-46a5-8e4c-ecd45bc54f7d tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1293164083", "id": 422970518, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:37.607539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.639489 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56ff78d5-03c1-46a5-8e4c-ecd45bc54f7d tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.414427 Sep 14 09:17:37.648514 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 244/479] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/flavors => generated 422 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:37.656389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.664288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.664789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.665249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.665998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.667215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.667865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.668079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.673769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:37.700324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02c56377-0e2a-4a7b-9823-7b6685effc63 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1529 microversion: 2.91 time: 0.248079 Sep 14 09:17:37.702704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 236/480] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1529 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:37.714729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:37.716066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.718981 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e6972066-0a4a-4397-9027-f548f0519f08 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.056514 Sep 14 09:17:37.727433 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 245/481] 10.222.0.90 () {60 vars in 1217 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:37.732749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.734740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.735350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.738134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.738601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.739013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:37.739635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] [instance: 0cb27920-4d70-4a4b-91ff-37534d4f1d02] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:37.740900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.749992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.749992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.749992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.759089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:37.759534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:37.761179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:37.807463 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] HTTP exception thrown: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Request method failure captured: Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 HTTP/1.1 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwRzEVIOvq7rEHlKusJSanIcsNmKe8te80poLfjvxyFDhVPTVjg27hGJRnankT_yzl74naAyrSA-SrriXUz1lTmRY-pgWdPrSX_QnCJTsT-Kg7ZL-bzBHlVT-0VAOpON5wR5SbCSfygpiDb2WWYDLyENF3uN2snzl3FTg1bC0ZwLSI Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 21ec556cdc15433d8f77662f79e19b03 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TenantUsagesTestJSON-1763901704 Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:37.810322 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21ec556cdc15433d8f77662f79e19b03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21ec556cdc15433d8f77662f79e19b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21ec556cdc15433d8f77662f79e19b03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21ec556cdc15433d8f77662f79e19b03"}]}] Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TenantUsagesTestJSON-1763901704 Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 21ec556cdc15433d8f77662f79e19b03 Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1763901704 Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TenantUsagesTestJSON-1763901704-project Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6a8f8c3be15942768efca8f028b8fa0b Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TenantUsagesTestJSON-1763901704-project Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. Sep 14 09:17:37.811860 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '0cb27920-4d70-4a4b-91ff-37534d4f1d02'} Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:37.812780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. Sep 14 09:17:37.814343 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:37.818177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] Returning 404 to user: Instance 0cb27920-4d70-4a4b-91ff-37534d4f1d02 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:37.818177 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-059da22b-ffaf-4d00-85bf-ba533bc1b188 tempest-TenantUsagesTestJSON-1763901704 tempest-TenantUsagesTestJSON-1763901704-project] 10.222.0.90 "GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02" status: 404 len: 111 microversion: 2.1 time: 0.088754 Sep 14 09:17:37.818177 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 246/482] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:37 2022] GET /compute/v2.1/servers/0cb27920-4d70-4a4b-91ff-37534d4f1d02 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:37.946669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lazy-loading 'flavor' on Instance uuid b12b89df-3c48-4741-945a-70141cadbcf2 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:38.116376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a33ec64d-9144-45c6-9fb8-9eadd4ca4f36 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2/action" status: 202 len: 0 microversion: 2.1 time: 0.402407 Sep 14 09:17:38.118624 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 237/483] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:38.149302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8722a67a-1d2f-4142-bc53-e90559c2b194 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:38.176522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8722a67a-1d2f-4142-bc53-e90559c2b194 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048895 Sep 14 09:17:38.185991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 238/484] 10.222.0.90 () {58 vars in 1182 bytes} [Wed Sep 14 09:17:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:38.195852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:38.196549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:38.206605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:38.207013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:38.207567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:38.208609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:38.210573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:38.210573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:38.352514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83a32209-3af1-4ca6-bfd0-d988052ad6bc tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Action: 'create', calling method: .version_select at 0x7f693fd2ad30>, body: {"security_group": {"name": "tempest-securitygroup-988066384", "description": "tempest-description-2116685328"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:38.444852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aabe3108-4405-4894-b908-7d1a629ebb37 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c/action" status: 202 len: 0 microversion: 2.25 time: 0.256010 Sep 14 09:17:38.445694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 239/485] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:17:38 2022] POST /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:39.008008 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83a32209-3af1-4ca6-bfd0-d988052ad6bc tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.188778 Sep 14 09:17:39.008835 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 247/486] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:17:37 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:39.018024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:39.018715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:39.038347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:39.039050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:39.043581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.044123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.044565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.045276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.045737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.050297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.056730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.057827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.058791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.059844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.062777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.063489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.736306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lazy-loading 'services' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:39.754867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:39.825304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e958c067-f215-400e-a22b-5f693fc1ff89 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1936 microversion: 2.91 time: 1.375000 Sep 14 09:17:39.836818 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 240/487] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:38 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1936 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:39.849930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c119f80c-f10f-4fee-90e0-8b39333b49d2 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1952765708", "id": 1234278336, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:39.900726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c119f80c-f10f-4fee-90e0-8b39333b49d2 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.062595 Sep 14 09:17:39.912849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 241/488] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:39 2022] POST /compute/v2.1/flavors => generated 425 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:39.924475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:39.925485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:39.938884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.939392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.940567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:39.941709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:39.943942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:39.946438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.276921 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e95b8848-f073-445f-93a9-1c01352f942f tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1614 microversion: 2.1 time: 1.262019 Sep 14 09:17:40.282979 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 248/489] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:39 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1614 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:40.300404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-db6ad450-1eff-48a1-8c18-283c5170862f tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Action: 'create', calling method: .version_select at 0x7f693fce2790>, body: {"security_group": {"name": "tempest-securitygroup-271969570", "description": "tempest-description-54597695"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:40.365504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:40.419550 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1723f617-aaf6-4b2f-a0b8-fa22248ec125 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 2036 microversion: 2.25 time: 0.505272 Sep 14 09:17:40.422970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 242/490] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:39 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 2036 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:40.459330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:40.464949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:40.492809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.494430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.497013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.498268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.501536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.505395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.697079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=33 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:40.743554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lazy-loading 'services' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:40.805892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35b6e862-91ba-4314-bbce-17609d0c25a5 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1936 microversion: 2.91 time: 0.372603 Sep 14 09:17:40.807544 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 243/491] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:40 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1936 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:40.829843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0be9e592-b06f-4ed7-82ec-116643904de6 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:40.854126 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0be9e592-b06f-4ed7-82ec-116643904de6 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.041441 Sep 14 09:17:40.854889 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 244/492] 10.222.0.90 () {58 vars in 1182 bytes} [Wed Sep 14 09:17:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:17:40.861927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:40.866500 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-db6ad450-1eff-48a1-8c18-283c5170862f tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.573195 Sep 14 09:17:40.867503 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 249/493] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:17:40 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:40.869458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:40.878948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.879723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.880438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.881770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.882474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.883123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.891689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851028-12", "block_migration": "auto"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:40.905217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:40.927806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.928339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.928775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:40.930072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:40.930520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:40.932167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.028171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'flavor' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:41.057976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Going to try to live migrate instance to n-h1-851028-12 {{(pid=122443) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:17:41.264004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:41.633892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] HTTP exception thrown: Cannot 'migrate' instance b12b89df-3c48-4741-945a-70141cadbcf2 while it is in vm_state suspended Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Request method failure captured: Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2/action HTTP/1.1 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwHFHLgZnjhEV-KCG1bj1AAsz8-e__-neWkO1sTPh9TbxSukmJdhV0P0ayN0a47GHLNnliLCCkn2CWgv9DxtdAhbA-Be0HqgHSoiE4_E4qwEMOj5Mwen1hl967NywOMXBhs-MxF1W2cC1T7RvkwWN7lNH2jpAW0SMeB5NfR1rsvCzw Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:17:41.635863 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c319dc0238504269b73e6008cf2607e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c319dc0238504269b73e6008cf2607e1"}]}] Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 45cc396218f04100846f332e882f6f6d Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: {"migrate": {}} Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:17:41.637201 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'migrate' instance b12b89df-3c48-4741-945a-70141cadbcf2 while it is in vm_state suspended Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b12b89df-3c48-4741-945a-70141cadbcf2', 'body': {'migrate': {}}} Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b12b89df-3c48-4741-945a-70141cadbcf2 in vm_state suspended. Cannot resize while the instance is in this state. Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:41.638045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b12b89df-3c48-4741-945a-70141cadbcf2 while it is in vm_state suspended Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:41.641634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b12b89df-3c48-4741-945a-70141cadbcf2 while it is in vm_state suspended Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Returning 409 to user: Cannot 'migrate' instance b12b89df-3c48-4741-945a-70141cadbcf2 while it is in vm_state suspended {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-693fe270-5263-483d-b40b-798300b23e75 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2/action" status: 409 len: 148 microversion: 2.1 time: 0.780638 Sep 14 09:17:41.645282 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 245/494] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:40 2022] POST /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2/action => generated 148 bytes in 787 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:17:41.648450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:41.663994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.665084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.668050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.669158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:41.669601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:41.672179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:41.733758 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a70f0b6-4953-45fb-add6-745b30ad59f8 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.089110 Sep 14 09:17:41.734373 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 246/495] 10.222.0.90 () {60 vars in 1217 bytes} [Wed Sep 14 09:17:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:41.749680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3df4568d-d0d4-4ee3-9827-a1fe0e6b1acd tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Action: 'create', calling method: .version_select at 0x7f694408b160>, body: {"keypair": {"name": "tempest-keypair-2037761214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2Fxy0wk+Lm5WWLDoKFliN3IHulo6SnTiAn0J6Pq0bApZL5yXYOYknR2ciUUJFoJtGhQBshHhjSGag0yXFXX8LJdVQGwZYgp+POafyziwMn0J+JkdBabgFpGr+yrtA2jw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:41.772460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3df4568d-d0d4-4ee3-9827-a1fe0e6b1acd tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:41.777237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3df4568d-d0d4-4ee3-9827-a1fe0e6b1acd tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for user 55337a61f6f54038a60f21aa891ccee1 and project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:41.828787 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3df4568d-d0d4-4ee3-9827-a1fe0e6b1acd tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089138 Sep 14 09:17:41.838659 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 247/496] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:17:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:41.852252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Calling method '.version_select at 0x7f693fe675e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:44.995115 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dcb13af4-fc02-43fe-ae3a-a6e2944c2853 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c/action" status: 202 len: 0 microversion: 2.25 time: 4.126225 Sep 14 09:17:44.996676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 250/497] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:17:40 2022] POST /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c/action => generated 0 bytes in 4129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:45.004279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4f04b15-c611-408e-b6c3-bce0bd4739b4 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4f04b15-c611-408e-b6c3-bce0bd4739b4 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Request method failure captured: Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action HTTP/1.1 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 39 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwHFHLgZnjhEV-KCG1bj1AAsz8-e__-neWkO1sTPh9TbxSukmJdhV0P0ayN0a47GHLNnliLCCkn2CWgv9DxtdAhbA-Be0HqgHSoiE4_E4qwEMOj5Mwen1hl967NywOMXBhs-MxF1W2cC1T7RvkwWN7lNH2jpAW0SMeB5NfR1rsvCzw Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:45.008332 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c319dc0238504269b73e6008cf2607e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c319dc0238504269b73e6008cf2607e1"}]}] Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 45cc396218f04100846f332e882f6f6d Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: {"os-resetState": {"state": "invalid"}} Sep 14 09:17:45.009964 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '913eff35-bbfe-4b66-ae71-dbc288038c7f', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:45.010741 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:17:45.012347 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 14 09:17:45.013686 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:45.014221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4f04b15-c611-408e-b6c3-bce0bd4739b4 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:45.015338 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d4f04b15-c611-408e-b6c3-bce0bd4739b4 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action" status: 400 len: 144 microversion: 2.1 time: 0.017224 Sep 14 09:17:45.016345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 251/498] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:44 2022] POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:45.023857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:45.024694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:45.054298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:45.059747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:45.060582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:45.062219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:45.063684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:45.064492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:45.154989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lazy-loading 'flavor' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:45.697820 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6218a1af-d12c-4acb-a86a-5b1fb3273195 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action" status: 202 len: 0 microversion: 2.91 time: 0.678359 Sep 14 09:17:45.704390 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 252/499] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:17:45 2022] POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:46.071652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0ae43dc0-ee45-4ef5-8283-feb54eedea67 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:46.082878 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0ae43dc0-ee45-4ef5-8283-feb54eedea67 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.372154 Sep 14 09:17:46.094063 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 253/500] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:46.110076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:46.111832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:46.120521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.140522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.146331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:46.147712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:46.151063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:46.153499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.137665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.181235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.183482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.184945 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b53d6202-2dab-460f-b69c-eeb5921b52e0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 1.087678 Sep 14 09:17:47.185683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84bd5288-250c-47de-b443-19b0c526a119 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:17:47.186258 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 254/501] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:46 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:47.186370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Neutron security group 84bd5288-250c-47de-b443-19b0c526a119 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:17:47.187058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.security_groups [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Security Group ID 84bd5288-250c-47de-b443-19b0c526a119 does not exist {{(pid=122444) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 14 09:17:47.192181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4268f463-8bbc-4eb0-989b-9a9ed1b8277d tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4268f463-8bbc-4eb0-989b-9a9ed1b8277d tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Request method failure captured: Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action HTTP/1.1 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 31 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwHFHLgZnjhEV-KCG1bj1AAsz8-e__-neWkO1sTPh9TbxSukmJdhV0P0ayN0a47GHLNnliLCCkn2CWgv9DxtdAhbA-Be0HqgHSoiE4_E4qwEMOj5Mwen1hl967NywOMXBhs-MxF1W2cC1T7RvkwWN7lNH2jpAW0SMeB5NfR1rsvCzw Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:47.197173 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c319dc0238504269b73e6008cf2607e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c319dc0238504269b73e6008cf2607e1"}]}] Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 45cc396218f04100846f332e882f6f6d Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: {"os-resetState": {"state": 1}} Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:47.198701 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '913eff35-bbfe-4b66-ae71-dbc288038c7f', 'body': {'os-resetState': {'state': 1}}} Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 1 Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:47.200156 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 14 09:17:47.201380 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.205441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4268f463-8bbc-4eb0-989b-9a9ed1b8277d tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:47.206821 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4268f463-8bbc-4eb0-989b-9a9ed1b8277d tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action" status: 400 len: 120 microversion: 2.1 time: 0.019344 Sep 14 09:17:47.207576 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 255/502] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:17:47 2022] POST /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f/action => generated 120 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:17:47.219086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.220549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:47.228866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.229526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.230738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.231819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.232777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.233215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.269217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 84bd5288-250c-47de-b443-19b0c526a119 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:17:47.269897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Neutron security group 84bd5288-250c-47de-b443-19b0c526a119 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:17:47.270241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.security_groups [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Security Group ID 84bd5288-250c-47de-b443-19b0c526a119 does not exist {{(pid=122444) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 14 09:17:47.414457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.499590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.506964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:47.533325 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-248ec229-a1d6-4f89-bf15-4fad6de09647 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.318110 Sep 14 09:17:47.555543 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 256/503] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:47 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:47.587750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aae28317-845a-4773-ad05-2fe81507d89b tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.627735 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aae28317-845a-4773-ad05-2fe81507d89b tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.060563 Sep 14 09:17:47.628961 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 257/504] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:17:47 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:47.648754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:47.661450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Failed to fetch instance by id 999 {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:17:47.662831 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Request method failure captured: Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 37 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwHFHLgZnjhEV-KCG1bj1AAsz8-e__-neWkO1sTPh9TbxSukmJdhV0P0ayN0a47GHLNnliLCCkn2CWgv9DxtdAhbA-Be0HqgHSoiE4_E4qwEMOj5Mwen1hl967NywOMXBhs-MxF1W2cC1T7RvkwWN7lNH2jpAW0SMeB5NfR1rsvCzw Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:17:47.672152 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c319dc0238504269b73e6008cf2607e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c319dc0238504269b73e6008cf2607e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c319dc0238504269b73e6008cf2607e1"}]}] Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c319dc0238504269b73e6008cf2607e1 Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1618577214 Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 45cc396218f04100846f332e882f6f6d Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1618577214-project-admin Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: {"os-resetState": {"state": "error"}} Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:47.674638 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 999 could not be found. Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:17:47.675505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 14 09:17:47.677129 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:47.679947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:47.681210 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-708b19e0-fcd2-47bb-b247-2d10f85a8b71 tempest-ServersAdminNegativeTestJSON-1618577214 tempest-ServersAdminNegativeTestJSON-1618577214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.050915 Sep 14 09:17:47.684306 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 258/505] 10.222.0.90 () {60 vars in 1179 bytes} [Wed Sep 14 09:17:47 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:17:47.685997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=19 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:47.698846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-911e8ede-b73a-4203-a9d2-41b7ba4ceb3a tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.723638 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-911e8ede-b73a-4203-a9d2-41b7ba4ceb3a tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036794 Sep 14 09:17:47.732189 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 259/506] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:47.741462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:47.743645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:47.760608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.761376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.762986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.765634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:47.768525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:47.769710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:47.842959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:48.141054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-13c39738-fa45-424a-8cb2-0b35809f68bb tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 204 len: 0 microversion: 2.1 time: 0.414598 Sep 14 09:17:48.142672 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 260/507] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:47 2022] DELETE /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:48.164449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a75e6c6-9420-4845-ad98-885970373b25 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:48.179518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a75e6c6-9420-4845-ad98-885970373b25 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035156 Sep 14 09:17:48.191654 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 261/508] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:48.213370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:48.214667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:48.234787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.236517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.245923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:48.247745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:48.249423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:48.252233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.582986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:49.605062 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ef602b1-a3b6-40d2-9c5c-61c1be499fc0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1467 microversion: 2.1 time: 1.403020 Sep 14 09:17:49.606579 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 262/509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:48 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1467 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:49.616104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-834057d7-8e1e-4f8b-80c7-f6c696c0ad4c tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:49.629360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:49.663282 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-834057d7-8e1e-4f8b-80c7-f6c696c0ad4c tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.055018 Sep 14 09:17:49.664534 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 263/510] 10.222.0.90 () {58 vars in 1165 bytes} [Wed Sep 14 09:17:49 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:49.681580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:49.686107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:49.709056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.711334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.714543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.715520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:49.716240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:49.716843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:49.787071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:50.228702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.239576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.241045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:50.242435 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-956b43b4-b190-4252-a729-4538573dbba6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 0.576690 Sep 14 09:17:50.243485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 264/511] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:49 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:50.251514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1581218725", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "1234278336", "adminPass": "***", "networks": [{"uuid": "5b8a862c-2436-460d-9581-aff71c8982e7"}], "security_groups": [{"name": "tempest-securitygroup--704785983"}], "key_name": "tempest-keypair-2037761214", "user_data": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:50.760121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] validate_networks() for [('5b8a862c-2436-460d-9581-aff71c8982e7', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:51.683826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:51.685360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=22 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:51.790325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:51.821261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:17:52.057349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:52.058014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:52.058846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:52.059589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:52.060265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:52.067802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33a61281-c3bd-4550-aa57-76579460f21b tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] 10.222.0.90 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10600 microversion: 2.1 time: 10.226189 Sep 14 09:17:52.069993 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 248/512] 10.222.0.90 () {58 vars in 1191 bytes} [Wed Sep 14 09:17:41 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10600 bytes in 10230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:17:52.078878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:52.081827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:52.105301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.106215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.106829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.107782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.108746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.109330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.123231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.124128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.129480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.137147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.143072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.144670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.230078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:52.235062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for user 55337a61f6f54038a60f21aa891ccee1 and project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:52.263762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:52.266378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:52.323418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.353657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.357042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.404768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e9fe07a-6d51-4259-b72f-c71b08587797 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.332071 Sep 14 09:17:52.405780 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 249/513] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:52.449777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77d1367d-f325-443f-8250-bdfcb2f9e7d7 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.200835 Sep 14 09:17:52.455335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 265/514] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:52.465175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fc6b01-f21f-416b-b181-0fbde2328d3c", "name": "network-vif-unplugged", "status": "completed", "tag": "e7762d66-8887-45f8-8da3-b517f6778654"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:52.475341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1079a689-3906-453d-bea0-71805f646b5b tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:52.493087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.493598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.494039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.499180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1079a689-3906-453d-bea0-71805f646b5b tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039404 Sep 14 09:17:52.499848 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 266/515] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:52.509506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:52.510112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:52.519523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.521001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.522034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.523184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.523997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.524902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.574048 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] Creating event network-vif-unplugged:e7762d66-8887-45f8-8da3-b517f6778654 for instance c6fc6b01-f21f-416b-b181-0fbde2328d3c on n-h2-851028-12 Sep 14 09:17:52.589696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-192c3956-80bc-4c87-8a50-d6122312f882 req-b525fdc9-a385-426a-982a-557293001273 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146560 Sep 14 09:17:52.593818 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 250/516] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:52.616270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:52.620810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:52.653869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.656378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.659668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.662980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.665458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.666740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:52.667414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.667595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:52.668086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:52.668900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lazy-loading 'fault' on Instance uuid b12b89df-3c48-4741-945a-70141cadbcf2 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:52.769894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:52.793975 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1aa75ace-9a40-4c9d-aaff-29193ddc096d tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 200 len: 1310 microversion: 2.1 time: 0.291278 Sep 14 09:17:52.794658 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 267/517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:52.820315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3b58179-d889-475c-975c-6dff0243d82e tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] Calling method '.version_select at 0x7f693fd42700>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.089618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.103261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.112285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.114789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ecf8c49-9dfa-43e6-a870-a38a507a7e4b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 0.518471 Sep 14 09:17:53.129194 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 251/518] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:53.150554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3b58179-d889-475c-975c-6dff0243d82e tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.338695 Sep 14 09:17:53.152117 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 268/519] 10.222.0.90 () {58 vars in 1191 bytes} [Wed Sep 14 09:17:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:53.156964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0bb763a-33f3-4639-a704-15510b21b046 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.159702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e8f22e2-4aa5-4797-9eb8-c5e16877f57b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.162450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e8f22e2-4aa5-4797-9eb8-c5e16877f57b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.234872 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0bb763a-33f3-4639-a704-15510b21b046 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.081437 Sep 14 09:17:53.237103 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 269/520] 10.222.0.90 () {58 vars in 1169 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:53.242101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a49c5c9c-e346-4140-aa08-4a7bb0f8e081 tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Calling method '.version_select at 0x7f693fb86670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.250339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e8f22e2-4aa5-4797-9eb8-c5e16877f57b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.271042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e8f22e2-4aa5-4797-9eb8-c5e16877f57b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1265 microversion: 2.1 time: 0.140272 Sep 14 09:17:53.272943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 252/521] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:53.286010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0a1b568-378c-4d95-a959-b519d673dc63 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.325284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d0a1b568-378c-4d95-a959-b519d673dc63 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.050369 Sep 14 09:17:53.328969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 253/522] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:53.350372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-699d844e-46e7-4d96-ae8b-3f4a7352aca8 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.371803 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-699d844e-46e7-4d96-ae8b-3f4a7352aca8 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027875 Sep 14 09:17:53.373080 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 254/523] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:53.386206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac946f07-c844-4593-b9af-2cabbf462fbe tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.478846 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac946f07-c844-4593-b9af-2cabbf462fbe tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.096289 Sep 14 09:17:53.508509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 255/524] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:53.519437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.531674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.539776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.549688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.550345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.551178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.551748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.552456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.737177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.754564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.763471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:53.773243 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a49c5c9c-e346-4140-aa08-4a7bb0f8e081 tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/e45b651f-6484-4919-a06f-f3110deac779" status: 202 len: 0 microversion: 2.1 time: 0.534836 Sep 14 09:17:53.773830 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 270/525] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:17:53 2022] DELETE /compute/v2.1/os-security-groups/e45b651f-6484-4919-a06f-f3110deac779 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:53.778850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e3cd81b-9583-4333-b7e3-461aedf9ace4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.269020 Sep 14 09:17:53.780126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 256/526] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:53.780249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-074c50ce-4a1e-476d-b417-2266afc9f1c9 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.799138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a72d21c4-06a0-4591-bc06-1f6b3929e8b9 tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] Calling method '.version_select at 0x7f693fe284c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.803754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-074c50ce-4a1e-476d-b417-2266afc9f1c9 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028841 Sep 14 09:17:53.804630 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 271/527] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:53.839386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.840096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: b12b89df-3c48-4741-945a-70141cadbcf2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:53.871264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.872210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.874764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.875714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:53.876976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:53.877416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:53.930185 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] HTTP exception thrown: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Request method failure captured: Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 HTTP/1.1 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwF0tHbtu5af0slC8pwsJev0u6NHGQFskD-4spdvxv4siZdc0a8-Dau4qVOXlpS1x2fKC3PjdequCKk7uVbt09C280uwfPZGupuHF-lhFmSVPz5myleRM2jQhoBYxytMqTvTSxAliqoMTjEZi9Ab-ZsqNDXpLs7Xyx01BGvOL3JiTQ Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4f7c8c34482c413795cf068d9dc47820 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:17:53.933393 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4f7c8c34482c413795cf068d9dc47820", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f7c8c34482c413795cf068d9dc47820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f7c8c34482c413795cf068d9dc47820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4f7c8c34482c413795cf068d9dc47820"}]}] Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4f7c8c34482c413795cf068d9dc47820 Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-752717229-project Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: eb15ea3eacc54f439db99d1413ff2d70 Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752717229-project Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. Sep 14 09:17:53.934922 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b12b89df-3c48-4741-945a-70141cadbcf2'} Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:17:53.935881 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. Sep 14 09:17:53.937398 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:17:53.940583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Returning 404 to user: Instance b12b89df-3c48-4741-945a-70141cadbcf2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:17:53.942256 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9cb614ac-e5d0-463c-b313-e12e18e93959 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2" status: 404 len: 111 microversion: 2.1 time: 0.122688 Sep 14 09:17:53.943306 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 272/528] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/servers/b12b89df-3c48-4741-945a-70141cadbcf2 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:17:53.949245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-337bf306-088e-4e3e-abf4-6a857a673f03 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.979134 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-337bf306-088e-4e3e-abf4-6a857a673f03 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.034500 Sep 14 09:17:53.980669 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 273/529] 10.222.0.90 () {58 vars in 1144 bytes} [Wed Sep 14 09:17:53 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:53.991101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:53.993039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:54.006061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.006803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.010413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.011640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.012363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.013317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.072382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:17:54.235960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a72d21c4-06a0-4591-bc06-1f6b3929e8b9 tempest-SecurityGroupsTestAdminJSON-1588889542 tempest-SecurityGroupsTestAdminJSON-1588889542-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/6f50718d-55b1-4e9f-beac-402a5082adf8" status: 202 len: 0 microversion: 2.1 time: 0.453993 Sep 14 09:17:54.237019 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 257/530] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:17:53 2022] DELETE /compute/v2.1/os-security-groups/6f50718d-55b1-4e9f-beac-402a5082adf8 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:54.242619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75260d86-50f4-4f1c-96da-85dc32a8751e tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:54.257519 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b4d0af93-5a0b-441b-8f82-b948cda0ecb0 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "DELETE /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 204 len: 0 microversion: 2.1 time: 0.275329 Sep 14 09:17:54.259045 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 274/531] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:17:53 2022] DELETE /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:17:54.270453 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75260d86-50f4-4f1c-96da-85dc32a8751e tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032269 Sep 14 09:17:54.271637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 258/532] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:54.280756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc4a3d1a-ee1d-476f-b646-852ebed643e6 tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] Calling method '.version_select at 0x7f693fe67280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:54.281116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:54.285564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:54.299380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.302407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.308905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.310021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.310583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.311156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.769630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.778968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.786080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:54.787574 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78a6f4fd-8cda-42ac-b6c4-1cecc80ef383 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 0.526955 Sep 14 09:17:54.792656 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 275/533] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:54 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:54.798572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:54.799140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:54.811070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.817508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.822277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:54.823212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:54.824021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:54.824776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.140012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.155135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0dcaaba6-f22f-411c-9ece-7db4ef54235c tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1477 microversion: 2.1 time: 0.360600 Sep 14 09:17:55.155756 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 276/534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:54 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1477 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:55.170962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b162bbf1-aeb7-4197-9978-5ebfa499797f tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.217046 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b162bbf1-aeb7-4197-9978-5ebfa499797f tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.051961 Sep 14 09:17:55.218420 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 277/535] 10.222.0.90 () {58 vars in 1148 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:55.224138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.225396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:55.226123 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc4a3d1a-ee1d-476f-b646-852ebed643e6 tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/02bd506a-2e3f-4eb3-a227-de7db330913e" status: 202 len: 0 microversion: 2.1 time: 0.952895 Sep 14 09:17:55.228502 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 259/536] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:17:54 2022] DELETE /compute/v2.1/os-security-groups/02bd506a-2e3f-4eb3-a227-de7db330913e => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:55.245118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.245745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.246206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.246959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.247641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.248297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.373319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1595575513", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "96e7261f-bc7b-4692-a80d-6b913a391b83"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:55.408929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.418557 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f52bb27f-0f61-49a9-9056-509b28a06b5d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1323 microversion: 2.1 time: 0.198887 Sep 14 09:17:55.419142 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 278/537] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:55.429513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fc6b01-f21f-416b-b181-0fbde2328d3c", "tag": "e7762d66-8887-45f8-8da3-b517f6778654"}, {"server_uuid": "b12b89df-3c48-4741-945a-70141cadbcf2", "name": "network-vif-deleted", "tag": "603d9c60-7c63-4552-976e-f915cb3ccf5b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:55.449314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] validate_networks() for [('96e7261f-bc7b-4692-a80d-6b913a391b83', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:17:55.465188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.465921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.466208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.493552 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Creating event network-changed:e7762d66-8887-45f8-8da3-b517f6778654 for instance c6fc6b01-f21f-416b-b181-0fbde2328d3c on n-h2-851028-12 Sep 14 09:17:55.494342 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] Creating event network-vif-deleted:603d9c60-7c63-4552-976e-f915cb3ccf5b for instance b12b89df-3c48-4741-945a-70141cadbcf2 on n-h2-851028-12 Sep 14 09:17:55.512399 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c4810946-29f3-4a57-bc9c-ad71e661a924 req-97ae6273-2614-41a9-b941-3186f56078a0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085865 Sep 14 09:17:55.513228 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 279/538] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:55.528957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:55.529682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:55.553118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.553118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.553575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.557194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:55.557746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:55.558201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:55.898592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.913393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.915641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:55.936047 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b85a4cf9-65a0-402d-b721-98cbb00f31d5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.417339 Sep 14 09:17:55.959454 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 280/539] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:55 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:55.971398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfd2b678-fc87-4aa8-bb77-1d57eb5ccbdc tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] Calling method '.version_select at 0x7f693fd2a310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.567575 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfd2b678-fc87-4aa8-bb77-1d57eb5ccbdc tempest-SecurityGroupsTestAdminJSON-1734555667 tempest-SecurityGroupsTestAdminJSON-1734555667-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/9717e7d6-3783-4547-9d00-f01b9465cb2b" status: 202 len: 0 microversion: 2.1 time: 0.601754 Sep 14 09:17:56.568288 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 281/540] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:17:55 2022] DELETE /compute/v2.1/os-security-groups/9717e7d6-3783-4547-9d00-f01b9465cb2b => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:17:56.576883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c8a319b-d90c-4d0c-b765-5a51e7a1605d tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.621651 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c8a319b-d90c-4d0c-b765-5a51e7a1605d tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.051487 Sep 14 09:17:56.627981 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 282/541] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Sep 14 09:17:56 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:56.647495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:56.648419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:56.669173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.669668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.676798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.677737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:56.678243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:56.678692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:56.990357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:17:56.991441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:17:56.992168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:17:56.992613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:17:56.993014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:17:57.010744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.011246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.011692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.012469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.013319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.014006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.055174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Getting quotas for project c9e67ca35d2247eb82228094d59c3023. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:17:57.064187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Getting quotas for user 6099c8cee6ea42d7ade1287430035b76 and project c9e67ca35d2247eb82228094d59c3023. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:17:57.098185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:17:57.102353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:17:57.154769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.189914 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d8a14cc-6b1d-4544-b6fa-3aeec8e18e42 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959832 Sep 14 09:17:57.191924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 260/542] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:17:57.201965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:57.203261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:57.213478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.215443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.215578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.216301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.217431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.218146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.218816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.231982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.240697 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18084c3c-63f2-43fe-b698-b5460eb0eb59 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 0.611231 Sep 14 09:17:57.241301 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 283/543] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:56 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:57.256562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:57.268915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:57.287954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.288804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.294826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.298337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.299127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.302699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.530303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.550529 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-013235ee-d5d0-4fd3-9312-62a949cab3f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1323 microversion: 2.1 time: 0.300007 Sep 14 09:17:57.557745 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 284/544] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1323 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:57.576492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2dcf14b-3e84-4687-9a9f-2eb21573ad52 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:57.611864 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2dcf14b-3e84-4687-9a9f-2eb21573ad52 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051484 Sep 14 09:17:57.613237 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 285/545] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:57.630948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:57.632167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:57.638841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.652165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.652772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.653543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:57.654010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:57.654446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:57.830920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.850138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39594a83-636a-4b74-a984-cd11e2ed44cd tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1477 microversion: 2.1 time: 0.656784 Sep 14 09:17:57.851083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 261/546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1477 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:57.856432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3909f40-6cd3-4102-b3b0-46f41b639afb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:57.863371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3909f40-6cd3-4102-b3b0-46f41b639afb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:57.917333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.930955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.942811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:57.965422 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb5abcd0-7d42-4d06-826c-f02def9ce5fc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.347043 Sep 14 09:17:57.966372 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 286/547] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:57.980684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-325d26b9-0803-41f8-9b52-7b8727ae0a1e tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.068067 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-325d26b9-0803-41f8-9b52-7b8727ae0a1e tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.100304 Sep 14 09:17:58.080293 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 287/548] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:58.092626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae399563-060d-46d9-b6a6-12cc812c41f7 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.130197 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae399563-060d-46d9-b6a6-12cc812c41f7 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.048711 Sep 14 09:17:58.138645 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 288/549] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:17:58.178209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6545e1a9-00a4-4775-840a-3417644226b4 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.193959 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6545e1a9-00a4-4775-840a-3417644226b4 tempest-FlavorsV2TestJSON-666473241 tempest-FlavorsV2TestJSON-666473241-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039499 Sep 14 09:17:58.194554 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 289/550] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:17:58.270295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.270967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:58.283439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.283958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.294571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.299644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.304867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.305693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.572483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3909f40-6cd3-4102-b3b0-46f41b639afb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:58.582808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3909f40-6cd3-4102-b3b0-46f41b639afb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1224 microversion: 2.1 time: 0.730287 Sep 14 09:17:58.584033 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 262/551] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:57 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1224 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:58.601331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "913eff35-bbfe-4b66-ae71-dbc288038c7f", "name": "network-vif-deleted", "tag": "db2a2562-b619-4836-aaee-379b0ebbd3f0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:17:58.623392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.624163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.624775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.649832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] Creating event network-vif-deleted:db2a2562-b619-4836-aaee-379b0ebbd3f0 for instance 913eff35-bbfe-4b66-ae71-dbc288038c7f on n-h1-851028-12 Sep 14 09:17:58.663227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-912b162e-34e2-4650-a40a-73cc43b52b25 req-a11ac1f5-a235-4f86-b07e-19cc0719d56e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072536 Sep 14 09:17:58.672468 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 263/552] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:17:58.685525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:58.687919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:58.718481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.718994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.724508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:58.725410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:58.725884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:58.726324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:59.427362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:59.447403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:59.449949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:59.459811 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1aa092dc-f5e8-4204-ad5a-d3f68518415a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 1.192753 Sep 14 09:17:59.476386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 290/553] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:17:59.489084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:59.490011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:59.501330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.501888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.502323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:59.503048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.503497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.504002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:59.591380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.593521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.594257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:17:59.596439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lazy-loading 'fault' on Instance uuid 913eff35-bbfe-4b66-ae71-dbc288038c7f {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:17:59.891007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb15ea3eacc54f439db99d1413ff2d70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f7c8c34482c413795cf068d9dc47820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:17:59.914982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9420837c-51d1-4301-a173-246258fe1ff9 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 200 len: 1312 microversion: 2.1 time: 0.436157 Sep 14 09:17:59.917771 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 291/554] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:59 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 1312 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:17:59.938648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:17:59.940192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:17:59.983390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:17:59.993061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:17:59.993752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.000921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.003920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.008001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.397552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.413747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.415713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.426995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d3a18ccb-44bf-48bb-96e3-fd6526c02544 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.507412 Sep 14 09:18:00.427619 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 292/555] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:17:59 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:00.438818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:00.444111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:00.458751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.461840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.463331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.466607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.467094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.467715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.493405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.519219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:00.542456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e26f9364-1f60-4a67-9e89-b3a12719a2a3 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 1.862767 Sep 14 09:18:00.546203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 264/556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:17:58 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:00.563229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:00.565066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:00.591794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.596870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.599787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.600614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.601155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.601541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.720125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:00.736690 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6bb705e0-488c-4941-ac12-9fdd01647dc7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1282 microversion: 2.1 time: 0.306563 Sep 14 09:18:00.739256 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 293/557] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:00 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1282 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:00.949230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:00.950035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] [instance: 913eff35-bbfe-4b66-ae71-dbc288038c7f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:00.961848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.963743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.964833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:00.966396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:00.967698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:00.968282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:01.020526 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] HTTP exception thrown: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Request method failure captured: Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f HTTP/1.1 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwF0tHbtu5af0slC8pwsJev0u6NHGQFskD-4spdvxv4siZdc0a8-Dau4qVOXlpS1x2fKC3PjdequCKk7uVbt09C280uwfPZGupuHF-lhFmSVPz5myleRM2jQhoBYxytMqTvTSxAliqoMTjEZi9Ab-ZsqNDXpLs7Xyx01BGvOL3JiTQ Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4f7c8c34482c413795cf068d9dc47820 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:18:01.023848 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4f7c8c34482c413795cf068d9dc47820", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f7c8c34482c413795cf068d9dc47820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4f7c8c34482c413795cf068d9dc47820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4f7c8c34482c413795cf068d9dc47820"}]}] Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4f7c8c34482c413795cf068d9dc47820 Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-752717229 Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-752717229-project Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: eb15ea3eacc54f439db99d1413ff2d70 Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-752717229-project Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. Sep 14 09:18:01.025724 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '913eff35-bbfe-4b66-ae71-dbc288038c7f'} Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:01.026480 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. Sep 14 09:18:01.027762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:01.028959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] Returning 404 to user: Instance 913eff35-bbfe-4b66-ae71-dbc288038c7f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:01.029726 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8e397087-bcdf-490c-8a16-81069e8eb8a6 tempest-ServersAdminNegativeTestJSON-752717229 tempest-ServersAdminNegativeTestJSON-752717229-project] 10.222.0.90 "GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f" status: 404 len: 111 microversion: 2.1 time: 0.083967 Sep 14 09:18:01.030778 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 294/558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:00 2022] GET /compute/v2.1/servers/913eff35-bbfe-4b66-ae71-dbc288038c7f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:18:01.463067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:01.464947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:01.488987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:01.490432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:01.492185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:01.496089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:01.497684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:01.498180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.101211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.110790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.119793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.121949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.128084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.133668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:02.136718 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da2b63f2-0465-4d01-b62c-f3f1e9cd6791 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.679932 Sep 14 09:18:02.137277 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b735c2ed-0c61-4285-8bd4-b35657bb3477 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 1.589607 Sep 14 09:18:02.156250 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 295/559] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:01 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:02.163919 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 265/560] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:00 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:02.181137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.182165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.202188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:02.204822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:02.212840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:02.216263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.218378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.219037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.220944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.226058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.226716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.239789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.240355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.240787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.241508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:02.241958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:02.242374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:02.310246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:03.357770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.377993 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94f4b10b-61bb-4656-9ec5-4d57fbd87d76 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 1.220129 Sep 14 09:18:03.381405 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 296/561] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:02 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:03.494684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.506222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-105ef129-c75c-4127-9f50-b48984aa7768 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1324 microversion: 2.1 time: 1.338332 Sep 14 09:18:03.517289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 266/562] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:02 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1324 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:03.523734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:03.526952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:03.541531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.543214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.543850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:03.549602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.550828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.556078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:03.697131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.727367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.728998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:03.734666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-127303e6-233d-4197-8c6e-099eff8aa453 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.223377 Sep 14 09:18:03.736860 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 267/563] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:03 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:03.742288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:03.743183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:03.751518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.752569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.753271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:03.754307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:03.754991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:03.755659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:03.991927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eede125f-de84-45bb-9627-6acb6b3c711a tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:04.007509 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eede125f-de84-45bb-9627-6acb6b3c711a tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.623675 Sep 14 09:18:04.009179 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 297/564] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:18:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:04.016227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:04.035766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:04.041612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.043192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.043871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.068569 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] Creating event network-changed:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:18:04.075983 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-6d5111df-103b-4348-95d9-b66b97836fe6 req-47efc864-13e4-4c07-8aa6-03089df66d7e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063972 Sep 14 09:18:04.077036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 298/565] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:04.364966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:04.377418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:04.385839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:04.387362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c031682-8da4-4f2f-bf79-5fb681c52e05 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1567 microversion: 2.25 time: 0.649245 Sep 14 09:18:04.388155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 268/566] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:03 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1567 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:04.409985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:04.421318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:04.444086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.444887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.445553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.447702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.448790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.449489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.536283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:04.537495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:04.566182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.566796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.569547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:04.570365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:04.573208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:04.575391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:05.394553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:05.404485 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-569bcded-7e35-40d8-89ec-2148686ebf7b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 1.001003 Sep 14 09:18:05.405071 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 299/567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:04 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:05.410185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db70afe2-8bc3-4daa-b118-de8ddc4fd012", "tag": "a72fabda-6f3e-4a11-8631-d472fe5d8721"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:05.422109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:05.423165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:05.423936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:05.439999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] Creating event network-changed:a72fabda-6f3e-4a11-8631-d472fe5d8721 for instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 on n-h2-851028-12 Sep 14 09:18:05.448321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:05.452526 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3705c793-282c-415b-b43d-ba8502ea7666 req-394cb17b-45f3-4fa6-a3cc-799d7b02d44e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045615 Sep 14 09:18:05.453952 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 300/568] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:05.461268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:05.461966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:05.463726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-07c335a0-4fa6-441f-a210-e4841e0606a2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1324 microversion: 2.1 time: 0.934285 Sep 14 09:18:05.465325 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 269/569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:04 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1324 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:05.479956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:05.480807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:05.481302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:05.482191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:05.482784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:05.483267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:05.868789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:05.884307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1310433143", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:05.896224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:05.897955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:05.919737 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e616320f-8593-4db1-99ba-5a5b5c2d8c7f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.463490 Sep 14 09:18:05.920610 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 301/570] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:05 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:05.941897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-896903848", "imageRef": "3376c9e8-7657-4218-9f4d-d14e43f28184", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:06.017619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:06.018008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:06.018481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:06.018888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:06.027607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:06.060198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:06.071419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:06.074532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:06.074961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:06.079525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:06.081468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:06.082274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:06.122674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Getting quotas for project c5cb6bc7674349ee8ed58c9cec371251. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:06.129668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Getting quotas for user 4f8c0aef81f34ce4be9295b5a18ba11b and project c5cb6bc7674349ee8ed58c9cec371251. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:06.146081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:06.148946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:06.219781 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5949686f-84a4-464d-8627-b8a4e9876802 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.752594 Sep 14 09:18:06.220871 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 270/571] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:18:06.227265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:06.227936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:06.237177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:06.237836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:06.238431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:06.239185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:06.239651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:06.240154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:06.810831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.826740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.831501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.835540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ad0a6662-3930-45c9-a1b5-01d03ae1857b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1542 microversion: 2.25 time: 0.612998 Sep 14 09:18:06.836540 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 271/572] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:06 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1542 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:06.845549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:06.848890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:06.861815 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] Request method failure captured: Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 142 Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxKUDORb3ku8tlPfUoTAMo_6pRuJ388AA3saaIBFleg5BRTR-AwO3663cDNG0wFp65vTec2vJwGyuE6m2_CtIJIEAvDKdJ13chMCkYIU2Xg7wnggQjJ9hJ4R1N0mxS-EnHG428jMraY961TITJvISTb3bUYK_jCaNm7iTJN1_age0Q Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7558b655b0784b0aa50cf8181b29592a Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsV2NegativeTest-252760915 Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:18:06.865415 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7558b655b0784b0aa50cf8181b29592a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7558b655b0784b0aa50cf8181b29592a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7558b655b0784b0aa50cf8181b29592a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7558b655b0784b0aa50cf8181b29592a"}]}] Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsV2NegativeTest-252760915 Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7558b655b0784b0aa50cf8181b29592a Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-252760915 Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsV2NegativeTest-252760915-project Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6ac28f8279a04eb7b6c0ed2590fe3f4f Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsV2NegativeTest-252760915-project Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-896903848", "imageRef": "3376c9e8-7657-4218-9f4d-d14e43f28184", "flavorRef": "452"}} Sep 14 09:18:06.866959 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: exception: Flavor's memory is too small for requested image. Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-896903848', 'imageRef': '3376c9e8-7657-4218-9f4d-d14e43f28184', 'flavorRef': '452'}}} Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:06.867868 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:06.869248 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 14 09:18:06.870619 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:06.872134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:06.873172 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b3bc4bd-e79f-4827-92ff-08917e9559f8 tempest-FlavorsV2NegativeTest-252760915 tempest-FlavorsV2NegativeTest-252760915-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.951369 Sep 14 09:18:06.874315 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 302/573] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:05 2022] POST /compute/v2.1/servers => generated 93 bytes in 953 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:18:06.979242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.990147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:06.992874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.002407 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-235f4495-b849-4e51-852c-89a7157a0d31 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "PUT /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1359 microversion: 2.75 time: 0.164008 Sep 14 09:18:07.003718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 272/574] 10.222.0.90 () {62 vars in 1297 bytes} [Wed Sep 14 09:18:06 2022] PUT /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:07.009946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.012559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.022626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.023244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.024148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.025248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.026449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.027553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.053833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-034679ae-6336-4221-8c34-e1829e21ac60 tempest-ListImageFiltersNegativeTestJSON-1217643652 tempest-ListImageFiltersNegativeTestJSON-1217643652-project] Calling method '.version_select at 0x7f693fb3b790>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.084138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-034679ae-6336-4221-8c34-e1829e21ac60 tempest-ListImageFiltersNegativeTestJSON-1217643652 tempest-ListImageFiltersNegativeTestJSON-1217643652-project] HTTP exception thrown: Image not found. Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-034679ae-6336-4221-8c34-e1829e21ac60 tempest-ListImageFiltersNegativeTestJSON-1217643652 tempest-ListImageFiltersNegativeTestJSON-1217643652-project] Request method failure captured: Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/images/7478887e-b0a8-44fa-9a5f-1eb2953234e4 HTTP/1.1 Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxOCZlUv3S8vn3vff4vgC0xnvQDJevxxiULyuucbGK9Wg_ZCH-gzul6DtWXxP7cFJ2fbxv9gQVnG2WfcRupeooityThoy9MVyPTI4YErPgawbd3JBuyxhTaG47dALlO_VCZOxBVSXMVZ-ohzv42TivyaaNLVW7g5ghKhJxFUc8-mRg Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8ec3530bdc124e638a13b8ad946f37fc Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1217643652 Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:18:07.093504 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8ec3530bdc124e638a13b8ad946f37fc", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8ec3530bdc124e638a13b8ad946f37fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8ec3530bdc124e638a13b8ad946f37fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8ec3530bdc124e638a13b8ad946f37fc"}]}] Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1217643652 Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8ec3530bdc124e638a13b8ad946f37fc Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1217643652 Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ListImageFiltersNegativeTestJSON-1217643652-project Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d81eab11b4d64c3382fdeb3bc82b82d5 Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1217643652-project Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: exception: Image not found. Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '7478887e-b0a8-44fa-9a5f-1eb2953234e4'} Sep 14 09:18:07.095938 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:18:07.096923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7478887e-b0a8-44fa-9a5f-1eb2953234e4 Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:18:07.098326 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7478887e-b0a8-44fa-9a5f-1eb2953234e4 could not be found. Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:07.103689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:07.105059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-034679ae-6336-4221-8c34-e1829e21ac60 tempest-ListImageFiltersNegativeTestJSON-1217643652 tempest-ListImageFiltersNegativeTestJSON-1217643652-project] Returning 404 to user: Image not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:07.106188 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-034679ae-6336-4221-8c34-e1829e21ac60 tempest-ListImageFiltersNegativeTestJSON-1217643652 tempest-ListImageFiltersNegativeTestJSON-1217643652-project] 10.222.0.90 "GET /compute/v2.1/images/7478887e-b0a8-44fa-9a5f-1eb2953234e4" status: 404 len: 62 microversion: 2.1 time: 0.218951 Sep 14 09:18:07.106188 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 303/575] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:18:06 2022] GET /compute/v2.1/images/7478887e-b0a8-44fa-9a5f-1eb2953234e4 => generated 62 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:07.109895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.110934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.123124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.123924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.124543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.127276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.128164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.128931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.412136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.430128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-084bc7d0-e250-43a8-a5da-e69c4f5ed80d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 0.422663 Sep 14 09:18:07.431968 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 273/576] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:07.444734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-622496f6-0c4d-41fd-93ac-f0f28564096d tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '.version_select at 0x7f693fe28820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.457238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-622496f6-0c4d-41fd-93ac-f0f28564096d tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.458140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-622496f6-0c4d-41fd-93ac-f0f28564096d tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.458887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-622496f6-0c4d-41fd-93ac-f0f28564096d tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.475013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-622496f6-0c4d-41fd-93ac-f0f28564096d tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 864 microversion: 2.25 time: 0.040921 Sep 14 09:18:07.480584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 274/577] 10.222.0.90 () {60 vars in 1184 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/os-migrations => generated 864 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:18:07.495857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.499089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.529473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.554981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.555573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.558689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.562732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.564315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.634165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.655233 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a1511be-6697-4853-9f34-180f6abd6a8a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1324 microversion: 2.1 time: 0.554121 Sep 14 09:18:07.658767 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 304/578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:07.677780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.678898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.701300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.704213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.706248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.708183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.708787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.709260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.837450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.875610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.889244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:07.924903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f331236-3db1-47c4-a22a-d5bf8c0e3a35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1556 microversion: 2.91 time: 0.442518 Sep 14 09:18:07.934805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 275/579] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1556 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:07.950418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:07.951135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:07.990190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.993880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:07.994353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:07.995106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:07.995574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.003942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:08.151605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:08.169639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:08.192520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:08.214101 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-75d3169c-b28e-4212-99cd-62d78747a92e tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1355 microversion: 2.75 time: 0.554070 Sep 14 09:18:08.223532 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 305/580] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1355 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:08.250000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "name": "network-vif-plugged", "status": "completed", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:08.281887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:08.285585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.286455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:08.317900 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] Creating event network-vif-plugged:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:18:08.332386 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-bb99071d-59ef-46b1-90aa-85f712324dc3 req-5e1b81c4-4867-488f-a737-3f3494740ea6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107091 Sep 14 09:18:08.333686 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 306/581] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:08.356088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:08.405497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-63b9b4af-a31c-4ef2-a2d4-b308e5a11842 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 2036 microversion: 2.25 time: 0.464822 Sep 14 09:18:08.406360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 276/582] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:07 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 2036 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:08.447699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56ccd2d3-8291-404c-a01a-2386aff15b68 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: .version_select at 0x7f693fc359d0>, body: {"keypair": {"name": "tempest-keypair-928735375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKETPn7a9qczHJz9dkFdLT7V5JBrNRuMpbpK8b3UxfEDE3UGbGffPzPDu0+evFM+O0qOXZpc4WfEDbfLKABO7OhXRJvoNI/BA7vCqeYOaIf+TEIKYOEiUtpUgwi/QMKXjA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:08.457120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:08.458028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:08.475035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:08.479964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:08.480654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.481095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:08.481816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:08.493856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.498159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:08.538231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-56ccd2d3-8291-404c-a01a-2386aff15b68 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for project 639c54e3be9d48d983b7e6e83436d107. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:08.555130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-56ccd2d3-8291-404c-a01a-2386aff15b68 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for user c92c2abda1124946b2adcb0b0560fd0c and project 639c54e3be9d48d983b7e6e83436d107. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:08.561578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:08.640119 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56ccd2d3-8291-404c-a01a-2386aff15b68 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.198665 Sep 14 09:18:08.641065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 307/583] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:18:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:18:08.686251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:08.687187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:08.707329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:08.708462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.709095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:08.710322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:08.711071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:08.711663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.171235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.185158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.193827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-912da1da-c995-4c5e-9fc7-87f2c8f8b874 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 0.739803 Sep 14 09:18:09.195383 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 277/584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:08 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:09.200577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:09.201656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:09.212086 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-59a95f79-7df3-4b2f-8f94-0eb28583cb63 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1324 microversion: 2.1 time: 0.529116 Sep 14 09:18:09.215069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.215743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.216365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.217226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.217816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.218441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.220905 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 308/585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:08 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1324 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:09.255953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:09.256955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:09.266462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.268238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.269128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.270317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:09.271791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:09.272500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:09.383252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.401458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.403280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.410964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f541508-33ac-482e-9525-d8518e86b045 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.214351 Sep 14 09:18:09.412499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 278/586] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:09 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:09.570662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.583032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.584923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:09.595521 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3f2e6e3-74a6-4845-bdda-4f20db73d330 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1417 microversion: 2.75 time: 0.342920 Sep 14 09:18:09.618772 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 309/587] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:09 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1417 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:10.224533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:10.226291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.241767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:10.244136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.270974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.272990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.277492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.277736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.279705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.280739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.281341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.281753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.283005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.284024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.284492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.284912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.721950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:10.735100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d58d4c6c-d20d-4192-abe8-d01b0262d598 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 0.516253 Sep 14 09:18:10.756457 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 279/588] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:10 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:10.779161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:10.779842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:10.799467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.802290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.805823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:10.806948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:10.808755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:10.810231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.201454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.218975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.231360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.248223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bf12f5b-5312-4c6b-b704-2a11e5a341ee tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.489704 Sep 14 09:18:11.268107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.268577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 280/589] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:10 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:11.285781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:11.289962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:11.295436 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-000e837e-c42c-4f9e-963e-9ad725f97e94 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1520 microversion: 2.1 time: 1.062175 Sep 14 09:18:11.300302 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 310/590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:10 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1520 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:11.334900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c75d4eb8-0baa-4cd6-a4ac-3856e72f20e8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'create', calling method: .version_select at 0x7f693fb86ee0>, body: {"pool": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:11.341071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.341582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.342016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.348598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:11.349988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:11.352642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:11.846377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.862117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.864031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:11.877939 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e320d122-08e8-409f-aadb-5c68d301f75f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1438 microversion: 2.75 time: 0.610456 Sep 14 09:18:11.879390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 281/591] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:11 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1438 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:12.276111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6c59e1c-1fb9-4057-a734-f40c181b2d55 tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] Calling method '.version_select at 0x7f6944131670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:12.391047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6c59e1c-1fb9-4057-a734-f40c181b2d55 tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] 10.222.0.90 "GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55" status: 200 len: 784 microversion: 2.1 time: 0.509989 Sep 14 09:18:12.392214 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 282/592] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:18:11 2022] GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55 => generated 784 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:12.405272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:12.406084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:12.422771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:12.423432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:12.425504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:12.426385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:12.430180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:12.430732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:12.981900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:12.993863 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5c14cf7-ec98-40ba-aa03-4c8a97cc12c2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 0.600562 Sep 14 09:18:12.994460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 283/593] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:12 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:13.006156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:13.013275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:13.027933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.029330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.030374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.035708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.036591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.037259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.266743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:13.269059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:13.271389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:13.272164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:13.273039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:13.388985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:13.402973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.407145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.408024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.409177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.409652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.410095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.636297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:13.651413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:13.661197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:13.668742 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b221f48b-e333-488c-b1bc-a56d19056071 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "POST /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6/action" status: 202 len: 1495 microversion: 2.75 time: 0.672652 Sep 14 09:18:13.672085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 284/594] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:18:12 2022] POST /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6/action => generated 1495 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:18:13.694302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:13.697748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:13.729833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.740527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.742320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:13.744865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:13.745674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:13.748391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:14.042337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:14.056673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:14.060869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:14.072484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53618f38-dd27-44e7-a1d0-f0f473f1d90b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.398353 Sep 14 09:18:14.077668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 285/595] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:13 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:14.087806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-295d5a7d-386e-4407-8486-1259b6762cba tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] Calling method '.version_select at 0x7f693fd91310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:14.208261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-295d5a7d-386e-4407-8486-1259b6762cba tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] 10.222.0.90 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.129123 Sep 14 09:18:14.208869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 286/596] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Sep 14 09:18:14 2022] GET /compute/v2.1/images => generated 445 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:14.223021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2041004172", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b41e49db-121e-4bc1-879b-5eb8e9fa3036"}], "security_groups": [{"name": "tempest-securitygroup--146386695"}], "key_name": "tempest-keypair-928735375", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:14.428337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] validate_networks() for [('b41e49db-121e-4bc1-879b-5eb8e9fa3036', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:15.328059 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c75d4eb8-0baa-4cd6-a4ac-3856e72f20e8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.998043 Sep 14 09:18:15.329387 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 311/597] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:18:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:18:15.335263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db70afe2-8bc3-4daa-b118-de8ddc4fd012", "name": "network-vif-plugged", "status": "completed", "tag": "a72fabda-6f3e-4a11-8631-d472fe5d8721"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:15.363827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.364448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.366884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.397387 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] Creating event network-vif-plugged:a72fabda-6f3e-4a11-8631-d472fe5d8721 for instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 on n-h2-851028-12 Sep 14 09:18:15.410263 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4b64b1f6-048d-4e0f-be60-5ae314ee82d7 req-9b9e0a70-0b09-4595-8cc1-4d882eefba9d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078847 Sep 14 09:18:15.412982 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 312/598] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:15.430223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.434971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.455916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.461781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.467231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.468612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.470798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.474938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.596183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:15.597453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:15.598117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:15.598691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:15.599283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:15.621706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.622468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.624108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.625155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.626378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.627034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.680633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:15.685574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for user c92c2abda1124946b2adcb0b0560fd0c and project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:15.690398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:15.707850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:15.710396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:15.724825 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6935d63-b843-456a-b5af-4bf9cbfd8d8a tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.308298 Sep 14 09:18:15.725444 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 313/599] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:15.728834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:15.732386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:15.749923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.751417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.758876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.760198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.760845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.761752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.762373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.763705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.849473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66fdac19-04bd-4e38-a16b-93b1a94984f3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.632587 Sep 14 09:18:15.852324 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 287/600] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:18:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:18:15.864337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33adbe6d-c673-48a7-9e60-5e20265d7d40 tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] Calling method '.version_select at 0x7f693fd450d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.943926 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33adbe6d-c673-48a7-9e60-5e20265d7d40 tempest-ListImagesTestJSON-1932132476 tempest-ListImagesTestJSON-1932132476-project] 10.222.0.90 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.084387 Sep 14 09:18:15.945004 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 288/601] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:15.959134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:15.960147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:15.967834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.969062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.970373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:15.971441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:15.972130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:15.973056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.167240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.181583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.185550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.219154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.226871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42d52f71-14c7-4b8b-b9d7-867757ec7d60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.280468 Sep 14 09:18:16.249846 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 289/602] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:16.255231 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1a6dd28e-c050-48dd-8dae-3d6d8e43fbc2 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1390 microversion: 2.1 time: 0.527891 Sep 14 09:18:16.269410 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 314/603] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:15 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1390 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:16.281048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-704645351", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "96e7261f-bc7b-4692-a80d-6b913a391b83"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:16.282775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:16.283163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:16.374110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] validate_networks() for [('96e7261f-bc7b-4692-a80d-6b913a391b83', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:16.417363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.432673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.434414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:16.435788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a4cedc3-3a5d-4989-aa1c-07953e2d67c2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1285 microversion: 2.25 time: 0.165301 Sep 14 09:18:16.439099 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 315/604] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:16 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:16.755754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:16.756439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:16.773408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.781670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.782853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:16.783963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:16.784483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:16.784925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.023954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.040555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.042120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.059302 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c138c0f8-46b4-4aaf-9df6-4e9a817f57dd tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.307924 Sep 14 09:18:17.072902 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 316/605] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:16 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:17.265863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:17.267104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.281540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.290308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.297162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.300153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.301990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.307880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.585234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.598290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.599730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:17.613793 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7af30a0d-b896-4f65-9276-9144f6e6a9d0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.352389 Sep 14 09:18:17.614572 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 317/606] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:17 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:17.620224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:17.621092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.630146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.630869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.631488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.633047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.633649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.634231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.685775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:17.686905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:17.687448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:17.687877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:17.690358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:17.732861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.736606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.737328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.749045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.750871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.752080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.833026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Getting quotas for project c9e67ca35d2247eb82228094d59c3023. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:17.840947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Getting quotas for user 6099c8cee6ea42d7ade1287430035b76 and project c9e67ca35d2247eb82228094d59c3023. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:17.872035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:17.875210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:17.963889 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd678f4b-7afb-416d-992e-83dad9bc7093 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710410 Sep 14 09:18:17.968516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 290/607] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:18:17.974839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:17.977299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:17.989996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.992314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.993133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:17.994730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:17.996161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:17.997316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.025042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.046776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-806a0d65-cc1b-4ab3-9155-c5979a87f545 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1589 microversion: 2.1 time: 0.428428 Sep 14 09:18:18.049188 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 318/608] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:17 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1589 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:18.060918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ecaca9e7-fe27-4703-9851-fdf2460057b4 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:18.061974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ecaca9e7-fe27-4703-9851-fdf2460057b4 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:18.427139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecaca9e7-fe27-4703-9851-fdf2460057b4 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.442776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ecaca9e7-fe27-4703-9851-fdf2460057b4 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1223 microversion: 2.1 time: 0.391639 Sep 14 09:18:18.444617 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 319/609] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:18 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1223 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:18.471787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.486790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:18.489268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:18.500583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.509269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.520305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4904a032-cb31-4a13-b2ac-36c08ec03cac tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1345 microversion: 2.25 time: 0.545454 Sep 14 09:18:18.524075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 291/610] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:17 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1345 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:18.526954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.528808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.530370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.531384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.532825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.536661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.541113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:18.545220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:18.564155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.567328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.571285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.574204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.576253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.577564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.599052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:18.869349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.886005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.892424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:18.913980 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1bb6466-65c4-4d8e-a973-a46ee378db2b tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.385916 Sep 14 09:18:18.916126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 292/611] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:18 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:18.933722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:18.934500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:18.947050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.951706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.952709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:18.953474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:18.954037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:18.960308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.166591 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e765cbe1-5e89-4d06-b89b-839fba6dbeb8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.720817 Sep 14 09:18:19.176212 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 320/612] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:18:18 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012/os-interface => generated 284 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:19.241235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.253411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.256641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.271752 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abf43b69-73f2-4100-b5cb-50e424be8107 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.352421 Sep 14 09:18:19.278089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 293/613] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:18 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:19.481481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:19.494759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:19.517991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.518831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.521356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.522296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.523081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.523860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.564518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:19.565239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:19.580589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.581415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.583426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.586551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.587956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.588665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.680725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.691534 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-190a6e47-1e99-455b-b76c-8c2782976cd7 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1275 microversion: 2.1 time: 0.216276 Sep 14 09:18:19.701143 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 321/614] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:19 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1275 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:19.717566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.731551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.742621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:19.746986 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-521909dd-bd2e-4a8e-bcb4-fe05d08147a8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1343 microversion: 2.25 time: 0.185703 Sep 14 09:18:19.747624 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 294/615] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:19 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1343 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:19.950431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:19.951333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:19.973626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.974112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.977193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:19.978208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:19.978923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:19.979505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.112338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.132209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.133749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.147842 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d404783a-5468-4afc-9954-9f562db6759c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.201232 Sep 14 09:18:20.149969 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 322/616] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:19 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:20.313973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:20.316026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:20.339163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.341117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.341832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.344768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.345872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.346897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.730617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:20.732003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:20.742210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.746477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.747462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.749150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.750651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.752553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.762065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.775442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.791460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:20.806001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e1d4332-22a1-4791-b87a-931d5bff41ec tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.492434 Sep 14 09:18:20.806894 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 295/617] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:20 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:20.814749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:20.827629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:20.854317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.856913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.857640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.858626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:20.871918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:20.873230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:20.882406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:21.113516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.133205 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02612cef-3868-4706-8112-4b2490b067e3 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1281 microversion: 2.1 time: 0.406436 Sep 14 09:18:21.134564 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 323/618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:20 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:21.184303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:21.185331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:21.206511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.209414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.210757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.214252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.217864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.220156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.639032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.652626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.654547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.669151 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f42a430-b929-4a0a-b53d-f26dc4dde548 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.488967 Sep 14 09:18:21.671167 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 324/619] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:21 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:21.743062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.756775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.758335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:21.759935 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22ee5c46-bf84-4883-9cfd-7947ace532de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 0.950546 Sep 14 09:18:21.769400 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 296/620] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:20 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:21.859396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:21.861000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:21.869613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.870690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.871353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:21.872663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:21.873344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:21.873988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.151836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.167176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.169290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.184487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:22.185190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:22.198315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbb79039-4d85-46e0-ab7d-21196941b55b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.344542 Sep 14 09:18:22.199611 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 325/621] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:21 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:22.216336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.216933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.217500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.218660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.219404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.240996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.573868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:22.590650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9cd742a8-8528-48f3-af88-505e5981ed6a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1281 microversion: 2.1 time: 0.429953 Sep 14 09:18:22.604701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 297/622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:22 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1281 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:22.713486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:22.714430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:22.737401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.738028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.738518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.740732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.741271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.743602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.798645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:22.800200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:22.807608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.814364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.818933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:22.824491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:22.826484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:22.830932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.543167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.565497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.572808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.598009 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b65a2d76-2bb4-4adf-9ba4-0d5ec4733c16 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.888568 Sep 14 09:18:23.622023 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 326/623] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:22 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:23.634777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.640781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.656475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.658632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.659093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.663734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.664612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.666630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.885969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.898885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.908723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:23.910103 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3427c532-0509-4f68-9aac-572783ee8972 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 1.116078 Sep 14 09:18:23.911843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 298/624] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:22 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:23.932939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:23.935118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:23.953083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.953627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.954182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:23.959808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:23.960331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:23.960777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.028678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:24.041922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:24.045387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:24.067616 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44a6a2cf-5ee1-4cc7-9861-8292ba739346 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.443197 Sep 14 09:18:24.068246 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 327/625] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:24.080137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db70afe2-8bc3-4daa-b118-de8ddc4fd012", "tag": "a72fabda-6f3e-4a11-8631-d472fe5d8721"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:24.105836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.106321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.106756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.134640 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] Creating event network-changed:a72fabda-6f3e-4a11-8631-d472fe5d8721 for instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 on n-h2-851028-12 Sep 14 09:18:24.145667 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e1a5d494-7106-43f8-a56a-53f18c9aefb3 req-194e62f8-1980-4a19-aed7-fc4b4daa36f7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075988 Sep 14 09:18:24.150386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 328/626] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:24.184175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:24.186956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:24.208603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.209143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.209522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:24.211120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:24.212322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:24.212764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.216018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.224894 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c87212de-e12e-4343-bc5b-ad9ea46e2661 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.073189 Sep 14 09:18:25.225487 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 329/627] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:24 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:25.245918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.246758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.277557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.278485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.278735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.283114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.287132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.288931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.308082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.321343 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81c6dba6-a5ec-4027-b3dc-da6c63c862db tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 200 len: 1589 microversion: 2.1 time: 1.395840 Sep 14 09:18:25.352025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 299/628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:23 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 1589 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:25.373239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.373852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.395497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.396271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.397030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.398966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.399674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.400313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.583135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.601386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.602832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.609021 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9cf10a5c-f479-4bad-b3d4-907d31953785 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.382495 Sep 14 09:18:25.609611 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 330/629] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:25.631886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:25.632797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:25.638631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:25.640476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.641262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.642522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.645551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.646239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.646862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.896842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.913288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.914728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:25.920203 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-59e3c0a5-8300-4f70-a81d-f731e340abbc tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.304750 Sep 14 09:18:25.929047 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 331/630] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:25.934559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:25.965949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:25.966467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:25.966899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:25.984919 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] Creating event network-changed:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h1-851028-12 Sep 14 09:18:26.003359 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-52af1832-181a-4506-b794-5f5de323a6cc req-38eb4ad1-f1f4-4622-a579-19e4f7c9987e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072168 Sep 14 09:18:26.005164 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 332/631] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:26.192763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:26.211914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:26.220479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:26.229145 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee38f252-322d-4fc7-9437-d541021dcb91 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 0.867188 Sep 14 09:18:26.233550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 300/632] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:25 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:26.256028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.257584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:26.277983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.279365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.280004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.281508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.282691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.283430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.658294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:26.659722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:26.686641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.691532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.697685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:26.707808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:26.708902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:26.714632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.046357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.061312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.066804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.083274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ffcf6e8-3f60-4504-87d4-0c7731ee22ef tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.435407 Sep 14 09:18:27.097406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 301/633] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:27.116519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:27.117859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:27.137172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.142412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.146288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.147295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.149046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.149710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.581971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.606903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.616229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.627090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:27.634744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b0af67a-da81-4fc5-9c8e-4e7bd186df1b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.527792 Sep 14 09:18:27.636076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 302/634] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:27 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:27.658718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:27.660056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:27.676364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.677380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.678247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.683882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:27.684700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:27.685150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:27.813232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:27.827511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:27.846725 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0c2848a-5fbc-42a9-9d26-77161806c61e tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.595826 Sep 14 09:18:27.849872 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 333/635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:26 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:27.863838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=30 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:28.116388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.116805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.134330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.134832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.135417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.136168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.136628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.137064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.431701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:28.482394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.505596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.516534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.536315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0dca05c1-7055-4589-9145-11adff569e69 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.423584 Sep 14 09:18:28.554101 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 334/636] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:28.685370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.685952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.713417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.718347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.719184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.723432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.730326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.731442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.836965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.854451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.859323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:28.865887 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e9e9494-e391-4f3e-84da-cf4a2464172c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 1.225317 Sep 14 09:18:28.868234 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 303/637] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:27 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:28.894758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:28.895939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:28.920752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.923635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.926172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:28.927162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:28.930749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:28.931412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.145772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.158627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.160604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.167336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1822f914-1c7f-46a1-ad75-1a125454023b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.489800 Sep 14 09:18:29.186323 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 335/638] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:29.570410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:29.571104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:29.584974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.587945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.591589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.593287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:29.596644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:29.597224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:29.943436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.989472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:29.998411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.011237 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1ee52f60-d24e-4866-806f-a94583d9a38c tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.444634 Sep 14 09:18:30.048548 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 336/639] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:29 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:30.062909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.068212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:30.076940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.083068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.083576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.084049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.086223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.087843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.089896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.094860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4ecd1ca-2c5b-4bd8-9260-d7ebd2c98646 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.222719 Sep 14 09:18:30.095923 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 304/640] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:28 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:30.201024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:30.202099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:30.213548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.217657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.218509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.219512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:30.221367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:30.224225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:30.448042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.463839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.465383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:30.514783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27b8f17c-73fb-483c-9a6b-af3d1a985456 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.317925 Sep 14 09:18:30.525521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 305/641] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:30 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:31.002503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.018540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.021878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.025116 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3c47f83-6dcd-469d-a01a-06914a88feba tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 0.975487 Sep 14 09:18:31.028494 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 337/642] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:30 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:31.052095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:31.052708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:31.066455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.067071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.067622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.068397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.068830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.069260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.124667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:31.125729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:31.151108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.151855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.152544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.155213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.155870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.158239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.380369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.389374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.390955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.402148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94446aae-baf1-4000-85d5-95816f930920 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.353549 Sep 14 09:18:31.403505 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 306/643] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:31 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:31.548605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:31.549951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:31.559492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.560379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.561034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.562010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:31.562672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:31.563999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:31.803171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.821129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.822590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:31.835327 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fbf2515-a57b-4dd7-9d3b-1de7a070035f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.291391 Sep 14 09:18:31.865513 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 307/644] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:31 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:32.014646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33852f-0a4c-44c9-96ba-9a94fcd19bd2", "tag": "efded278-36be-496d-bec0-732ffc5156c3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:32.034759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.035351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.035980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.062647 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] Creating event network-changed:efded278-36be-496d-bec0-732ffc5156c3 for instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 on n-h2-851028-12 Sep 14 09:18:32.076033 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-32e40bac-d121-45dc-8387-536ce43adc9c req-22d9971b-1d10-4a64-b601-78db284f54bb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066069 Sep 14 09:18:32.079336 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 308/645] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:32.112485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.113247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:32.121474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:32.129240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:32.134193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.135440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47c6142d-aaad-4d95-b449-976e9a9b64c0 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.014404 Sep 14 09:18:32.136464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.136918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.137649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.138097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.138559 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 338/646] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:31 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:32.140783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.377207 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb9650e3-1056-437b-871e-0a8a5ce79869 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-13T09%3A18%3A32.108085&end=2022-09-15T09%3A18%3A32.108085" status: 404 len: 112 microversion: - time: 0.235429 Sep 14 09:18:32.378401 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 339/647] 10.222.0.90 () {58 vars in 1316 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-13T09%3A18%3A32.108085&end=2022-09-15T09%3A18%3A32.108085 => generated 112 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:18:32.388814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27e91d81-0918-486d-93e9-35bc8a421168 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] Calling method '.version_select at 0x7f693fa52f70>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.394243 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-27e91d81-0918-486d-93e9-35bc8a421168 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27e91d81-0918-486d-93e9-35bc8a421168 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] Request method failure captured: Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-simple-tenant-usage/6fadac880ff74228a94ca33709c39392?start=2022-09-15T09%3A18%3A32.108085&end=2022-09-13T09%3A18%3A32.108085 HTTP/1.1 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxnloeQmis4lF3zHXXUSUsxDpb0Kh0G6UXyu9D9fkRlOpGUNHSeaLe77FosGUd8T8pEGwtIv9Rh3jucXsQA_Wni_fSYKw_UfkqZM7f16jLqDEKd_Zq6KjLjjakD3tWc3vmEQXY3qvQ5w8_jYzuRWMhWh2fxfhKbJPZA7zhB2Y8BY38 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: fe835a6bd07a491595ea610f8d7c46db Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1125148484 Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:18:32.396073 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_fe835a6bd07a491595ea610f8d7c46db", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fe835a6bd07a491595ea610f8d7c46db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/fe835a6bd07a491595ea610f8d7c46db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/fe835a6bd07a491595ea610f8d7c46db"}]}] Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1125148484 Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: fe835a6bd07a491595ea610f8d7c46db Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1125148484 Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 46527a0f93524c4a8eb0b8c72c48ca2e Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid start time. The start time cannot occur after the end time. Sep 14 09:18:32.397474 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '6fadac880ff74228a94ca33709c39392'} Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:18:32.398198 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 14 09:18:32.399381 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.400030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27e91d81-0918-486d-93e9-35bc8a421168 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:32.401823 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-27e91d81-0918-486d-93e9-35bc8a421168 tempest-TenantUsagesNegativeTestJSON-1125148484 tempest-TenantUsagesNegativeTestJSON-1125148484-project-admin] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage/6fadac880ff74228a94ca33709c39392?start=2022-09-15T09%3A18%3A32.108085&end=2022-09-13T09%3A18%3A32.108085" status: 400 len: 111 microversion: 2.1 time: 0.016878 Sep 14 09:18:32.404818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 340/648] 10.222.0.90 () {58 vars in 1412 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/os-simple-tenant-usage/6fadac880ff74228a94ca33709c39392?start=2022-09-15T09%3A18%3A32.108085&end=2022-09-13T09%3A18%3A32.108085 => generated 111 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:18:32.637087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98d729cc-7f95-4a56-8860-9a00f65a2d14 tempest-TenantUsagesNegativeTestJSON-1492251367 tempest-TenantUsagesNegativeTestJSON-1492251367-project] Calling method '.version_select at 0x7f693fa06310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.645078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-98d729cc-7f95-4a56-8860-9a00f65a2d14 tempest-TenantUsagesNegativeTestJSON-1492251367 tempest-TenantUsagesNegativeTestJSON-1492251367-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'a6ff04cee5b14907ae33e1158fefa238', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fadac880ff74228a94ca33709c39392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98d729cc-7f95-4a56-8860-9a00f65a2d14 tempest-TenantUsagesNegativeTestJSON-1492251367 tempest-TenantUsagesNegativeTestJSON-1492251367-project] Request method failure captured: Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T09%3A18%3A32.108085&end=2022-09-15T09%3A18%3A32.108085&detailed=1 HTTP/1.1 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxmIMgV0USE8M1LsgKeWOESzhUxbDD812yHKsxWAekuF_G0W2yMfMMfOShRdj5-dPkKQyDvW1eZ7Y37edFWF2pmsYdFoFGWTp3mKtx1TePaWw5OpmsNfn3V5V8HkkDGOUiWPLZA6sEUn6KglPS0fHZfsZ6rcTMJ_BmWpJy7Jt6gyRg Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6fadac880ff74228a94ca33709c39392 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1492251367 Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:18:32.647750 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6fadac880ff74228a94ca33709c39392", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6fadac880ff74228a94ca33709c39392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6fadac880ff74228a94ca33709c39392"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6fadac880ff74228a94ca33709c39392"}]}] Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1492251367 Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6fadac880ff74228a94ca33709c39392 Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1492251367 Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TenantUsagesNegativeTestJSON-1492251367-project Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: a6ff04cee5b14907ae33e1158fefa238 Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1492251367-project Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: action_args: {} Sep 14 09:18:32.649184 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 14 09:18:32.649959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 14 09:18:32.651068 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 14 09:18:32.653534 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 14 09:18:32.653534 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:32.655184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98d729cc-7f95-4a56-8860-9a00f65a2d14 tempest-TenantUsagesNegativeTestJSON-1492251367 tempest-TenantUsagesNegativeTestJSON-1492251367-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:32.656373 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-98d729cc-7f95-4a56-8860-9a00f65a2d14 tempest-TenantUsagesNegativeTestJSON-1492251367 tempest-TenantUsagesNegativeTestJSON-1492251367-project] 10.222.0.90 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T09%3A18%3A32.108085&end=2022-09-15T09%3A18%3A32.108085&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.247547 Sep 14 09:18:32.657698 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 341/649] 10.222.0.90 () {58 vars in 1335 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-13T09%3A18%3A32.108085&end=2022-09-15T09%3A18%3A32.108085&detailed=1 => generated 123 bytes in 249 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:32.665501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:32.666357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:32.678709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.679558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.680583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.681517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:32.682233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:32.682893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:32.977158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.003739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.006111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.018013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-91829591-df40-4308-8cd1-c0370ed6afd0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.358892 Sep 14 09:18:33.018938 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 342/650] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:33.027911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:33.028943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:33.041719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:33.042727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:33.043574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:33.045237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:33.046021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:33.046836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:33.339078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.356120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.358064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.359232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80baac7f-d53d-42f0-be4b-27e3f2b4e684 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 1.278551 Sep 14 09:18:33.359803 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 309/651] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:32 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:33.372640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:33.374438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:33.395146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:33.395816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:33.396906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:33.398804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:33.400086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:33.401066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:33.514912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.524703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.529879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:33.549831 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3e307494-b932-45df-b3d3-41b47c9f87d7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.529170 Sep 14 09:18:33.550667 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 343/652] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:33 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:34.047170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:34.047725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:34.057261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.057785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.058225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.065634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.066686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.067397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.067609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.086112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5279dbd3-0958-4c48-b6c8-caee46e2953c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 0.723011 Sep 14 09:18:34.087757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 310/653] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:33 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:34.104786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "name": "network-vif-plugged", "status": "completed", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:34.144713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.146904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.151044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.193332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] Creating event network-vif-plugged:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h1-851028-12 Sep 14 09:18:34.208609 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-99f19ebe-b100-4342-b41f-611a09fc4d2d req-edf3e746-9fed-4e4b-806d-0de2262ae4f0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117980 Sep 14 09:18:34.209603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 311/654] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:34.386917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:34.388420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:34.396006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.396828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.397434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.398146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.398833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.399489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.486572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.508206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.514259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.524101 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44e61e8a-cd4f-4a9c-b27e-7133915f7cc2 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.479353 Sep 14 09:18:34.538518 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 344/655] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:34 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:34.592834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:34.593449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:34.603978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.604755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.605535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.619111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:34.622350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:34.627305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:34.706497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.722333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.723810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.724917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5edb7fb-44fb-48dc-986a-451afe46f1c0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 0.343102 Sep 14 09:18:34.725737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 312/656] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:34 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:34.818166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.833715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.835274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:34.847752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c48d471-aaec-4d23-b473-db59d4323ef1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1533 microversion: 2.91 time: 0.260438 Sep 14 09:18:34.848386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 345/657] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:34 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:34.940337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be86999a-e8f5-4e1d-892f-6e475c3e4c4d tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Action: 'create', calling method: .version_select at 0x7f693fcfe310>, body: {"pool": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:35.112926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:35.113537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:35.120191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.120968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.121800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.122732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.123647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.124327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.556591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:35.580158 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-58d1d957-83aa-4c2d-b875-d964c93c7f34 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 0.461157 Sep 14 09:18:35.580158 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 346/658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:35 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:35.589594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:35.589594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:35.595991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.596619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.597157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.598107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.598769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.599401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.711335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:35.742832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:35.750172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:35.771307 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a15406f4-82e7-4a26-a493-d7c7e4bdb812 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.197593 Sep 14 09:18:35.788303 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 347/659] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:35 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:35.788303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:35.788303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:35.806248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.807176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.807849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:35.810838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:35.812955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:35.814380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:36.205562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.214886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.216364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.217526 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb9a0fdd-a883-45f8-9531-4a6ff4d179db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1410 microversion: 2.25 time: 0.441942 Sep 14 09:18:36.224937 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 348/660] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:35 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1410 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:36.237016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:36.241291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:36.254291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:36.255056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:36.255661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:36.256635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:36.257242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:36.257821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:36.393171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.409794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.415169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:36.426729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca7d200c-ff4e-4505-896b-32f5e70394ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1533 microversion: 2.91 time: 0.200337 Sep 14 09:18:36.431455 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 349/661] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:36 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1533 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:36.597996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:36.598968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:36.611830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:36.612446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:36.612883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:36.613590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:36.616524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:36.617246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.057159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:37.081117 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c63792fc-006b-4e6b-86c1-87412778f64a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 0.488364 Sep 14 09:18:37.082255 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 350/662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:36 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:18:37.087973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:37.088592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:37.106430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.107249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.107799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.111112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.111859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.115752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.297235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:37.307754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:37.314468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:37.326679 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1210e16f-4d41-46a3-b042-e9339370cb33 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.242473 Sep 14 09:18:37.333653 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 351/663] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:37 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:37.341228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:37.342140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:37.355797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.358376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.364499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:37.366239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:37.367309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:37.368490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.349002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.365471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.372651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.377184 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b63061b-7c6d-45ee-8f5e-1c3b04f00faf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1607 microversion: 2.25 time: 1.039217 Sep 14 09:18:38.383043 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 352/664] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:37 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1607 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:38.401084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:38.402172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:38.418221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.419116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.421953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.426598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.428193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.432484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.511753 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be86999a-e8f5-4e1d-892f-6e475c3e4c4d tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.784724 Sep 14 09:18:38.512917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 313/665] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:18:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:38.521891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:38.525626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:38.555076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.557303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.558367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.561258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.562148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.564164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.623480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.644921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.655254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.676555 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ffa1d17-934f-4eb7-9180-05748a9a7f33 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1476 microversion: 2.91 time: 0.291934 Sep 14 09:18:38.688115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 353/666] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:38 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1476 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:38.700464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:38.701407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:38.709252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.709977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.710573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.711450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.712088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.713293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.866229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.902022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.904911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:38.915422 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b86d48f6-2ce7-4e23-9ee1-00b1a3e02954 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.225835 Sep 14 09:18:38.917419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 354/667] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:38 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:38.925321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:38.926557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:38.934072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.935246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.935865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:38.937658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:38.939432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:38.940171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.139019 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-889154fc-29a2-47e2-a571-4ccfa2abf408 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.219438 Sep 14 09:18:39.139638 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 355/668] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:18:38 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-interface => generated 285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:18:39.152201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-42cf1e3d-0595-45b0-8e44-530480152678 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fa4f1f0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:39.156310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:39.169940 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f685cfcc-fd2c-4139-afd3-05e3c5252ba8 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 0.655910 Sep 14 09:18:39.184730 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 314/669] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:38 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:39.206917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:39.209878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:39.218750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.219241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.220131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.224127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.225175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.227249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.233752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:39.401475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-851028-12". {{(pid=122444) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:18:39.529692 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b8b0232-2584-4f8f-97a1-9859163c5418 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action" status: 202 len: 0 microversion: 2.91 time: 0.343677 Sep 14 09:18:39.531737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 315/670] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:18:39 2022] POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:18:39.544028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:39.544947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:39.579052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.580804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.581618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.583065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.586020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.586784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.864740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:39.876372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:39.877861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:39.890966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7175bd32-7e47-46a6-be04-e9f536ab5250 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1484 microversion: 2.91 time: 0.352542 Sep 14 09:18:39.907741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 316/671] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:39 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1484 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:39.951266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:39.954885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:39.965616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.966389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.968100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.970288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:39.974192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:39.974845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:39.995162 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-42cf1e3d-0595-45b0-8e44-530480152678 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips/f9e89425-e675-4904-bcf2-4f4e3b97826b" status: 200 len: 142 microversion: 2.1 time: 0.848631 Sep 14 09:18:39.996331 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 356/672] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:18:39 2022] GET /compute/v2.1/os-floating-ips/f9e89425-e675-4904-bcf2-4f4e3b97826b => generated 142 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:40.010310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12b6851b-d53e-437c-83ea-66b821bfc174 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fa52d30>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:40.293362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:40.317117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:40.318573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:40.327255 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cbf397b-9423-4a90-9a6b-ccbc934175f0 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.382309 Sep 14 09:18:40.334543 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 317/673] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:39 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:40.340535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33852f-0a4c-44c9-96ba-9a94fcd19bd2", "name": "network-vif-plugged", "status": "completed", "tag": "efded278-36be-496d-bec0-732ffc5156c3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:40.358850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:40.359327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:40.359843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:40.379341 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] Creating event network-vif-plugged:efded278-36be-496d-bec0-732ffc5156c3 for instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 on n-h2-851028-12 Sep 14 09:18:40.385099 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9466939e-2440-4b19-a816-dfe8dbc00b5f req-a2b490cb-f000-4f97-8711-9d7b5dc30306 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048923 Sep 14 09:18:40.386501 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 318/674] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:40.394972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:40.395931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:40.410731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:40.413458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:40.414820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:40.416723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:40.417380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:40.417978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.385308 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12b6851b-d53e-437c-83ea-66b821bfc174 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.379332 Sep 14 09:18:41.386052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 357/675] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:18:40 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:41.467462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.483527 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2871283-8f0b-4148-bca7-f0e0670b892f tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.095373 Sep 14 09:18:41.484443 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 319/676] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:40 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:41.489835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:41.490437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:41.496837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:41.497519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:41.508643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.511240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:41.511731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:41.512218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.584022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7172b729-cbe6-4a35-9330-d79ff3a490ab tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Action: 'create', calling method: .version_select at 0x7f693fa22c10>, body: {"keypair": {"name": "tempest-keypair-603315805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo5CsEXSp/LI6G+5drMtefReGQOL5HougF72Ho2hYJakrp/9t+YA0uYC3EcHsoZ/0kMDHgWjbnOVJ2B4qPYMgcQ442IgPaXYfZ68MG13Dgg1qn19Y/jN0v6eiUgOQw6sA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:41.626171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-7172b729-cbe6-4a35-9330-d79ff3a490ab tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Getting quotas for project b30258bc21b14d8a9036ab6f6b78319b. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:41.631263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-7172b729-cbe6-4a35-9330-d79ff3a490ab tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Getting quotas for user 73ce9c120ce24272bafa2f172995b978 and project b30258bc21b14d8a9036ab6f6b78319b. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:41.666827 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7172b729-cbe6-4a35-9330-d79ff3a490ab tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.279545 Sep 14 09:18:41.667810 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 358/677] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:18:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:41.673502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:41.674535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:41.689787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:41.690759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:41.691393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.692474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:41.693239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:41.693899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:41.809271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.819636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.824807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.833724 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-592cddac-6ada-4268-b969-ca9ffccd4766 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.347780 Sep 14 09:18:41.834591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 320/678] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:41 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:41.840118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f9e6d2a-af0f-4fab-9996-e659d85ebfdb tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fce0b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:41.913858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.922493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.924601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:41.933207 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f2d3f947-b1db-4917-b442-3cf6c3633ffa tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.263277 Sep 14 09:18:41.934539 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 359/679] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:41 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:42.508332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:42.509068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:42.520235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.521041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.523129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:42.524111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:42.525492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:42.526892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.642423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:43.656363 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3e37502f-03e5-47a4-aa55-dd8da33dbd48 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1323 microversion: 2.1 time: 1.149796 Sep 14 09:18:43.672186 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 360/680] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:42 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1323 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:43.692746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:43.697330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:43.723282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.724060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.725777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:43.730094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:43.730783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:43.731524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.061700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.069100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:44.082942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.084551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.115188 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8eadaee-dcba-4527-a492-28de971e6d45 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.440682 Sep 14 09:18:44.116011 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 361/681] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:43 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:44.174615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:44.175660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:44.183967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.184499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.184952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.185700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:44.186212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:44.186644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:44.659878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.669450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.679981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:44.695970 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f026bb1b-b681-4aff-a6ab-211796e8f090 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1447 microversion: 2.75 time: 0.578521 Sep 14 09:18:44.721180 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 362/682] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:44 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1447 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:44.726764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f7aa0454-8565-4e23-9918-9b76a5bf9ed7"}], "security_groups": [{"name": "tempest-securitygroup--80476478"}], "key_name": "tempest-keypair-603315805", "user_data": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:45.416032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] validate_networks() for [('f7aa0454-8565-4e23-9918-9b76a5bf9ed7', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:18:46.353452 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f9e6d2a-af0f-4fab-9996-e659d85ebfdb tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/f9e89425-e675-4904-bcf2-4f4e3b97826b" status: 202 len: 0 microversion: 2.1 time: 4.517262 Sep 14 09:18:46.354887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 321/683] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:18:41 2022] DELETE /compute/v2.1/os-floating-ips/f9e89425-e675-4904-bcf2-4f4e3b97826b => generated 0 bytes in 4519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:46.359633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:46.360847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:46.379382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.380888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.381334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.382366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.383069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.383872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.926980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:46.927542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:46.927876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:46.928454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:46.928875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:46.945389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:46.967375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.967959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.968416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:46.969187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:46.969709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:46.970139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.034086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Getting quotas for project b30258bc21b14d8a9036ab6f6b78319b. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:18:47.056914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Getting quotas for user 73ce9c120ce24272bafa2f172995b978 and project b30258bc21b14d8a9036ab6f6b78319b. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:18:47.113997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:18:47.121359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:18:47.246554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f19a59d-8d85-46a1-98fc-b480d1f1e703 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.520622 Sep 14 09:18:47.260284 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 363/684] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:44 2022] POST /compute/v2.1/servers => generated 407 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:18:47.267566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:47.273410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.294963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.295456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.295917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.297605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e10bc40b-6941-4707-8e67-d15e2c01688d tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 200 len: 1519 microversion: 2.1 time: 0.941792 Sep 14 09:18:47.298550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 322/685] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:46 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 1519 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:47.342161 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] Creating event network-changed:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h1-851028-12 Sep 14 09:18:47.347724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:47.359104 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9c0cecd4-af8d-480c-9812-059cf2e686d3 req-f0245e10-dacf-441e-babd-66de08a451a8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097332 Sep 14 09:18:47.360929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:47.362320 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 364/686] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:47.366910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:47.374391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:47.383316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.384419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.385024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.386020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.386933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.387544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.415562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.416714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.418206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.423175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:47.425149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:47.426717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:47.585564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.595050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.596574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.607298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.623043 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0dd1ed87-9d5d-4a73-a029-b69d53a7c3f7 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1453 microversion: 2.75 time: 0.260194 Sep 14 09:18:47.623970 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 365/687] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:47 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:47.629161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55ca69a9-f684-4287-b79b-c157981bddef tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Action: 'create', calling method: .version_select at 0x7f693fa22f70>, body: {"pool": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:47.659777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.662338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:47.682924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-028aec0b-33a7-4b59-acc4-dc847dbae852 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.372654 Sep 14 09:18:47.685537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 323/688] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:47 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:47.697417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89beec06-5185-438b-a65d-ec80e6b44911 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:47.698378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89beec06-5185-438b-a65d-ec80e6b44911 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:48.463004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89beec06-5185-438b-a65d-ec80e6b44911 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:48.487922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89beec06-5185-438b-a65d-ec80e6b44911 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1225 microversion: 2.1 time: 0.796296 Sep 14 09:18:48.489820 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 324/689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:47 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1225 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:48.503871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: .version_select at 0x7f6945414310>, body: {"addFloatingIp": {"address": "172.25.4.228"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:48.528641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:48.544359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:48.546085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:48.559817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:48.561195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:48.564706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:48.565545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:48.760824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:18:48.761565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquired lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:18:52.139812 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-55ca69a9-f684-4287-b79b-c157981bddef tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.513998 Sep 14 09:18:52.143714 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 366/690] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:18:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:52.180277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:52.181394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:52.189126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.189624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.190063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.190765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.191219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.191640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.193238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:18:52.301118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.323454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.325015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.335491 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-428e2bec-167f-4190-af09-8f7e9352f1cc tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1438 microversion: 2.75 time: 0.190089 Sep 14 09:18:52.336318 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 367/691] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:52 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1438 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:52.380668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:52.381612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:52.392098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.392898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.393657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.394639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.395284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.395922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.837889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.853794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.856073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:52.872064 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ae96478-76a5-41f9-8fe5-429659a8807b tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.504428 Sep 14 09:18:52.875671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 368/692] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:52 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:52.881981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:52.887335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:52.904847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.906494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.907776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:52.908726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:52.909253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:52.909747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:53.035238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:53.046435 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8238a27d-c022-4f8d-95d1-818e4f8b52c4 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1221 microversion: 2.1 time: 0.168786 Sep 14 09:18:53.047799 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 369/693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:52 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:53.131525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fcd1c809-a3d1-4133-b054-16d6a373e39c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Calling method '.version_select at 0x7f693f9dfee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:53.198520 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fcd1c809-a3d1-4133-b054-16d6a373e39c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.147297 Sep 14 09:18:53.199483 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 370/694] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:18:53 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:18:53.204913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9baac8f4-1a50-4488-83e7-04db5778b7c5 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fa22310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:53.869299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Updating instance_info_cache with network_info: [{"id": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d", "address": "fa:16:3e:57:4c:01", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap56d4a97b-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:18:53.896967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Releasing lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:18:53.897843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80642d20-3d5a-4d36-a1a1-9587c0ecbb6b tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action" status: 202 len: 0 microversion: 2.1 time: 5.406819 Sep 14 09:18:53.898451 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 325/695] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:48 2022] POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action => generated 0 bytes in 5408 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:18:53.910901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:53.924556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:53.925321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:53.926348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:53.942386 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] Creating event network-changed:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:18:53.948257 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ff6f3250-3bb7-4f68-8640-155534c4eaa3 req-609e0594-0e10-4a9f-b832-7d87f7a7539c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048406 Sep 14 09:18:53.948868 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 326/696] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:18:54.127262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.130664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.144146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.145328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.146873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.147809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.150095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.150714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.295947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:18:54.296366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:18:54.297163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:18:54.299697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:18:54.300325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:18:54.409439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.438864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.440071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.440918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.442210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.443067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.443867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.519362 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9baac8f4-1a50-4488-83e7-04db5778b7c5 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b" status: 202 len: 0 microversion: 2.1 time: 1.318753 Sep 14 09:18:54.519993 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 371/697] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:18:53 2022] DELETE /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:18:54.524832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1c0ed02-c889-483f-b0a7-8f5393902805 tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Action: 'create', calling method: .version_select at 0x7f693fa06550>, body: {"pool": "non_exist_pool"} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.596847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f1c0ed02-c889-483f-b0a7-8f5393902805 tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] HTTP exception thrown: Floating IP pool not found. Sep 14 09:18:54.598488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1c0ed02-c889-483f-b0a7-8f5393902805 tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Request method failure captured: Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 26 Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZx7VeJMdQK3-cqGCMmdaLCPp40APllFwyKMVU59o_Ir121b5vqC5e0KwHo5VkZsYft8V36BoJ-ZzQInsGYwIW6bPbfvos26zQMeuZlThET03D0hXANUUjPmXrySdw6yprSRgR2-eJXA1wiHb_31PRh2GqfCE3nktReYlJxnNOLqIWw Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0eae1f917f2c477bb0d5944935d8d79d Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:18:54.600882 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0eae1f917f2c477bb0d5944935d8d79d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0eae1f917f2c477bb0d5944935d8d79d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0eae1f917f2c477bb0d5944935d8d79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0eae1f917f2c477bb0d5944935d8d79d"}]}] Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0eae1f917f2c477bb0d5944935d8d79d Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FloatingIPsNegativeTestJSON-1085470697-project Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: a9387c008a404a11a2494ac620a28948 Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1085470697-project Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: {"pool": "non_exist_pool"} Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: exception: Floating IP pool not found. Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 14 09:18:54.602479 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:54.603471 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 14 09:18:54.605719 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:18:54.608045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1c0ed02-c889-483f-b0a7-8f5393902805 tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Returning 404 to user: Floating IP pool not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:54.609505 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f1c0ed02-c889-483f-b0a7-8f5393902805 tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.088532 Sep 14 09:18:54.610636 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 372/698] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:18:54 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:18:54.616532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: .version_select at 0x7f69454613a0>, body: {"addFloatingIp": {"address": "172.25.4.228"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:54.620650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.628929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.629737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.631787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.634229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.636556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.637000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.643150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c17c226-8147-4537-ac58-6ab15b6a612e tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6/action" status: 202 len: 1944 microversion: 2.75 time: 0.692515 Sep 14 09:18:54.645539 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 327/699] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:18:53 2022] POST /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6/action => generated 1944 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:18:54.658948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:54.662388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.680253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.681013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.681665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.682552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.683163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.684350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.724923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:18:54.725635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquired lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:18:54.770981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.786054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.788421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.796723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b656dbb-37e1-4864-a4c6-61671eb1ff19 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.150101 Sep 14 09:18:54.798164 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 328/700] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:54 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:54.804582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:54.805513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:54.814079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.814837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.815518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.816517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:54.817253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:54.817890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:54.981142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:54.991118 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f88065dc-98d2-4e16-8278-d4ac04397ecf tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1221 microversion: 2.1 time: 0.191400 Sep 14 09:18:55.003935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 329/701] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:54 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1221 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:55.003935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fd0d4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.079279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b could not be found", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:18:55.080367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] HTTP exception thrown: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Request method failure captured: Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b HTTP/1.1 Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZxqleoVmJyifBgR-7UItuYfYv7uXfiUb1mtyjGdu-fKOc6YAUDFIVKvmAl9zxU0_UvFzaACEOZ47frdRUGSYMolFt4ONoJMv3lN3E9Movy_4CsDkpJOcx0Q08Q14ihE1-_ND91m3tggiFiAdmvl3rTpkuEJZQVKlMw62zPmbx4vbbY Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9d8d7fc91fa047e9831479e6da7101de Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:18:55.097643 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9d8d7fc91fa047e9831479e6da7101de", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9d8d7fc91fa047e9831479e6da7101de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9d8d7fc91fa047e9831479e6da7101de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9d8d7fc91fa047e9831479e6da7101de"}]}] Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9d8d7fc91fa047e9831479e6da7101de Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsTestJSON-550418653-project Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 135a9789b9a34b36bdd5eec0fa13a03e Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsTestJSON-550418653-project Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9f94d48f-b37a-4c72-8ce9-f523ac3ad97b'} Sep 14 09:18:55.099523 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:18:55.100588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b could not be found Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59addc22-c4bf-4b55-a350-144c39e580d7'] Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b. Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.102024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:55.103544 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:55.105038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.105038 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.107915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Returning 404 to user: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:55.113463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51561df9-ba95-4527-939b-839ef6904c37 tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b" status: 404 len: 111 microversion: 2.1 time: 0.120271 Sep 14 09:18:55.114042 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 330/702] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:18:54 2022] GET /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:55.124491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Calling method '.version_select at 0x7f693fb5c820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.264584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e3ad4574-ca13-4a15-9fc7-ee37cbeed130 could not be found", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:18:55.266931 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] HTTP exception thrown: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Request method failure captured: Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-floating-ips/e3ad4574-ca13-4a15-9fc7-ee37cbeed130 HTTP/1.1 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZx7VeJMdQK3-cqGCMmdaLCPp40APllFwyKMVU59o_Ir121b5vqC5e0KwHo5VkZsYft8V36BoJ-ZzQInsGYwIW6bPbfvos26zQMeuZlThET03D0hXANUUjPmXrySdw6yprSRgR2-eJXA1wiHb_31PRh2GqfCE3nktReYlJxnNOLqIWw Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 0eae1f917f2c477bb0d5944935d8d79d Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:18:55.269040 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0eae1f917f2c477bb0d5944935d8d79d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0eae1f917f2c477bb0d5944935d8d79d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0eae1f917f2c477bb0d5944935d8d79d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0eae1f917f2c477bb0d5944935d8d79d"}]}] Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 0eae1f917f2c477bb0d5944935d8d79d Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1085470697 Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsNegativeTestJSON-1085470697-project Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: a9387c008a404a11a2494ac620a28948 Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1085470697-project Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130 Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e3ad4574-ca13-4a15-9fc7-ee37cbeed130'} Sep 14 09:18:55.270638 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:18:55.271595 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e3ad4574-ca13-4a15-9fc7-ee37cbeed130 could not be found Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fa782db-18a5-43a0-b5a8-f4ea83052b8f'] Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130. Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.272948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130 Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:55.274358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:55.275752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130 Sep 14 09:18:55.275752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.276809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] Returning 404 to user: Floating IP not found for ID e3ad4574-ca13-4a15-9fc7-ee37cbeed130 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:55.277861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac65af96-a4f5-40f6-a877-e6310c27531c tempest-FloatingIPsNegativeTestJSON-1085470697 tempest-FloatingIPsNegativeTestJSON-1085470697-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/e3ad4574-ca13-4a15-9fc7-ee37cbeed130" status: 404 len: 111 microversion: 2.1 time: 0.159337 Sep 14 09:18:55.279001 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 331/703] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:18:55 2022] DELETE /compute/v2.1/os-floating-ips/e3ad4574-ca13-4a15-9fc7-ee37cbeed130 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:55.284533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.285372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:55.292270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.293058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.297152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.298928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.299587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.302528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.322007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:55.482188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:55.503547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e234db3-e180-4df6-82bc-4b9425b35ee0 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.223212 Sep 14 09:18:55.504497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 332/704] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:55 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:55.513244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Calling method '.version_select at 0x7f693fd0db80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.606986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b could not be found", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:18:55.608003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] HTTP exception thrown: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Request method failure captured: Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b HTTP/1.1 Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZxqleoVmJyifBgR-7UItuYfYv7uXfiUb1mtyjGdu-fKOc6YAUDFIVKvmAl9zxU0_UvFzaACEOZ47frdRUGSYMolFt4ONoJMv3lN3E9Movy_4CsDkpJOcx0Q08Q14ihE1-_ND91m3tggiFiAdmvl3rTpkuEJZQVKlMw62zPmbx4vbbY Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9d8d7fc91fa047e9831479e6da7101de Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:18:55.610536 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9d8d7fc91fa047e9831479e6da7101de", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9d8d7fc91fa047e9831479e6da7101de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9d8d7fc91fa047e9831479e6da7101de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9d8d7fc91fa047e9831479e6da7101de"}]}] Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9d8d7fc91fa047e9831479e6da7101de Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsTestJSON-550418653 Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsTestJSON-550418653-project Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 135a9789b9a34b36bdd5eec0fa13a03e Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsTestJSON-550418653-project Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9f94d48f-b37a-4c72-8ce9-f523ac3ad97b'} Sep 14 09:18:55.612015 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:18:55.612917 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b could not be found Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a942cb81-f465-4983-a161-fd91599150ee'] Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b. Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.614003 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:18:55.615143 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:18:55.616357 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b Sep 14 09:18:55.616357 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:18:55.616357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] Returning 404 to user: Floating IP not found for ID 9f94d48f-b37a-4c72-8ce9-f523ac3ad97b {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:18:55.616357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f9604f2-56f6-4735-a680-aadc342381da tempest-FloatingIPsTestJSON-550418653 tempest-FloatingIPsTestJSON-550418653-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b" status: 404 len: 111 microversion: 2.1 time: 0.102867 Sep 14 09:18:55.616357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 333/705] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:18:55 2022] DELETE /compute/v2.1/os-floating-ips/9f94d48f-b37a-4c72-8ce9-f523ac3ad97b => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:18:55.829873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:55.831262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:55.839167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.839655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.840293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:55.841161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:55.841786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:55.842211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.249626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:56.268898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:56.270560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:56.276250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a33020b-0558-48d5-8a00-1100bc269dd1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.450884 Sep 14 09:18:56.277824 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 334/706] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:55 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:18:56.292123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:56.293166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:56.307784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.308887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.309800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.310964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.311562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.312047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.526618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:56.536756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a055507b-2f95-4aa9-a17a-620c9e8796af tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1277 microversion: 2.1 time: 0.257657 Sep 14 09:18:56.542099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 335/707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:56 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:56.552908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:56.553849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:56.561543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.562464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.563767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.564811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:56.565454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:56.566065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:56.691323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:56.716725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3fd74ad-f4b1-4ed8-90bc-e3a9110a7953 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.171415 Sep 14 09:18:56.717747 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 336/708] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:56 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:57.022358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:57.097641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=10 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:57.318792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:57.320616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:57.327640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.328583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.329565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.331052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.331516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.332006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.544828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.558222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.560961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.574912 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16b95f50-af31-4216-a970-2fc16c85f0f1 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.269829 Sep 14 09:18:57.589610 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 337/709] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:57 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:57.605585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:57.606221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:57.613410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:57.615224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.615767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.616236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.618235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.618871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.619454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.710758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:18:57.720668 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db54ab34-01f3-4b07-8568-f863fb676d85 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1283 microversion: 2.1 time: 0.129135 Sep 14 09:18:57.721308 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 338/710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:18:57 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1283 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:18:57.753088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:57.754349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:57.768498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.784821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.785335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.786184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:57.786728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:57.787231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:57.946624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:18:57.986858 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-529137d4-76d0-4c5d-846d-0d184119cfd9 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.240558 Sep 14 09:18:57.987311 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 339/711] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:18:57 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:18:58.131280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:18:58.131976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:18:58.142358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.143076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.143670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.156537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:18:58.157730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:18:58.158229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:18:58.214471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:18:58.418025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd5bbe36-4942-43fc-9b81-2353e42a1fbe tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 204 len: 0 microversion: 2.1 time: 0.289949 Sep 14 09:18:58.420239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 340/712] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:18:58 2022] DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:18:58.605953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1682006864", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "422970518", "adminPass": "***", "networks": [{"uuid": "5b8a862c-2436-460d-9581-aff71c8982e7"}], "security_groups": [{"name": "tempest-securitygroup--704785983"}], "key_name": "tempest-keypair-2037761214", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:18:58.657861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:18:59.210955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] validate_networks() for [('5b8a862c-2436-460d-9581-aff71c8982e7', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:19:00.497340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:00.498533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:00.499184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:00.499600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:00.504374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:00.527497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.528437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.529512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:00.530449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.530914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.531344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:00.586773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:00.595507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Getting quotas for user 55337a61f6f54038a60f21aa891ccee1 and project d45ebdf7b6f3452bb868bec5bd60ca4c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:00.634003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:00.637229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:00.746418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b78de90a-f923-4295-9405-1f2c9cdf23fb tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.147187 Sep 14 09:19:00.748075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 341/713] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:18:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:19:00.754236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:00.755173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:00.770543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.771445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.772406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:00.774008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:00.774705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:00.775227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.009557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:01.024182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:01.026381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:01.033558 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06ba53bd-ea38-4bc9-92a4-39aef3de449f tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1529 microversion: 2.91 time: 0.283128 Sep 14 09:19:01.034483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 342/714] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:00 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1529 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:01.040660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:01.042020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:01.073717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.074477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.074916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.075631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:01.079845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:01.080960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:01.589006 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.neutron [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] re-assign floating IP 172.25.4.228 from instance bc773229-a107-4f87-a5eb-02aaa6b264e2 Sep 14 09:19:01.664593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Building network info cache for instance {{(pid=122443) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:19:02.046321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:02.054883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03b2edd1-6913-488d-9b3d-7004846ebf69 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 1.019093 Sep 14 09:19:02.055465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 343/715] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:01 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:02.060095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.060694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:02.069355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.069849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.070284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.070983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.071434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.071856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.265114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:02.322349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9988cc7-b1f3-4244-9fdc-e7a0898c1cb2 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.264827 Sep 14 09:19:02.323379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 344/716] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:02 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:02.339407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:02.363865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.364821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.365586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.386964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] Creating event network-changed:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:19:02.394987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f38188e9-9d79-4192-b00a-acfc1fb6c917 req-c58fcbd6-f5d7-4aa9-a172-b4133f76c234 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067986 Sep 14 09:19:02.396397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 345/717] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:02.404927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.405967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:02.415309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.416959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.417678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.418591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.419973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.421429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.785228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:02.801183 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f60578af-2393-4199-adbc-999f1d403ce5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1323 microversion: 2.1 time: 0.403342 Sep 14 09:19:02.816318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 346/718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:02 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:02.823000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:02.824418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:02.835463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.836477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.837148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.838377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:02.839424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:02.840401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:02.959342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lazy-loading 'services' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:02.980754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d255532-57bb-40b0-8e96-a50bcf3a349d tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1936 microversion: 2.91 time: 0.162843 Sep 14 09:19:02.981512 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 347/719] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:02 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1936 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:03.008608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:03.009469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:03.016074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.017375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.018111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.019439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.020256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.020908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.025359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:03.046262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lazy-loading 'flavor' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:03.382495 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e6a728c-2dfa-4e0e-8b4f-622a2f2887ce tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action" status: 202 len: 0 microversion: 2.91 time: 0.377581 Sep 14 09:19:03.393139 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 348/720] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:19:03 2022] POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:19:03.414229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:03.418375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:03.437443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.440440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.441953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:03.442948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:03.445446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:03.446236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.342363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.354640 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d6b7a29d-21ff-403a-925d-d21699464f3d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.950353 Sep 14 09:19:04.355662 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 349/721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:03 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:04.363212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.364187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:04.371959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.373164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.374128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.375267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.378905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.379814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.442826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Updating instance_info_cache with network_info: [{"id": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d", "address": "fa:16:3e:57:4c:01", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap56d4a97b-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122443) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:19:04.451797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Building network info cache for instance {{(pid=122443) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:19:04.601715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:04.624772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:04.652427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e83485bb-b488-44c4-a25c-c1135b068398 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.294048 Sep 14 09:19:04.667866 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 350/722] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:04 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:04.669214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.682000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:04.707525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.708571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.708571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.709784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.709784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.709972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.908162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.921390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.923176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:04.937107 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b92966f5-fdeb-4193-8df3-ef05b53ec47e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.280622 Sep 14 09:19:04.937777 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 351/723] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:04 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:04.946413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:04.947123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:04.966316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.967283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.968222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:04.972390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:04.974731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:04.975398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.330381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:05.346405 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd21d4e2-8334-4aea-b423-3f176aeaae9e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.407073 Sep 14 09:19:05.347271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 352/724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:04 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:05.357059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33852f-0a4c-44c9-96ba-9a94fcd19bd2", "tag": "efded278-36be-496d-bec0-732ffc5156c3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:05.399540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.400056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.402617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.421839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] Creating event network-changed:efded278-36be-496d-bec0-732ffc5156c3 for instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 on n-h2-851028-12 Sep 14 09:19:05.428843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9314261b-c3cf-433a-87b9-e47d63fca1af req-4179600e-9d34-47b4-947a-6483bc60b2da service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080110 Sep 14 09:19:05.430101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 353/725] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:05.437723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:05.439191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:05.446880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.447736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.448698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.449647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.450300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:05.450937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:05.944002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:05.953592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-811f3208-e3c1-4085-80e1-27551091fb12 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.521325 Sep 14 09:19:05.967382 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 354/726] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:05 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:05.980738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:05.981576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:05.995027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:05.996397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.001108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.002880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.005381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.007342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.155136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Updating instance_info_cache with network_info: [{"id": "efded278-36be-496d-bec0-732ffc5156c3", "address": "fa:16:3e:f0:a6:64", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefded278-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122443) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:19:06.177493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Releasing lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:19:06.178723 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fbfc8ca5-12ce-4d89-ac05-fea062d5234c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2/action" status: 202 len: 0 microversion: 2.1 time: 11.566848 Sep 14 09:19:06.180124 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 373/727] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:18:54 2022] POST /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2/action => generated 0 bytes in 11569 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:19:06.187600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:06.189004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:06.196473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.196966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.197429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.198170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.198656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.199081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.223994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:06.260502 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcc92fe9-160e-4c43-8b99-6a69a3b0988a tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.283324 Sep 14 09:19:06.272714 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 355/728] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:05 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:06.290733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: .version_select at 0x7f6945414430>, body: {"removeFloatingIp": {"address": "172.25.4.228"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:06.483172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:06.496268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:06.499482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:06.508223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0c9eb44-deec-4f00-9497-4a0d211f7f23 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.326756 Sep 14 09:19:06.509753 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 374/729] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:06 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:06.542845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:06.544486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:06.574771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.577680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.580150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.581543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.588572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.591125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.754827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:06.761073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.761569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.762001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:06.762714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:06.766113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:06.767654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.162741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:07.178454 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-61c11e56-71e4-40ef-8dde-9510cb2ffc0d tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.649165 Sep 14 09:19:07.180298 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 375/730] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:06 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:07.189020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:07.190101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:07.198991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.199577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.200057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.202159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.202871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.204727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.714822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] HTTP exception thrown: Floating IP 172.25.4.228 is not associated with instance bc773229-a107-4f87-a5eb-02aaa6b264e2. Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Request method failure captured: Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action HTTP/1.1 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 49 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZxCGXpLrXUBhFGAjlzqN03RUWXWHKscqTxzWNYGVwbihNog2q4Lvryxr0kDLJtR8alUa0YmZXmLRumkwU9YVm0rpXuN9oPsoyuvticwOUCoGA3hckisRLMZ2kY95ytwGQZjPfSk4mTGeud12hkg-qaXU52IqqrmCjNTpVfGe6MxWjk Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:19:07.716736 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c9e67ca35d2247eb82228094d59c3023", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c9e67ca35d2247eb82228094d59c3023"}]}] Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 6099c8cee6ea42d7ade1287430035b76 Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: {"removeFloatingIp": {"address": "172.25.4.228"}} Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:19:07.718185 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP 172.25.4.228 is not associated with instance bc773229-a107-4f87-a5eb-02aaa6b264e2. Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'bc773229-a107-4f87-a5eb-02aaa6b264e2', 'body': {'removeFloatingIp': {'address': '172.25.4.228'}}} Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.228 is not associated with instance bc773229-a107-4f87-a5eb-02aaa6b264e2. Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:07.719007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.228 is not associated with instance bc773229-a107-4f87-a5eb-02aaa6b264e2. Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Returning 409 to user: Floating IP 172.25.4.228 is not associated with instance bc773229-a107-4f87-a5eb-02aaa6b264e2. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d4e2c8d-fe06-489c-a40e-5dd1ceaab3b9 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action" status: 409 len: 146 microversion: 2.1 time: 1.440928 Sep 14 09:19:07.720834 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 356/731] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:06 2022] POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action => generated 146 bytes in 1447 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:07.725331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa26f8cb-f4a0-4e68-86dd-0423d8559934", "tag": "66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:07.736807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.737294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.737730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.754056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] Creating event network-changed:66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3 for instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 on n-h1-851028-12 Sep 14 09:19:07.760015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-23ae26f0-f265-441f-9448-8bb5015f2693 req-737e91d5-a11a-4b1a-a5e6-9ecab7726674 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037959 Sep 14 09:19:07.761080 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 357/732] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:07.780777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:07.781832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:07.789685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.790491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.791727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.792733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.793269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.793703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.832975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:07.843514 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ea7151a-69cc-47a3-8411-853238b14704 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.661975 Sep 14 09:19:07.844374 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 376/733] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:07 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:07.868172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db70afe2-8bc3-4daa-b118-de8ddc4fd012", "name": "network-vif-deleted", "tag": "a72fabda-6f3e-4a11-8631-d472fe5d8721"}, {"name": "network-changed", "server_uuid": "6865b8ea-16eb-4958-83a9-583407022460", "tag": "3c43a081-809d-4017-9c6a-97d846370981"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:07.883080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:07.883882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:07.884526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:07.921084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:07.979690 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d713672-08a1-4495-9221-ecb45c1ab883 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.216971 Sep 14 09:19:07.990594 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 358/734] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:07 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:07.995782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:07.996430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.006096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.006598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.011889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.012746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.013418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.023885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.136878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:08.140645 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Creating event network-vif-deleted:a72fabda-6f3e-4a11-8631-d472fe5d8721 for instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 on n-h2-851028-12 Sep 14 09:19:08.141832 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] Creating event network-changed:3c43a081-809d-4017-9c6a-97d846370981 for instance 6865b8ea-16eb-4958-83a9-583407022460 on n-h1-851028-12 Sep 14 09:19:08.147690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:08.149179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:08.157843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a306784c-5bd3-430b-8431-3dd6491acc03 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.165412 Sep 14 09:19:08.161698 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 359/735] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:07 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:08.170944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.228"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:08.181712 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2cd65646-28c5-4da1-8045-71a16a3e0b47 req-4fce8735-7609-4b15-a584-7a7e26a806f9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.330326 Sep 14 09:19:08.184991 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 377/736] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:08.205831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:08.207976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.216521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.217277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.218090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.219235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.220214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.220942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.692866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.701272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.705479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.708673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.711473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.712524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.713959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.756924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:08.765342 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2cf40ab7-f15a-4e69-baf1-df86851d010c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.566575 Sep 14 09:19:08.765922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 378/737] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:08 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:08.870498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:08.871110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:08.887346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.887848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.888309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:08.889014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:08.889533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:08.890245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.360642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.371108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:19:09.371651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquired lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:19:09.374015 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-69d33810-792c-4b4c-9d95-f27962d3388c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.507238 Sep 14 09:19:09.374795 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 379/738] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:08 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:09.381439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:09.382241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:09.389409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.390236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.390855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.392454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.393285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.393893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.552771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:09.579729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8f49bfb-f2a3-42a3-9316-34f9a11656ab tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.202448 Sep 14 09:19:09.581214 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 380/739] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:09 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:09.586130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:09.586936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:09.595113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.596321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.596932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.597832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.598444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.599031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.709111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.713455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:09.721474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.723356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:09.729848 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f081535f-92eb-4c93-87e4-fb60d382e17a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.147356 Sep 14 09:19:09.731009 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 381/740] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:09 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:09.789238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:09.790216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:09.801355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.801997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.802748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:09.804345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:09.805113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:09.805765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:10.253856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:10.263322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3585053d-4696-4c38-961a-5cd71f9e89fc tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.477899 Sep 14 09:19:10.276774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 382/741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:09 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:10.398764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:10.400231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:10.407745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:10.408672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:10.409584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:10.410608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:10.411304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:10.411965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:10.561654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:10.604099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:11.373078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.412579 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-964cfce0-afb4-41ba-9527-c6985c3a5544 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 1.016830 Sep 14 09:19:11.418729 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 383/742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:10 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:11.432392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.433283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.448900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.450604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.452013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.454995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.456049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.457682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.620636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:11.676295 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1fd2ba2e-7ff2-40c1-802b-ba332a49be7c tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.252339 Sep 14 09:19:11.680727 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 384/743] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:11.698653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.699272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.712057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.712806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.713425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.714497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.716801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.717607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.825683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:19:11.827923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.849963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.851996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:11.860035 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18f3a0e6-af4a-4e8d-8066-681d236fecea tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.176592 Sep 14 09:19:11.861652 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 385/744] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:11.867867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:11.869219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:11.877701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.878821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.879424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:11.880390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:11.880995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:11.882339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.272661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:12.290221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f2ee03b3-a591-462a-998c-6dce1ed8bed8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.421893 Sep 14 09:19:12.293146 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 386/745] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:11 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:12.304987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a33852f-0a4c-44c9-96ba-9a94fcd19bd2", "tag": "efded278-36be-496d-bec0-732ffc5156c3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:12.332440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.335540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.336018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.357232 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] Creating event network-changed:efded278-36be-496d-bec0-732ffc5156c3 for instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 on n-h2-851028-12 Sep 14 09:19:12.363192 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d4ae4385-a4de-4fbc-a9df-5b4ff61545d9 req-049b0fe9-67b8-4a97-a6fd-fcad58e8cca8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068436 Sep 14 09:19:12.364414 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 387/746] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:12.369675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:12.374610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:12.386766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.387545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.388179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.389085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.389697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.390284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.879530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:12.909637 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c9dc1d38-dd1d-4cdd-a04c-0b8385aa31d8 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 2346 microversion: 2.25 time: 0.542603 Sep 14 09:19:12.910602 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 388/747] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:12 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 2346 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:12.918320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:12.919922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:12.928086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.928803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.930418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:12.931735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:12.933366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:12.933969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.652855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:13.666776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9c9d442-b1a4-4b32-93b2-38389889f8a9 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.754620 Sep 14 09:19:13.667387 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 389/748] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:12 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:13.675987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:13.676615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:13.695748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.696273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.696897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.697781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:13.698401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:13.699016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:13.926740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:13.992304 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-93081a13-c048-4093-9894-fe4daee3b82b tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.323764 Sep 14 09:19:13.992911 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 390/749] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:13 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:14.008324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6865b8ea-16eb-4958-83a9-583407022460", "name": "network-vif-plugged", "status": "completed", "tag": "3c43a081-809d-4017-9c6a-97d846370981"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:14.031653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.035982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.036646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.060741 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] Creating event network-vif-plugged:3c43a081-809d-4017-9c6a-97d846370981 for instance 6865b8ea-16eb-4958-83a9-583407022460 on n-h1-851028-12 Sep 14 09:19:14.072886 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-06399614-5b41-4479-9b0b-64809b7e6a91 req-365a805e-6988-4157-8fcd-91cb4759ea80 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075312 Sep 14 09:19:14.075973 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 391/750] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:14.083832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.089713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.103734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.107925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.108597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.112559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.113219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.113852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.152962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Updating instance_info_cache with network_info: [{"id": "efded278-36be-496d-bec0-732ffc5156c3", "address": "fa:16:3e:f0:a6:64", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapefded278-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:19:14.171392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Releasing lock "refresh_cache-4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:19:14.176610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f4afd085-4369-40c9-acf8-fe701c676ed1 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2/action" status: 202 len: 0 microversion: 2.1 time: 6.010667 Sep 14 09:19:14.180342 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 360/751] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:08 2022] POST /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2/action => generated 0 bytes in 6018 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:19:14.194771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.210190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.211939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.214654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.216202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.223050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.223824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.290299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc5c7f72-e528-43f3-84e8-ef078ddc88be tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.107660 Sep 14 09:19:14.295155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 361/752] 10.222.0.90 () {60 vars in 1217 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:19:14.306940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.309491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.325518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.326214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.329593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.331740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.337627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.338389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.385501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:14.397982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:14.399467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:14.419193 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7b08bf94-4efe-4586-8b8e-fc0270755a5a tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.341746 Sep 14 09:19:14.420939 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 392/753] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:14.456466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.462295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.474118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.474618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.475051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.475770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.476250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.476679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.540110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:19:14.777440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8dc1a3b4-c0e7-42dc-862c-73d659ff4147 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 204 len: 0 microversion: 2.1 time: 0.342826 Sep 14 09:19:14.778111 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 393/754] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:19:14 2022] DELETE /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:19:14.798803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:14.801104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:14.819390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.819933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.820397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:14.823706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:14.829425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:14.832019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.371332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:15.396751 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a427f84e-382c-4142-ad35-3d37c71bdbd5 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 1.100139 Sep 14 09:19:15.407677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 362/755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:15.413194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.228"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:15.426951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:15.443499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.444391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.445088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.446029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.446715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.447639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.456813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:15.505179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:19:15.507254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquired lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:19:15.510643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:15.546811 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-30cdbd32-5987-4860-86f5-0a2e09df6b5a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1349 microversion: 2.1 time: 0.759590 Sep 14 09:19:15.549128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 394/756] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:14 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1349 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:15.553956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:15.556920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:15.572497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.573208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.573958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.575269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.575734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.576204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.841059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:15.885199 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0b86889b-2412-4c2c-8378-4126f35eb6d5 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.334763 Sep 14 09:19:15.891399 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 395/757] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:15 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:15.901622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:15.902809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:15.926804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.927551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.928195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:15.930530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:15.931016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:15.931728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.112569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.119075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:16.134931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.139364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:16.154530 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd88de96-c7c3-4cb6-81e9-4569ac23b3b7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.261653 Sep 14 09:19:16.158383 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 396/758] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:15 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:16.426598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:16.428146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:16.443236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.444010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.445183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:16.446071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:16.446791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:16.447386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:17.125003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:17.136705 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1fdaa34d-7772-4cf4-96c6-222479bd6d80 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.717728 Sep 14 09:19:17.139504 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 397/759] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:16 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:17.531321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9c8ec0a9-70a0-4a1d-a921-ef6c563c0fae tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Action: 'create', calling method: .version_select at 0x7f693fced430>, body: {"pool": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:19.662761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:19:21.433059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Updating instance_info_cache with network_info: [{"id": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d", "address": "fa:16:3e:57:4c:01", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap56d4a97b-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:19:21.460223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Releasing lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:19:21.466274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11a01133-8dd1-494c-978e-b6a808624443 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action" status: 202 len: 0 microversion: 2.1 time: 6.056864 Sep 14 09:19:21.471463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 363/760] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:15 2022] POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action => generated 0 bytes in 6063 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:19:21.502687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:21.503574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:21.518273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:21.523951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:21.524767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:21.525752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:21.528440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:21.530007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.013803 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9c8ec0a9-70a0-4a1d-a921-ef6c563c0fae tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.869520 Sep 14 09:19:22.015429 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 398/761] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:19:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:22.022514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:22.023495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:22.028043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.033327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.034415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.035269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.036265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.036641 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84b0bf04-a619-405e-afdd-80b89672899b tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1539 microversion: 2.1 time: 0.562827 Sep 14 09:19:22.037458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.038122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.045152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 364/762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:21 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1539 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:22.056233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:22.057204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:22.071927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.074835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.075608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.080947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.081791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.082535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.169015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:22.224602 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d868dcbe-c640-4333-ae8a-980d6797bc95 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1931 microversion: 2.75 time: 0.205045 Sep 14 09:19:22.228307 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 399/763] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:22 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1931 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:22.233148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.245374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.247991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.248999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a33852f-0a4c-44c9-96ba-9a94fcd19bd2", "name": "network-vif-deleted", "tag": "efded278-36be-496d-bec0-732ffc5156c3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:22.256421 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-904678b1-c40f-4109-a067-5f7e516e38e9 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.210662 Sep 14 09:19:22.257285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 365/764] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:22 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:22.272413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:22.273424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:22.277814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.278567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.279152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:22.279489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.281048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.281645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.282145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.283007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.283476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.284153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.295276 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] Creating event network-vif-deleted:efded278-36be-496d-bec0-732ffc5156c3 for instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 on n-h2-851028-12 Sep 14 09:19:22.301677 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-be996f6b-de8b-4ec9-96b0-e9a3ebe67b08 req-1a5bfd8a-1d33-45a2-b9cd-8f96bfad97c6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071562 Sep 14 09:19:22.308188 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 400/765] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:22.315646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa26f8cb-f4a0-4e68-86dd-0423d8559934", "name": "network-vif-plugged", "status": "completed", "tag": "66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:22.326213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.327095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.327755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.353114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] Creating event network-vif-plugged:66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3 for instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 on n-h1-851028-12 Sep 14 09:19:22.360149 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-907539e4-94a4-4c73-9cb2-9df275856756 req-36aabb4b-cc3b-4953-8dd5-fce679caf215 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049973 Sep 14 09:19:22.361119 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 401/766] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:22.367742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb04419-1e4e-425c-9ef9-75740dcf724c", "device": "/dev/xvdb"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:22.371456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:22.380018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.381186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.382134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.383193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.384112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.384851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.750073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:22.770826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-477dcb8e-d049-483f-9434-114742ca0501 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1388 microversion: 2.1 time: 0.512272 Sep 14 09:19:22.776359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 366/767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:22 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1388 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:22.786109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:22.815208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:22.815715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:22.816255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:22.841756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] Creating event network-changed:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:19:22.873491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-108bad1a-8348-4cd2-b0c3-87789a7a37da req-8dc97f96-ee4f-4f1d-9e58-ca87b75ddbbc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087457 Sep 14 09:19:22.874372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 367/768] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:22.890724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7cc6b121-3bef-4dc2-9a0b-e0b0808b303a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '.version_select at 0x7f693fe67820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:23.080328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-57a99b61-87a9-4526-9e13-9e2c09c156c5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.709669 Sep 14 09:19:23.081952 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 402/769] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Sep 14 09:19:22 2022] POST /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 194 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:19:23.286568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b28a1bbd-c71b-45f1-9e2c-fbc1031c679c tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fa06790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-89762874", "description": "tempest-description-1553662234"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:23.589324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7cc6b121-3bef-4dc2-9a0b-e0b0808b303a tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips/f5abd88c-4f47-4448-834d-18f44eeaa9ad" status: 200 len: 184 microversion: 2.1 time: 0.706640 Sep 14 09:19:23.590815 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 368/770] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:19:22 2022] GET /compute/v2.1/os-floating-ips/f5abd88c-4f47-4448-834d-18f44eeaa9ad => generated 184 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:23.598393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20a415cc-f110-4fd2-9592-ac95220de9f7 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Action: 'create', calling method: .version_select at 0x7f693fe01040>, body: {"pool": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:24.250444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:24.283982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b28a1bbd-c71b-45f1-9e2c-fbc1031c679c tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.200389 Sep 14 09:19:24.285222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 403/771] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:24.292202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:24.292906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:24.308419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.309576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.310178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:24.311000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.312106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.312650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:24.684347 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-073790fe-6b16-4703-b30e-10303edda7c1 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.397861 Sep 14 09:19:24.685825 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 404/772] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:19:24 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460/os-interface => generated 284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:24.692479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:24.693404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:24.713163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.714056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.714669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:24.717534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:24.728151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:24.729214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:25.106812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] Lazy-loading 'services' on Instance uuid 7c84a439-1cd7-48fe-a50c-0549e4272dd6 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:25.154649 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-04b2d343-d50c-4e01-914f-be6bdb37b916 tempest-ServersAdmin275Test-574774402 tempest-ServersAdmin275Test-574774402-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1922 microversion: 2.75 time: 0.467543 Sep 14 09:19:25.155589 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 405/773] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:24 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1922 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:25.160888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:25.161495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:25.179678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:25.180135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:25.180861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:25.182501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:25.184910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:25.185563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:25.608292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:25.618952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:25.621423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:25.634726 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a33e7979-7ed2-4652-8f3f-6526c4364007 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.478015 Sep 14 09:19:25.635335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 406/774] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:25 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:25.649127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Action: 'action', calling method: .version_select at 0x7f69454618b0>, body: {"removeFloatingIp": {"address": "172.25.4.228"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:26.079923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:26.087247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:26.088043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:26.088668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:26.093144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:26.093847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:26.094616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:26.603686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:19:26.604137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquired lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:19:27.134654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20a415cc-f110-4fd2-9592-ac95220de9f7 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.541796 Sep 14 09:19:27.144276 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 369/775] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:19:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:27.151598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:27.152879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:27.189929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:27.190841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:27.191502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:27.192358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:27.199968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:27.200723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:28.060556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:28.074676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d5d40cb-fb11-4df0-8505-cbacde5ebb38 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1587 microversion: 2.1 time: 0.928947 Sep 14 09:19:28.075761 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 370/776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:27 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1587 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:28.084658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54df2158-48fd-4e71-9ca5-bdcf72413970 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fce0820>, body: {"security_group_rule": {"parent_group_id": "3914bf56-664d-4347-b83d-54a862ffdbc0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:28.552151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Building network info cache for instance {{(pid=122443) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:19:28.922938 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54df2158-48fd-4e71-9ca5-bdcf72413970 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.844261 Sep 14 09:19:28.924704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 371/777] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:28 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:28.932776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:28.938135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:28.956106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:28.958845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:28.960858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:28.965755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:28.966795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:28.967599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:29.050287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:19:29.217441 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2681f450-61a3-43bc-9ac9-684fe890aeca tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 204 len: 0 microversion: 2.75 time: 0.290607 Sep 14 09:19:29.218048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 372/778] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:19:28 2022] DELETE /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:19:29.231880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:29.233158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:29.249521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:29.250040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:29.250511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:29.251400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:29.251863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:29.252321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:29.449512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:29.459484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:29.460978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:29.477602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-face2e6f-cfa6-4554-86a4-6e02fb37493c tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.258331 Sep 14 09:19:29.478628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 373/779] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:29 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:29.492798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6865b8ea-16eb-4958-83a9-583407022460", "tag": "3c43a081-809d-4017-9c6a-97d846370981"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:29.521902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:29.522389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:29.522838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:29.565741 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] Creating event network-changed:3c43a081-809d-4017-9c6a-97d846370981 for instance 6865b8ea-16eb-4958-83a9-583407022460 on n-h1-851028-12 Sep 14 09:19:29.579375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8ced6fb5-7826-41c6-952d-1e5f73ac44cc req-8f6322bd-ad30-4292-8c26-7a0fabd53cc2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099339 Sep 14 09:19:29.587935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 374/780] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:29.614237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05d06b76-e090-4932-82f7-95e450a7f87f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Action: 'create', calling method: .version_select at 0x7f693fd1e9d0>, body: {"pool": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:30.051616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Updating instance_info_cache with network_info: [{"id": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d", "address": "fa:16:3e:57:4c:01", "network": {"id": "96e7261f-bc7b-4692-a80d-6b913a391b83", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1982021880-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c9e67ca35d2247eb82228094d59c3023", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap56d4a97b-f1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122443) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:19:30.072527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Releasing lock "refresh_cache-bc773229-a107-4f87-a5eb-02aaa6b264e2" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:19:30.073403 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-345c7367-fa29-4f63-bda4-80fb9994a834 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action" status: 202 len: 0 microversion: 2.1 time: 4.428319 Sep 14 09:19:30.074731 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 407/781] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:19:25 2022] POST /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2/action => generated 0 bytes in 4430 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:19:30.081837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:30.090746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:30.109011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:30.110605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:30.112119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.113389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:30.114339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:30.123586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.293859 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7cba0aeb-cd86-4fd8-8bbf-5679bdff3b4e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217628 Sep 14 09:19:30.294470 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 408/782] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:19:30 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:30.299012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:30.316785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:30.317532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:30.318983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:30.347447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] Creating event network-changed:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:19:30.355186 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2d705bd7-daef-4dad-a18b-73bf7e996de1 req-f18f5320-d9a6-4520-a16b-94ff2dc93a9e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058979 Sep 14 09:19:30.356424 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 409/783] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:30.376394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64a05b56-92b3-46cf-8442-93377428315a tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693f89ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-226573178", "description": "tempest-description-262050930"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:31.227615 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64a05b56-92b3-46cf-8442-93377428315a tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.869232 Sep 14 09:19:31.228272 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 410/784] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:30 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:31.233193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:31.234141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:31.241228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:31.254246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.258479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.259399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.261300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.262041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.263663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.395516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.413823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.417487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f8c0aef81f34ce4be9295b5a18ba11b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5cb6bc7674349ee8ed58c9cec371251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.435394 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c001585e-553b-4c44-8b6f-ad8286a22c7f tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 200 len: 1444 microversion: 2.75 time: 0.205879 Sep 14 09:19:31.439388 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 411/785] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:31 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:31.468986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:31.469704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:31.479541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.482396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.484669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.488025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.488675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.489252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.528270 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] HTTP exception thrown: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Request method failure captured: Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 HTTP/1.1 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxCGXpLrXUBhFGAjlzqN03RUWXWHKscqTxzWNYGVwbihNog2q4Lvryxr0kDLJtR8alUa0YmZXmLRumkwU9YVm0rpXuN9oPsoyuvticwOUCoGA3hckisRLMZ2kY95ytwGQZjPfSk4mTGeud12hkg-qaXU52IqqrmCjNTpVfGe6MxWjk Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:31.530078 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c9e67ca35d2247eb82228094d59c3023", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c9e67ca35d2247eb82228094d59c3023"}]}] Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6099c8cee6ea42d7ade1287430035b76 Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:31.531758 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4a33852f-0a4c-44c9-96ba-9a94fcd19bd2'} Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:31.532957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:31.534488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:31.536456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Returning 404 to user: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:31.536769 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ba1adfe-a87d-4642-87b2-6298433cfbf2 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 404 len: 111 microversion: 2.1 time: 0.093842 Sep 14 09:19:31.537874 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 412/786] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:19:31 2022] DELETE /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:31.543130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:31.544052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:31.551200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.552241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.552918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.553856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:31.554537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:31.555174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:31.681054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.703270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.705253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:31.713973 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ffa9887-5450-43fd-bf91-20537c563233 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.174225 Sep 14 09:19:31.718854 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 413/787] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:31 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:31.753017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47933d20-6e44-4b52-bed4-b19760ea9110 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693f8aedc0>, body: {"security_group_rule": {"parent_group_id": "0c2b089d-7381-4304-81b4-6515506e5517", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:32.999599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05d06b76-e090-4932-82f7-95e450a7f87f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.406579 Sep 14 09:19:33.001270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 375/788] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:19:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:33.011983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:33.014757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47933d20-6e44-4b52-bed4-b19760ea9110 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.294046 Sep 14 09:19:33.023542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:33.024518 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 414/789] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:33.031255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:33.034826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] [instance: 7c84a439-1cd7-48fe-a50c-0549e4272dd6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:33.043483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.044371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.045114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.046042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.046615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.047151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.053072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.053972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.055784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.068987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.069732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.070324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.077037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] HTTP exception thrown: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Request method failure captured: Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 HTTP/1.1 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZxCGXpLrXUBhFGAjlzqN03RUWXWHKscqTxzWNYGVwbihNog2q4Lvryxr0kDLJtR8alUa0YmZXmLRumkwU9YVm0rpXuN9oPsoyuvticwOUCoGA3hckisRLMZ2kY95ytwGQZjPfSk4mTGeud12hkg-qaXU52IqqrmCjNTpVfGe6MxWjk Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:19:33.078790 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c9e67ca35d2247eb82228094d59c3023", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c9e67ca35d2247eb82228094d59c3023"}]}] Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 6099c8cee6ea42d7ade1287430035b76 Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:33.080358 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4a33852f-0a4c-44c9-96ba-9a94fcd19bd2'} Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:33.081076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. Sep 14 09:19:33.082235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.083316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Returning 404 to user: Instance 4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:33.083316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a8b42dc-96ce-4456-a9f9-d3d4ccca8345 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2" status: 404 len: 111 microversion: 2.1 time: 0.077449 Sep 14 09:19:33.083316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 376/790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:33 2022] GET /compute/v2.1/servers/4a33852f-0a4c-44c9-96ba-9a94fcd19bd2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:33.098712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:33.099392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:33.100764 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] HTTP exception thrown: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Request method failure captured: Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 HTTP/1.1 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxK_8WEono54VA6jAPYHoayZ-Y-n_cFxMgr07kKE_SdyMydRqOxC6V-486Bd0lKL71Yg-oGoK5ckCUuXfpeX3yTJwVKALdy-EHhmoyDJUjxcJCf9RE7eaYKh5DHSFbKB9oUsufYAx-GWBarYTHG_V0AkmGsvxM5KdforH5WzYUKSC8 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.75 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c5cb6bc7674349ee8ed58c9cec371251 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdmin275Test-1504660914 Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:33.102693 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c5cb6bc7674349ee8ed58c9cec371251", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c5cb6bc7674349ee8ed58c9cec371251"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c5cb6bc7674349ee8ed58c9cec371251"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c5cb6bc7674349ee8ed58c9cec371251"}]}] Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdmin275Test-1504660914 Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c5cb6bc7674349ee8ed58c9cec371251 Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdmin275Test-1504660914 Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdmin275Test-1504660914-project Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4f8c0aef81f34ce4be9295b5a18ba11b Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdmin275Test-1504660914-project Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. Sep 14 09:19:33.104383 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '7c84a439-1cd7-48fe-a50c-0549e4272dd6'} Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:33.105153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. Sep 14 09:19:33.106301 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:33.108693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] Returning 404 to user: Instance 7c84a439-1cd7-48fe-a50c-0549e4272dd6 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:33.109793 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e7cb0bad-41b8-4375-92d9-54ca8c7ff302 tempest-ServersAdmin275Test-1504660914 tempest-ServersAdmin275Test-1504660914-project] 10.222.0.90 "GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6" status: 404 len: 111 microversion: 2.75 time: 0.084082 Sep 14 09:19:33.111743 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 415/791] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:33 2022] GET /compute/v2.1/servers/7c84a439-1cd7-48fe-a50c-0549e4272dd6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:19:33.116693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.117206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.117645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.118357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.119990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.122455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.127685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:33.128893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:33.145039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.147355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.148015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.148922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.149546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.150143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.294457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:33.303830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:33.309361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:33.330381 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-60e0d106-b8cd-47c4-9584-5eafd5fe4025 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.217310 Sep 14 09:19:33.331492 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 416/792] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:33 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:33.337240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa26f8cb-f4a0-4e68-86dd-0423d8559934", "tag": "66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:33.359160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:33.360486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:33.367116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:33.391002 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] Creating event network-changed:66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3 for instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 on n-h1-851028-12 Sep 14 09:19:33.399696 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2e5cd42e-b0ba-4940-95f1-92f934d4cfce req-475b4f85-ebe6-44fd-b62e-d25cfe11c118 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066659 Sep 14 09:19:33.402812 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 417/793] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:33.412289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4a0e340-c82b-4fc4-ba65-291acea3a213 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Action: 'create', calling method: .version_select at 0x7f693f89f0d0>, body: {"pool": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:33.472118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:33.488366 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-226de071-5ed0-4af0-8ecb-d7f440eedf08 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1587 microversion: 2.1 time: 0.404083 Sep 14 09:19:33.504732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 377/794] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:33 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1587 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:33.515959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-752e6205-c11b-4949-a640-4ff804ac8975 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fcfe5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-859842638", "description": "tempest-description-988812942"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:34.283844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-752e6205-c11b-4949-a640-4ff804ac8975 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.777296 Sep 14 09:19:34.285939 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 378/795] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:33 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:34.294680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ee55f10-d0fa-46d9-93c6-d7f1a92d1154 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '.version_select at 0x7f693fd453a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:36.833412 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4a0e340-c82b-4fc4-ba65-291acea3a213 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.424544 Sep 14 09:19:36.836226 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 418/796] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:19:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:36.847366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a5e2237-28c8-4e80-8f52-1c39b1aae407 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693f884ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-336205584", "description": "tempest-description-2122305782"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:36.971369 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ee55f10-d0fa-46d9-93c6-d7f1a92d1154 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/f5abd88c-4f47-4448-834d-18f44eeaa9ad" status: 202 len: 0 microversion: 2.1 time: 2.684078 Sep 14 09:19:36.975589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 379/797] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:19:34 2022] DELETE /compute/v2.1/os-floating-ips/f5abd88c-4f47-4448-834d-18f44eeaa9ad => generated 0 bytes in 2686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:36.978027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:36.978717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:36.999655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.002299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.004033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.005019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.005562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.006009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.101599 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9a5e2237-28c8-4e80-8f52-1c39b1aae407 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.263572 Sep 14 09:19:37.102222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 419/798] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:37.107507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-def4793c-8c20-4408-8668-222a959a5b6f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693f9620d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:37.154052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:37.181556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:37.188154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:37.196853 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0e17b02-5850-4789-89d5-8055b7d2b7a4 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.223089 Sep 14 09:19:37.211923 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 380/799] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:36 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:37.211923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:37.211923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:37.215854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.216703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.217495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.218432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.219158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.220852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.263173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:19:37.422984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72fdc6f4-2cd6-4097-8d96-7fa5b662e593 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 204 len: 0 microversion: 2.1 time: 0.220140 Sep 14 09:19:37.425354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 381/800] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:19:37 2022] DELETE /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:19:37.432700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1920d6e9-83b9-4263-80e3-8f38d5f063b5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fe01ee0>, body: {"security_group_rule": {"parent_group_id": "f5e667c2-1efe-4d9d-a7ae-192284be93b2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c3452b8a-3525-4eae-9297-57b5a7a54633"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:37.449957 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-def4793c-8c20-4408-8668-222a959a5b6f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips/696f3bd8-170e-45e2-bdc7-3020db1cd835" status: 200 len: 141 microversion: 2.1 time: 0.346287 Sep 14 09:19:37.450537 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 420/801] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:19:37 2022] GET /compute/v2.1/os-floating-ips/696f3bd8-170e-45e2-bdc7-3020db1cd835 => generated 141 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:37.464193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:37.465126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:37.473916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.474812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.475568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.477732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:37.478633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:37.479331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:37.756523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:37.765438 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d1afd965-0628-4fa6-9a55-3b8c4c9524aa tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1526 microversion: 2.1 time: 0.311016 Sep 14 09:19:37.767313 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 421/802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:37 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1526 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:37.771978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9e2248cd-1f7b-4648-8548-98fe3c618867 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693f884940>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:38.042590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1920d6e9-83b9-4263-80e3-8f38d5f063b5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.615096 Sep 14 09:19:38.043385 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 382/803] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:37 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:38.223818 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21c74366-9af0-47a2-bca7-9ddeebc877f9 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.178859 Sep 14 09:19:38.224766 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 383/804] 10.222.0.90 () {58 vars in 1128 bytes} [Wed Sep 14 09:19:38 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:19:38.230941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab6b3031-d7ee-426f-aade-029c0010ba90 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fd459d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-64885152", "description": "tempest-description-284020936"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:38.639552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab6b3031-d7ee-426f-aade-029c0010ba90 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.413374 Sep 14 09:19:38.640238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 384/805] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:38 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:38.646638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ca167c6-14b1-4637-b19e-4870296cb65e tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Calling method '.version_select at 0x7f693fb78a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:38.707747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1ca167c6-14b1-4637-b19e-4870296cb65e tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] HTTP exception thrown: Image not found. Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ca167c6-14b1-4637-b19e-4870296cb65e tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Request method failure captured: Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZypjrjFJeUoN695uUJAXn3xgXYk_ttRp_jLl3oAv1Vpqh8iCcoR3PsviQdFc_-WeX_hM8KMgB8rc__bMmL42PQdd1RizprWXDjdU_ud4l902R3SxfwGYHbSGoW_9i3rfaSL_hph6MYaitzI-TNPHtZyk5uCYBW91Y-lJ301zHTVd9c Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:19:38.712114 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a94bb80b14bd403d99386e3ff161b155", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a94bb80b14bd403d99386e3ff161b155"}]}] Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d4800c7fd4d34e4f950b029e85e3d41b Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '-1'} Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:38.713513 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.714407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:38.715781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ca167c6-14b1-4637-b19e-4870296cb65e tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ca167c6-14b1-4637-b19e-4870296cb65e tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.072248 Sep 14 09:19:38.721849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 385/806] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Sep 14 09:19:38 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:38.738945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:38.740535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:38.758311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:38.759150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:38.760634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:38.761730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:38.762439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:38.763063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:38.881547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:38.893388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:38.895156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:38.902491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1366e985-aa7c-453e-b068-7bc3060edd2e tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.179068 Sep 14 09:19:38.921051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 386/807] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:38 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:38.932471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e5418d6-cabc-4d9d-a2b4-70ec8489cc59 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fc36700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1886173337", "description": "tempest-description-1867666783"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:39.019165 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9e2248cd-1f7b-4648-8548-98fe3c618867 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/696f3bd8-170e-45e2-bdc7-3020db1cd835" status: 202 len: 0 microversion: 2.1 time: 1.250642 Sep 14 09:19:39.020733 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 422/808] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:19:37 2022] DELETE /compute/v2.1/os-floating-ips/696f3bd8-170e-45e2-bdc7-3020db1cd835 => generated 0 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:39.027613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3492038-f687-47ae-8787-dcdb1ef4b55d tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Calling method '.version_select at 0x7f693f8a9820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.062838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a3492038-f687-47ae-8787-dcdb1ef4b55d tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] HTTP exception thrown: Image not found. Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3492038-f687-47ae-8787-dcdb1ef4b55d tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Request method failure captured: Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/images/bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj HTTP/1.1 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZypjrjFJeUoN695uUJAXn3xgXYk_ttRp_jLl3oAv1Vpqh8iCcoR3PsviQdFc_-WeX_hM8KMgB8rc__bMmL42PQdd1RizprWXDjdU_ud4l902R3SxfwGYHbSGoW_9i3rfaSL_hph6MYaitzI-TNPHtZyk5uCYBW91Y-lJ301zHTVd9c Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:39.065732 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a94bb80b14bd403d99386e3ff161b155", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a94bb80b14bd403d99386e3ff161b155"}]}] Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d4800c7fd4d34e4f950b029e85e3d41b Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: exception: Image not found. Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj'} Sep 14 09:19:39.067088 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj to delete Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.067934 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj could not be found. Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:39.069118 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:19:39.070281 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.072735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3492038-f687-47ae-8787-dcdb1ef4b55d tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Returning 404 to user: Image not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:39.073824 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a3492038-f687-47ae-8787-dcdb1ef4b55d tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj" status: 404 len: 62 microversion: 2.1 time: 0.051913 Sep 14 09:19:39.074516 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 423/809] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:39 2022] DELETE /compute/v2.1/images/bf540d3d-2a59-4b80-8a5b-e6e0ab16fcfj => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:39.085241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.086263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:39.092919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:39.093725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:39.094257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:39.095621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:39.096216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:39.096757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:39.113629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:39.214243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e5418d6-cabc-4d9d-a2b4-70ec8489cc59 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.290443 Sep 14 09:19:39.223189 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 387/810] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:38 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:39.227462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce99a40a-8bca-4813-a82e-847f883c5c65 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693fe01430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.455494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:39.463884 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d097ea3b-8630-4b25-a6e3-09c37d38505c tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1526 microversion: 2.1 time: 0.383583 Sep 14 09:19:39.476017 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 424/811] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:39 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1526 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:39.480093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e5da7de3-5d08-470c-a747-f9c1fd4c3d31 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Calling method '.version_select at 0x7f693f8aeee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.487087 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce99a40a-8bca-4813-a82e-847f883c5c65 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.270492 Sep 14 09:19:39.487793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 388/812] 10.222.0.90 () {58 vars in 1164 bytes} [Wed Sep 14 09:19:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:19:39.493802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9edb92ca-6b48-4f37-bf4a-70aa938ffc3b tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fe67c10>, body: {"security_group_rule": {"parent_group_id": "0dfbab3b-cbd0-48e1-a03c-aff0e903b3cf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e1d5cd9b-2fd0-43aa-834d-8c87d6485e21"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:39.520251 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-e5da7de3-5d08-470c-a747-f9c1fd4c3d31 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] HTTP exception thrown: Image not found. Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e5da7de3-5d08-470c-a747-f9c1fd4c3d31 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Request method failure captured: Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/images/eb135a4e-222a-4ea4-828e-207d453e09891 HTTP/1.1 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZypjrjFJeUoN695uUJAXn3xgXYk_ttRp_jLl3oAv1Vpqh8iCcoR3PsviQdFc_-WeX_hM8KMgB8rc__bMmL42PQdd1RizprWXDjdU_ud4l902R3SxfwGYHbSGoW_9i3rfaSL_hph6MYaitzI-TNPHtZyk5uCYBW91Y-lJ301zHTVd9c Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:39.522059 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a94bb80b14bd403d99386e3ff161b155", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a94bb80b14bd403d99386e3ff161b155"}]}] Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d4800c7fd4d34e4f950b029e85e3d41b Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: exception: Image not found. Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'eb135a4e-222a-4ea4-828e-207d453e09891'} Sep 14 09:19:39.523461 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb135a4e-222a-4ea4-828e-207d453e09891 to delete Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.524268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb135a4e-222a-4ea4-828e-207d453e09891 could not be found. Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:39.525348 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e5da7de3-5d08-470c-a747-f9c1fd4c3d31 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Returning 404 to user: Image not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:39.526496 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e5da7de3-5d08-470c-a747-f9c1fd4c3d31 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/eb135a4e-222a-4ea4-828e-207d453e09891" status: 404 len: 62 microversion: 2.1 time: 0.057611 Sep 14 09:19:39.530453 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 425/813] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:19:39 2022] DELETE /compute/v2.1/images/eb135a4e-222a-4ea4-828e-207d453e09891 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:39.536384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10b30a12-67fe-4323-97d9-47be528587b8 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693f8ae940>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.774227 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10b30a12-67fe-4323-97d9-47be528587b8 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.242566 Sep 14 09:19:39.785632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 426/814] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:19:39 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:39.791643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-14ef6896-2da7-4546-8d5a-44400d11002f tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Calling method '.version_select at 0x7f693f9620d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:39.822326 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-14ef6896-2da7-4546-8d5a-44400d11002f tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] HTTP exception thrown: Image not found. Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-14ef6896-2da7-4546-8d5a-44400d11002f tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Request method failure captured: Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/images/tempest-invalid-827812778 HTTP/1.1 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZypjrjFJeUoN695uUJAXn3xgXYk_ttRp_jLl3oAv1Vpqh8iCcoR3PsviQdFc_-WeX_hM8KMgB8rc__bMmL42PQdd1RizprWXDjdU_ud4l902R3SxfwGYHbSGoW_9i3rfaSL_hph6MYaitzI-TNPHtZyk5uCYBW91Y-lJ301zHTVd9c Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:39.824198 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a94bb80b14bd403d99386e3ff161b155", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a94bb80b14bd403d99386e3ff161b155"}]}] Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d4800c7fd4d34e4f950b029e85e3d41b Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: exception: Image not found. Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'tempest-invalid-827812778'} Sep 14 09:19:39.825779 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-827812778 to delete Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.826694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-827812778 could not be found. Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:39.828016 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-14ef6896-2da7-4546-8d5a-44400d11002f tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Returning 404 to user: Image not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:39.830083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-14ef6896-2da7-4546-8d5a-44400d11002f tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/tempest-invalid-827812778" status: 404 len: 62 microversion: 2.1 time: 0.038665 Sep 14 09:19:39.831201 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 427/815] 10.222.0.90 () {58 vars in 1203 bytes} [Wed Sep 14 09:19:39 2022] DELETE /compute/v2.1/images/tempest-invalid-827812778 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:39.840182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0469187b-f9e9-4967-a882-c202488abe55 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693fa06550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:40.041490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9edb92ca-6b48-4f37-bf4a-70aa938ffc3b tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.552423 Sep 14 09:19:40.042036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 389/816] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:39 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:40.058455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c831bc84-cc51-44be-a4fe-9fb36237a508 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Calling method '.version_select at 0x7f693fc52820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:40.084828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c831bc84-cc51-44be-a4fe-9fb36237a508 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] HTTP exception thrown: Image not found. Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c831bc84-cc51-44be-a4fe-9fb36237a508 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Request method failure captured: Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/7d870518-42e2-4207-82e9-68489a9bdd9d HTTP/1.1 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZypjrjFJeUoN695uUJAXn3xgXYk_ttRp_jLl3oAv1Vpqh8iCcoR3PsviQdFc_-WeX_hM8KMgB8rc__bMmL42PQdd1RizprWXDjdU_ud4l902R3SxfwGYHbSGoW_9i3rfaSL_hph6MYaitzI-TNPHtZyk5uCYBW91Y-lJ301zHTVd9c Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:19:40.087542 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a94bb80b14bd403d99386e3ff161b155", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a94bb80b14bd403d99386e3ff161b155"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a94bb80b14bd403d99386e3ff161b155"}]}] Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: a94bb80b14bd403d99386e3ff161b155 Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-201476283 Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d4800c7fd4d34e4f950b029e85e3d41b Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-201476283-project Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7d870518-42e2-4207-82e9-68489a9bdd9d'} Sep 14 09:19:40.089394 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7d870518-42e2-4207-82e9-68489a9bdd9d to delete Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:40.090161 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7d870518-42e2-4207-82e9-68489a9bdd9d could not be found. Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:40.091254 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c831bc84-cc51-44be-a4fe-9fb36237a508 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:40.092471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c831bc84-cc51-44be-a4fe-9fb36237a508 tempest-ImagesDeleteNegativeTestJSON-201476283 tempest-ImagesDeleteNegativeTestJSON-201476283-project] 10.222.0.90 "DELETE /compute/v2.1/images/7d870518-42e2-4207-82e9-68489a9bdd9d" status: 404 len: 62 microversion: 2.1 time: 0.038785 Sep 14 09:19:40.093354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 390/817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:40 2022] DELETE /compute/v2.1/images/7d870518-42e2-4207-82e9-68489a9bdd9d => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:19:40.097643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:40.098578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:40.106249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:40.106835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:40.107348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:40.108437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:40.108982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:40.109528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:40.196013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:40.199250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:40.213860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:40.215364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:40.222592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a7f7bda-6f4b-4ccf-ba1e-25781684b15d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1551 microversion: 2.91 time: 0.131346 Sep 14 09:19:40.224181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 391/818] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:40 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1551 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:40.229958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ddeaf37-98fd-40f4-9d44-2a790dc8e658 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693fd1e5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.075352 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ddeaf37-98fd-40f4-9d44-2a790dc8e658 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/e1d5cd9b-2fd0-43aa-834d-8c87d6485e21" status: 202 len: 0 microversion: 2.1 time: 0.849930 Sep 14 09:19:41.075971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 392/819] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:40 2022] DELETE /compute/v2.1/os-security-groups/e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:41.082284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.082997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:41.096395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.097263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.097964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.099031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.099706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.100612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.525154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:41.538155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf745dce-4ee2-4b8d-9190-0669e97c6b75 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1526 microversion: 2.1 time: 0.460865 Sep 14 09:19:41.540723 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 393/820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:41 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1526 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:41.552233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b3c5f81-99a1-40d6-ba66-965044a17721 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693fcc8af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.559538 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0469187b-f9e9-4967-a882-c202488abe55 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/3d2af5f7-5c9a-41f5-9f0f-3873c95443eb" status: 202 len: 0 microversion: 2.1 time: 1.732243 Sep 14 09:19:41.560347 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 428/821] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:19:39 2022] DELETE /compute/v2.1/os-floating-ips/3d2af5f7-5c9a-41f5-9f0f-3873c95443eb => generated 0 bytes in 1734 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:41.568256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.568881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:41.581087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.582747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.586616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.587956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.588698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.589321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.627199 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b3c5f81-99a1-40d6-ba66-965044a17721 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/0dfbab3b-cbd0-48e1-a03c-aff0e903b3cf" status: 200 len: 245 microversion: 2.1 time: 0.084990 Sep 14 09:19:41.627450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 394/822] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:19:41 2022] GET /compute/v2.1/os-security-groups/0dfbab3b-cbd0-48e1-a03c-aff0e903b3cf => generated 245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:41.641777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.642565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:41.653584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.654969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.655458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.656516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.658184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.659445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.698304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:41.708868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:41.711033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:41.717636 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07c9876e-75d9-4d55-99c5-54e4ea567424 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1533 microversion: 2.91 time: 0.155653 Sep 14 09:19:41.720011 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 429/823] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:41 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1533 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:41.725637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc773229-a107-4f87-a5eb-02aaa6b264e2", "name": "network-vif-deleted", "tag": "56d4a97b-f1bc-4c60-be50-087c7d4ca43d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:41.736984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:41.737720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:41.738316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:41.753184 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] Creating event network-vif-deleted:56d4a97b-f1bc-4c60-be50-087c7d4ca43d for instance bc773229-a107-4f87-a5eb-02aaa6b264e2 on n-h1-851028-12 Sep 14 09:19:41.760527 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7bc9f271-05f2-4d9b-b2c1-158a9f026ee4 req-dd9fe56d-808e-404b-a923-dccd30d28554 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Sep 14 09:19:41.762500 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 430/824] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:41.769187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28e33524-10a3-452a-a2c9-0f5211f5bc18 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693f8464c0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:41.923957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:41.945649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b387486-d2eb-4a6b-a75a-20ef7792f48a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 2424 microversion: 2.25 time: 0.316098 Sep 14 09:19:41.947353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 395/825] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:41 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 2424 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:41.954938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-28b5d7f2-e00c-4e20-bf44-88f9b5bd46f2 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fd91ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-228923472", "description": "tempest-description-1815533601"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:42.372805 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-28b5d7f2-e00c-4e20-bf44-88f9b5bd46f2 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.423620 Sep 14 09:19:42.381627 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 396/826] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:19:41 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:42.395744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": "auto"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:42.401646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:42.419521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:42.420558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:42.421234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:42.422013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:42.424370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:42.424370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:42.522615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'flavor' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:42.539647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:19:42.806771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28e33524-10a3-452a-a2c9-0f5211f5bc18 tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/52014ca6-275f-4b34-8b4e-2d078414ec7b" status: 202 len: 0 microversion: 2.1 time: 1.043024 Sep 14 09:19:42.807805 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 431/827] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:19:41 2022] DELETE /compute/v2.1/os-floating-ips/52014ca6-275f-4b34-8b4e-2d078414ec7b => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:42.812617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ebfef4e-6ade-4d97-bec6-4eebef8eddbc tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693f884af0>, body: {"security_group_rule": {"parent_group_id": "2700dd1b-61c4-4248-b36a-ddff8b1e0e9c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:43.012134 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ebfef4e-6ade-4d97-bec6-4eebef8eddbc tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.202995 Sep 14 09:19:43.012720 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 432/828] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:43.020821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:43.021662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:43.028776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.029356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.029907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.030937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.031404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.032803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.074960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.075536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.076068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.077232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lazy-loading 'fault' on Instance uuid bc773229-a107-4f87-a5eb-02aaa6b264e2 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:19:43.126603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6099c8cee6ea42d7ade1287430035b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9e67ca35d2247eb82228094d59c3023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:43.134998 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ef85adc-00ce-40c7-9139-1c273836bbcb tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 200 len: 1314 microversion: 2.1 time: 0.121261 Sep 14 09:19:43.135584 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 433/829] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:43 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 1314 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:43.140125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:43.140720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:43.148076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.148611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.149048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.149782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:43.150241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:43.150665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:43.228513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:43.243763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:43.245651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:43.253630 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b7c35cf8-abfa-4c38-977f-82a8f7070702 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1533 microversion: 2.91 time: 0.116965 Sep 14 09:19:43.256155 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 434/830] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:43 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1533 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:43.266279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c4f89f8-0d94-456a-80a5-d69493ef4b3f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] Calling method '.version_select at 0x7f693f89f9d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:43.831382 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-381b107d-1768-4ab0-9741-8994a2e7bc43 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/action" status: 202 len: 0 microversion: 2.25 time: 1.447789 Sep 14 09:19:43.833318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 397/831] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:19:42 2022] POST /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/action => generated 0 bytes in 1451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:19:43.838952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc63691a-8068-4a87-a584-7bed10d782d6 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Action: 'create', calling method: .version_select at 0x7f693fe018b0>, body: {"security_group_rule": {"parent_group_id": "2700dd1b-61c4-4248-b36a-ddff8b1e0e9c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:44.399367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc63691a-8068-4a87-a584-7bed10d782d6 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.564407 Sep 14 09:19:44.400237 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 398/832] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:19:43 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:44.411275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.412697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:44.420413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.421057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.421596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.422683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.423270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.423798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.660515 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c4f89f8-0d94-456a-80a5-d69493ef4b3f tempest-FloatingIPDetailsTestJSON-1424858346 tempest-FloatingIPDetailsTestJSON-1424858346-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/f2205303-57c6-49ea-bbb0-f1a50e73e0fe" status: 202 len: 0 microversion: 2.1 time: 1.399591 Sep 14 09:19:44.661190 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 435/833] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:19:43 2022] DELETE /compute/v2.1/os-floating-ips/f2205303-57c6-49ea-bbb0-f1a50e73e0fe => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:44.666165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.667256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] [instance: bc773229-a107-4f87-a5eb-02aaa6b264e2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:44.674288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.675057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.675482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.676354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.676693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.677119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.692347 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] HTTP exception thrown: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Request method failure captured: Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 HTTP/1.1 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZxCGXpLrXUBhFGAjlzqN03RUWXWHKscqTxzWNYGVwbihNog2q4Lvryxr0kDLJtR8alUa0YmZXmLRumkwU9YVm0rpXuN9oPsoyuvticwOUCoGA3hckisRLMZ2kY95ytwGQZjPfSk4mTGeud12hkg-qaXU52IqqrmCjNTpVfGe6MxWjk Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:19:44.694039 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c9e67ca35d2247eb82228094d59c3023", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c9e67ca35d2247eb82228094d59c3023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c9e67ca35d2247eb82228094d59c3023"}]}] Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c9e67ca35d2247eb82228094d59c3023 Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1463461416 Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6099c8cee6ea42d7ade1287430035b76 Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1463461416-project Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. Sep 14 09:19:44.695466 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'bc773229-a107-4f87-a5eb-02aaa6b264e2'} Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:44.698538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. Sep 14 09:19:44.699987 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:19:44.701066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] Returning 404 to user: Instance bc773229-a107-4f87-a5eb-02aaa6b264e2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:44.701066 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-584dc48f-05d9-4f8e-8e5f-f24538395843 tempest-FloatingIPsAssociationTestJSON-1463461416 tempest-FloatingIPsAssociationTestJSON-1463461416-project] 10.222.0.90 "GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2" status: 404 len: 111 microversion: 2.1 time: 0.033164 Sep 14 09:19:44.701066 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 436/834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/servers/bc773229-a107-4f87-a5eb-02aaa6b264e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:44.705812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.706429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:44.710486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.715411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.716306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.716790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.717532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.718565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.719006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.725991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.744466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.750695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d7aed44e-3096-4dd9-a06b-3eb0c4584fa6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.348575 Sep 14 09:19:44.757644 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 399/835] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:44.763803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1c8826a-1320-4b5e-b56d-7ec11ba38255 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f694408b5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.823541 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1c8826a-1320-4b5e-b56d-7ec11ba38255 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121" status: 200 len: 661 microversion: 2.1 time: 0.064132 Sep 14 09:19:44.824874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 400/836] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121 => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:44.831957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ce0961d-4c7f-4e1b-ade1-ab15bf0197a0 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693fb000d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.863577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.873601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.875333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:44.882630 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8326f234-5582-4713-b747-9ebf884c0b99 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1476 microversion: 2.91 time: 0.185161 Sep 14 09:19:44.883217 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 437/837] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:44.900246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94dc86c0-4374-45b8-8c0d-25695d160de8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f89a820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:44.950825 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94dc86c0-4374-45b8-8c0d-25695d160de8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121" status: 200 len: 661 microversion: 2.1 time: 0.066293 Sep 14 09:19:44.951655 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 438/838] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:44.957195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:44.960359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:44.970034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.971082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.971879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.972828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:44.973302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:44.973734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:44.983061 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ce0961d-4c7f-4e1b-ade1-ab15bf0197a0 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/2700dd1b-61c4-4248-b36a-ddff8b1e0e9c" status: 200 len: 664 microversion: 2.1 time: 0.156777 Sep 14 09:19:44.983642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 401/839] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:19:44 2022] GET /compute/v2.1/os-security-groups/2700dd1b-61c4-4248-b36a-ddff8b1e0e9c => generated 664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:44.997892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afdf3a8d-1e93-4044-bd28-0c70486c837a tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693fe01310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:45.055634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-851028-12". {{(pid=122443) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:19:45.178290 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8e258671-1886-4f05-99a7-1d6510d37401 tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action" status: 202 len: 0 microversion: 2.91 time: 0.225189 Sep 14 09:19:45.182512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 439/840] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:19:44 2022] POST /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:19:45.187768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:45.189312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:45.196886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.197590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.198194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.199095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.199716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.200331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.382744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:45.394444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:45.396761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:45.403133 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ce81d6c8-436b-40c3-b78c-98d697fc48bb tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1484 microversion: 2.91 time: 0.219308 Sep 14 09:19:45.413287 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 440/841] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:45 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1484 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:45.557934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afdf3a8d-1e93-4044-bd28-0c70486c837a tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-group-rules/410f7553-09cd-4a04-962d-247214ff2c84" status: 202 len: 0 microversion: 2.1 time: 0.563112 Sep 14 09:19:45.559548 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 402/842] 10.222.0.90 () {58 vars in 1287 bytes} [Wed Sep 14 09:19:44 2022] DELETE /compute/v2.1/os-security-group-rules/410f7553-09cd-4a04-962d-247214ff2c84 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:45.570758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92cea589-2184-4a9b-a798-457a5efa0ce4 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693f8aeaf0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:45.787462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:45.788990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:45.796956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.797815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.798433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:45.799764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:45.800428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:45.801011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:46.776547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92cea589-2184-4a9b-a798-457a5efa0ce4 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/2700dd1b-61c4-4248-b36a-ddff8b1e0e9c" status: 202 len: 0 microversion: 2.1 time: 1.209799 Sep 14 09:19:46.777179 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 441/843] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:45 2022] DELETE /compute/v2.1/os-security-groups/2700dd1b-61c4-4248-b36a-ddff8b1e0e9c => generated 0 bytes in 1211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:46.788529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:46.793893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:46.806137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:46.807165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:46.808220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:46.809448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:46.810173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:46.810835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:46.861226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:46.882008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:46.883484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:46.884755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0a9e5ea-ae4d-4b7e-b9c7-3b5f38792a7b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.103074 Sep 14 09:19:46.885643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 403/844] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:45 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:19:46.890279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83bcd731-176f-4711-8b21-a94ce59ad3a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fb00b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:46.966682 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83bcd731-176f-4711-8b21-a94ce59ad3a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0" status: 200 len: 661 microversion: 2.1 time: 0.079962 Sep 14 09:19:46.967839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 404/845] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:46 2022] GET /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0 => generated 661 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:46.973171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f69442273a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:47.085614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:47.103645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:47.106525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:47.109655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:19:47.110295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Neutron security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:19:47.110836 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] HTTP exception thrown: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.110836 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Request method failure captured: Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 HTTP/1.1 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZyZGPSRmDo7PRYwbYOoUlBnhnPX8tIEj2bNCshVJltxNtDmUrphd0TWmDb8I610xN0JKDOS0-UIxXEVN_QQPJ7bI14qcoSqoxz8IU2ghKZFX2SpZKMQwGWojo7Z2pGmrYMQ1dBBTODA-_c60POZJb1KaZnDlPqRXGh8jTmV11EoLNE Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: bedc58e854bd409d9f5b5d80b832bd18 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-597666152 Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:19:47.114284 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_bedc58e854bd409d9f5b5d80b832bd18", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bedc58e854bd409d9f5b5d80b832bd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/bedc58e854bd409d9f5b5d80b832bd18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/bedc58e854bd409d9f5b5d80b832bd18"}]}] Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupRulesTestJSON-597666152 Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: bedc58e854bd409d9f5b5d80b832bd18 Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-597666152 Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupRulesTestJSON-597666152-project Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 2ed91278dd524d65ab6ca601d0013c94 Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupRulesTestJSON-597666152-project Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.116021 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e1d5cd9b-2fd0-43aa-834d-8c87d6485e21'} Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:19:47.117124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:19:47.129860 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.133634 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Returning 404 to user: Security group e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 does not exist Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-95b12d15-31dc-4cf8-8ba3-20a52d43d729'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d30ded1-26ce-47a3-be6c-fe8086300c53 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/e1d5cd9b-2fd0-43aa-834d-8c87d6485e21" status: 404 len: 194 microversion: 2.1 time: 0.148489 Sep 14 09:19:47.139226 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 405/846] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:46 2022] DELETE /compute/v2.1/os-security-groups/e1d5cd9b-2fd0-43aa-834d-8c87d6485e21 => generated 194 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:19:47.145109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3519002-5c74-4f28-8bfe-2953659fb03d tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.366492 Sep 14 09:19:47.159860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73914523-0ead-4d50-97ba-9b342abc0bea tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fe011f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:47.188877 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 442/847] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:46 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:47.202001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a141a3a-13df-489f-93d0-107718fa608b tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693f8ae1f0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:47.247195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73914523-0ead-4d50-97ba-9b342abc0bea tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0" status: 200 len: 661 microversion: 2.1 time: 0.127281 Sep 14 09:19:47.248136 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 406/848] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:47 2022] GET /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0 => generated 661 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:47.937798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:47.942052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:47.976457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:47.979911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:47.983721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:47.986996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:47.990521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:47.992372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.654106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:48.674705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:48.676207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:48.677602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e58d21b-ef1b-41c1-a5c1-3a69b8cc988a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.750654 Sep 14 09:19:48.678202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 407/849] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:47 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:48.700277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:48.713252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:48.737972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.738481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.738927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:48.739706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:48.755944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:48.756468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:49.127952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:49.151845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:49.162363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:49.194713 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db493720-c962-41de-8014-65f9e0835810 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.515087 Sep 14 09:19:49.201166 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 408/850] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:48 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:49.238031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cecacece-a275-4eea-b026-d5bb73c27d1e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f694408b1f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:49.264351 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a141a3a-13df-489f-93d0-107718fa608b tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/0dfbab3b-cbd0-48e1-a03c-aff0e903b3cf" status: 202 len: 0 microversion: 2.1 time: 2.079642 Sep 14 09:19:49.265613 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 443/851] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:47 2022] DELETE /compute/v2.1/os-security-groups/0dfbab3b-cbd0-48e1-a03c-aff0e903b3cf => generated 0 bytes in 2082 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:49.284199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fc5e202-f531-4809-a08d-b0f684965e88 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693f8a9dc0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:49.382205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cecacece-a275-4eea-b026-d5bb73c27d1e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677" status: 200 len: 662 microversion: 2.1 time: 0.177881 Sep 14 09:19:49.392810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 409/852] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:49 2022] GET /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677 => generated 662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:49.397936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3e1475f-3693-43e6-9045-ae42b4b84a67 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fcfeb80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:49.500085 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3e1475f-3693-43e6-9045-ae42b4b84a67 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677" status: 200 len: 662 microversion: 2.1 time: 0.105949 Sep 14 09:19:49.503747 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 410/853] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:19:49 2022] GET /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677 => generated 662 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:19:49.595172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-171963869", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:49.687228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:19:50.804075 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fc5e202-f531-4809-a08d-b0f684965e88 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/c3452b8a-3525-4eae-9297-57b5a7a54633" status: 202 len: 0 microversion: 2.1 time: 1.533602 Sep 14 09:19:50.806279 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 444/854] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:49 2022] DELETE /compute/v2.1/os-security-groups/c3452b8a-3525-4eae-9297-57b5a7a54633 => generated 0 bytes in 1537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:19:50.815834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:50.817938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:50.842431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:50.843944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:50.845338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:50.846917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:50.848681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:50.849569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:50.910965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:50.912205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:50.912935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:50.913506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:50.914080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:50.931232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:50.933765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:50.935013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:50.939527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:50.940289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:50.940915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:50.988669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Getting quotas for project d5ef9cdd87e4431ea8786e438a1a8061. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:51.006512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Getting quotas for user 8b93052ba3ce4f8cbecef7added9207e and project d5ef9cdd87e4431ea8786e438a1a8061. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:51.022799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:51.026578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:51.176330 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f3c8df8-84cc-49ed-84a4-952d6f6e717d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585697 Sep 14 09:19:51.177541 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 411/855] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:19:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:19:51.182682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:51.183509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:51.191953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:51.193406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:51.194865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:51.195866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:51.196509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:51.197101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:51.395185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:51.404742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:51.407325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:51.418862 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22ff9a81-8158-4aca-88aa-a2638ac739e7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.240063 Sep 14 09:19:51.420317 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 412/856] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:51 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:51.426354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-388df10b-38d8-46df-b56d-4dad30b8c2c5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f6944125160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:51.980958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:52.013691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:52.015160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:52.039914 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83340c3e-16f1-470a-9305-0709263393f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.208688 Sep 14 09:19:52.066785 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 445/857] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:50 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:52.082569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1842747210", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:19:52.247198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:19:52.248819 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-388df10b-38d8-46df-b56d-4dad30b8c2c5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/f5e667c2-1efe-4d9d-a7ae-192284be93b2" status: 202 len: 0 microversion: 2.1 time: 0.827214 Sep 14 09:19:52.250037 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 413/858] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:51 2022] DELETE /compute/v2.1/os-security-groups/f5e667c2-1efe-4d9d-a7ae-192284be93b2 => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:52.258554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7540deb-75d8-4efb-96fb-db96c8adf628 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f693fd0dee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:52.811670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:19:52.813614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:19:52.814316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:19:52.815035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:19:52.816951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:19:52.857597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:52.865321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:52.866109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:52.867290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:52.868149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:52.868930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:52.939596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Getting quotas for project d5ef9cdd87e4431ea8786e438a1a8061. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:19:52.952268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Getting quotas for user 8b93052ba3ce4f8cbecef7added9207e and project d5ef9cdd87e4431ea8786e438a1a8061. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:19:53.021944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:19:53.025989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:19:53.145177 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7540deb-75d8-4efb-96fb-db96c8adf628 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/0c2b089d-7381-4304-81b4-6515506e5517" status: 202 len: 0 microversion: 2.1 time: 0.890264 Sep 14 09:19:53.146470 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 414/859] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:52 2022] DELETE /compute/v2.1/os-security-groups/0c2b089d-7381-4304-81b4-6515506e5517 => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:19:53.156284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:53.159928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:53.169983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:53.239196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:53.247639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:53.248423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:53.249245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:53.249811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:53.257714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:53.273525 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-220aa102-d6a0-4f79-b391-163183685489 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.205419 Sep 14 09:19:53.274621 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 446/860] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:19:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:19:53.307117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:53.308474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:53.333141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:53.334136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:53.334957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:53.357487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:53.358449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:53.359224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:53.452651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:53.502522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:53.504728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:53.524860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e7fa1ce-5366-404c-a87b-6ad70a54c841 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.376754 Sep 14 09:19:53.528835 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 415/861] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:53 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:53.544376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4ae655d-a407-4f48-ac58-44a15de06fd5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] Calling method '.version_select at 0x7f6944125280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:54.197117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:54.211654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:54.216903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:54.222076 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b632bd37-f9d9-4903-b371-268ab690242d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.936664 Sep 14 09:19:54.224698 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 447/862] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:53 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:54.231054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-507aba80-10bc-4482-8cb0-d1dc1f547e53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:54.231976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-507aba80-10bc-4482-8cb0-d1dc1f547e53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:54.849192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-507aba80-10bc-4482-8cb0-d1dc1f547e53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:54.877509 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-507aba80-10bc-4482-8cb0-d1dc1f547e53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1218 microversion: 2.1 time: 0.632977 Sep 14 09:19:54.878945 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 448/863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:54 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1218 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:19:54.911680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:54.920201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:54.971655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:54.973863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:54.980729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:54.987394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:54.991844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:54.994162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.239759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.270728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.281077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.301814 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b2eb26c-7db5-467f-a4f9-ba25c4f49ebe tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.418766 Sep 14 09:19:55.302956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 449/864] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:54 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:55.320042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:55.325325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:55.348348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.349373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.350951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.351936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.353986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.355479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.419885 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4ae655d-a407-4f48-ac58-44a15de06fd5 tempest-SecurityGroupRulesTestJSON-597666152 tempest-SecurityGroupRulesTestJSON-597666152-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/3914bf56-664d-4347-b83d-54a862ffdbc0" status: 202 len: 0 microversion: 2.1 time: 1.889420 Sep 14 09:19:55.421533 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 416/865] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:19:53 2022] DELETE /compute/v2.1/os-security-groups/3914bf56-664d-4347-b83d-54a862ffdbc0 => generated 0 bytes in 1892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:19:55.663561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.684043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.688768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:55.695627 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f41f889f-3423-4623-89b9-daa88de36846 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.390798 Sep 14 09:19:55.697147 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 450/866] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:55 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:55.899117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Calling method '.version_select at 0x7f694408bee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:55.908731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:55.910008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:55.927135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.931573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.933569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.939752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.941077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.943152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.943596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.944057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.944368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:55.944821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:55.945247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:55.945683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:56.021178 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcf2e2ab-6f80-4f5e-a27b-3fe4462c2e4d tempest-AbsoluteLimitsTestJSON-704394113 tempest-AbsoluteLimitsTestJSON-704394113-project] 10.222.0.90 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.541822 Sep 14 09:19:56.024552 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 417/867] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Sep 14 09:19:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:19:56.333373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:56.333993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:56.360934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:56.366080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:56.366080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:56.366080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:56.366080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:56.372118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:56.631106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:56.661716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c1141ae-fa67-4719-a0ea-a35994d3607e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1288 microversion: 2.1 time: 0.757406 Sep 14 09:19:56.665065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 451/868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:55 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1288 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:56.726775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:56.727760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:56.755840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:56.761734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:56.763726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:56.765807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:56.767472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:56.771859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:56.814093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:56.849701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:56.859275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:56.888320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54b6fabc-f924-4064-9bcc-e258b3fe0e35 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.555425 Sep 14 09:19:56.890046 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 418/869] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:56 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:57.689182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:57.689811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:57.708190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:57.711696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:57.714082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:57.717931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:57.723830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:57.724619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:58.054694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.068004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.101332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.109587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-336c3ed7-c285-401f-91c2-a27cfec76ff0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.389069 Sep 14 09:19:58.133986 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 452/870] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:56 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:58.174350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:58.175043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:58.211575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:58.213909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:58.215251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:58.218647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:58.220529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:58.223636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:58.325038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:19:58.403437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.420528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29cf5a29-f0fb-443b-8d9c-95d3e7adfc15 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1276 microversion: 2.1 time: 0.731268 Sep 14 09:19:58.424665 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 419/871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:57 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1276 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:19:58.616827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.639570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.642511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:19:58.660545 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b5aa2ee-1b41-47f7-ab8f-8d6e05468bf5 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.525320 Sep 14 09:19:58.663759 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 453/872] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:58 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:19:59.138532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:59.139979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:59.186427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:59.187043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:59.190872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:59.195980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:59.200736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:59.202806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:59.458563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:19:59.460340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:19:59.473294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:59.474088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:59.474700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:19:59.475603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:19:59.477337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:19:59.480145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:00.081976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:00.098705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:00.102830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:00.109853 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92326c3a-174c-430e-8ae8-bd87b8569ea1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.970554 Sep 14 09:20:00.114105 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 420/873] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:19:59 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:00.129210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:00.130102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:00.141960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:00.142886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:00.144446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:00.146657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:00.147394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:00.150031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:00.251543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:20:00.341239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:00.488975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-504babcd-fb4a-4bc2-acce-40d254de576d tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 204 len: 0 microversion: 2.1 time: 0.372185 Sep 14 09:20:00.489744 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 421/874] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:00 2022] DELETE /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:20:00.510305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:00.511649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:00.533771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:00.536223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:00.536927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:00.538463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:00.540665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:00.542216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:00.663037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:00.679431 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-33b44b0a-092d-40bf-8e45-d21948d21732 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 1.230079 Sep 14 09:20:00.688025 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 454/875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:19:59 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:01.039520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:01.054625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:01.075281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:01.099917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b072c56e-613f-4fa1-a353-58ea7e4a5c79 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.606721 Sep 14 09:20:01.121275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 422/876] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:00 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:01.128537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:01.138063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:01.166686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.171455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.172434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:01.178259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.181680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.182492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:01.650916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fdf8469-2336-4527-a8e9-501ea5844b1d tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Calling method '.version_select at 0x7f693f89fe50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:01.696988 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-6fdf8469-2336-4527-a8e9-501ea5844b1d tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fdf8469-2336-4527-a8e9-501ea5844b1d tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/images/d8a1ca99-715d-4237-b52b-e4fb166bd858/metadata/os_distro HTTP/1.1 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:01.699737 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: exception: Image not found. Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'image_id': 'd8a1ca99-715d-4237-b52b-e4fb166bd858', 'id': 'os_distro'} Sep 14 09:20:01.703234 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:01.705850 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8a1ca99-715d-4237-b52b-e4fb166bd858 Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:01.708702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8a1ca99-715d-4237-b52b-e4fb166bd858 could not be found. Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:01.713200 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.718327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fdf8469-2336-4527-a8e9-501ea5844b1d tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:01.724742 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fdf8469-2336-4527-a8e9-501ea5844b1d tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "DELETE /compute/v2.1/images/d8a1ca99-715d-4237-b52b-e4fb166bd858/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 1.004274 Sep 14 09:20:01.724742 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 455/877] 10.222.0.90 () {58 vars in 1293 bytes} [Wed Sep 14 09:20:00 2022] DELETE /compute/v2.1/images/d8a1ca99-715d-4237-b52b-e4fb166bd858/metadata/os_distro => generated 62 bytes in 1028 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:01.750674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:01.751241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:01.761742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:01.806578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.807164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.807552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:01.814612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.816703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.817177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:01.825334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:01.840392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-297a1d0d-dc45-4960-83a9-1b7b5d13fc1a tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1664 microversion: 2.1 time: 0.717499 Sep 14 09:20:01.850696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 423/878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:01 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1664 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:01.856482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2eaf349-d5e4-4fd5-9eb3-53322051c465 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Calling method '.version_select at 0x7f694408bf70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:01.881556 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e2eaf349-d5e4-4fd5-9eb3-53322051c465 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2eaf349-d5e4-4fd5-9eb3-53322051c465 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/images/4ae3db22-0335-4bce-aac4-bb9102dc986a/metadata/os_version HTTP/1.1 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:01.884454 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'image_id': '4ae3db22-0335-4bce-aac4-bb9102dc986a', 'id': 'os_version'} Sep 14 09:20:01.885784 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:01.886604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4ae3db22-0335-4bce-aac4-bb9102dc986a Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:01.887871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ae3db22-0335-4bce-aac4-bb9102dc986a could not be found. Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:01.889613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:01.890708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:01.900682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2eaf349-d5e4-4fd5-9eb3-53322051c465 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:01.929115 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2eaf349-d5e4-4fd5-9eb3-53322051c465 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "GET /compute/v2.1/images/4ae3db22-0335-4bce-aac4-bb9102dc986a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.076273 Sep 14 09:20:01.932606 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 424/879] 10.222.0.90 () {58 vars in 1293 bytes} [Wed Sep 14 09:20:01 2022] GET /compute/v2.1/images/4ae3db22-0335-4bce-aac4-bb9102dc986a/metadata/os_version => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:01.945873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:01.946822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:01.962148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.964955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.965665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:01.966613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:01.973286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:01.973962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:02.520977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:02.527328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:02.534652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b18f0fd-254a-4f83-af07-005115cd0268 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.600352 Sep 14 09:20:02.536648 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 425/880] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:01 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:02.544648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6de2a6f8-53a3-4ab0-acc3-fbbfd9a6a8c2 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Calling method '.version_select at 0x7f693fb78c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:02.573189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:02.579373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:02.581235 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5fbc5b72-1b96-4931-91c3-f406a8ebf883 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.857199 Sep 14 09:20:02.586641 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6de2a6f8-53a3-4ab0-acc3-fbbfd9a6a8c2 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:02.598263 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 456/881] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:01 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6de2a6f8-53a3-4ab0-acc3-fbbfd9a6a8c2 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/images/d20a178c-580e-4fca-b209-00d02ec29884/metadata HTTP/1.1 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:02.599052 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'image_id': 'd20a178c-580e-4fca-b209-00d02ec29884'} Sep 14 09:20:02.600440 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.601314 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d20a178c-580e-4fca-b209-00d02ec29884 Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.604372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d20a178c-580e-4fca-b209-00d02ec29884 could not be found. Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:02.605532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:02.608535 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.612127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:02.613023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:02.614654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6de2a6f8-53a3-4ab0-acc3-fbbfd9a6a8c2 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:02.616890 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6de2a6f8-53a3-4ab0-acc3-fbbfd9a6a8c2 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "GET /compute/v2.1/images/d20a178c-580e-4fca-b209-00d02ec29884/metadata" status: 404 len: 62 microversion: 2.1 time: 0.078699 Sep 14 09:20:02.617677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 426/882] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:20:02 2022] GET /compute/v2.1/images/d20a178c-580e-4fca-b209-00d02ec29884/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:02.634029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-658454c4-3cc8-403d-b94e-c4d6294e923a tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Action: 'update_all', calling method: .version_select at 0x7f69440ee280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:02.638293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:02.638801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:02.639241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:02.639987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:02.640446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:02.640876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:02.673255 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-658454c4-3cc8-403d-b94e-c4d6294e923a tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-658454c4-3cc8-403d-b94e-c4d6294e923a tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/images/5d3ea12f-fc38-4408-968b-8f17976f8d80/metadata HTTP/1.1 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 57 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:02.677470 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:02.678840 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'image_id': '5d3ea12f-fc38-4408-968b-8f17976f8d80', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.679872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d3ea12f-fc38-4408-968b-8f17976f8d80 Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.681028 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d3ea12f-fc38-4408-968b-8f17976f8d80 could not be found. Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:02.682184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:02.694471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.703064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-658454c4-3cc8-403d-b94e-c4d6294e923a tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:02.703064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-658454c4-3cc8-403d-b94e-c4d6294e923a tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "PUT /compute/v2.1/images/5d3ea12f-fc38-4408-968b-8f17976f8d80/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059534 Sep 14 09:20:02.703064 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 427/883] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:20:02 2022] PUT /compute/v2.1/images/5d3ea12f-fc38-4408-968b-8f17976f8d80/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:02.705452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-418ace78-2675-47a9-ad0b-fa5cce9e3185 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Action: 'update', calling method: .version_select at 0x7f694408b1f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:02.745619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-418ace78-2675-47a9-ad0b-fa5cce9e3185 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-418ace78-2675-47a9-ad0b-fa5cce9e3185 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/images/acc5c49d-1387-412f-af23-ffda7a4eb469/metadata/os_distro HTTP/1.1 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 30 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:02.756419 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: {"meta": {"os_distro": "alt"}} Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:20:02.757836 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'image_id': 'acc5c49d-1387-412f-af23-ffda7a4eb469', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.759379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID acc5c49d-1387-412f-af23-ffda7a4eb469 Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.760575 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image acc5c49d-1387-412f-af23-ffda7a4eb469 could not be found. Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:02.761677 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:02.762794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.764057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-418ace78-2675-47a9-ad0b-fa5cce9e3185 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:02.764057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-418ace78-2675-47a9-ad0b-fa5cce9e3185 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "PUT /compute/v2.1/images/acc5c49d-1387-412f-af23-ffda7a4eb469/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062530 Sep 14 09:20:02.764057 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 428/884] 10.222.0.90 () {60 vars in 1310 bytes} [Wed Sep 14 09:20:02 2022] PUT /compute/v2.1/images/acc5c49d-1387-412f-af23-ffda7a4eb469/metadata/os_distro => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:02.778437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b91c1a5-15b0-471a-8509-9bf8255469b6 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Action: 'create', calling method: .version_select at 0x7f69440eeca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:02.819559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7b91c1a5-15b0-471a-8509-9bf8255469b6 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] HTTP exception thrown: Image not found. Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b91c1a5-15b0-471a-8509-9bf8255469b6 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Request method failure captured: Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/images/83d5172a-dbd3-456c-acca-51cd657de3c2/metadata HTTP/1.1 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 57 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZy_XB4P-OKqa0XX6BZzE51ikUfASY304XvbzbyKtxHfcW3sU-qe_6cgeOWxRz-gyLdxGPJpBVcSfnf49y4w6ljIa_iXDB2XfdYD8C2QONmc0F6__tL8mD8sIUWbzFzPqRRO5oQFDplexWxmQqapS8XFEq1rSfTspTOkzzv1kVgcbbg Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:02.821699 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_09b6820cde2e45c18bbf1f7a1eb9a9d1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/09b6820cde2e45c18bbf1f7a1eb9a9d1"}]}] Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 09b6820cde2e45c18bbf1f7a1eb9a9d1 Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001 Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 468de2da7f234b1fab199f43903f506d Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1196436001-project Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:20:02.823078 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'image_id': '83d5172a-dbd3-456c-acca-51cd657de3c2', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.824089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 83d5172a-dbd3-456c-acca-51cd657de3c2 Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:20:02.825144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 83d5172a-dbd3-456c-acca-51cd657de3c2 could not be found. Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:02.826248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:20:02.827367 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:02.830511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b91c1a5-15b0-471a-8509-9bf8255469b6 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:02.831648 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b91c1a5-15b0-471a-8509-9bf8255469b6 tempest-ImagesMetadataNegativeTestJSON-1196436001 tempest-ImagesMetadataNegativeTestJSON-1196436001-project] 10.222.0.90 "POST /compute/v2.1/images/83d5172a-dbd3-456c-acca-51cd657de3c2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.067549 Sep 14 09:20:02.833301 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 429/885] 10.222.0.90 () {60 vars in 1281 bytes} [Wed Sep 14 09:20:02 2022] POST /compute/v2.1/images/83d5172a-dbd3-456c-acca-51cd657de3c2/metadata => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:20:02.874991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:02.876532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:02.887331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:02.888357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:02.889709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:02.890897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:02.892791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:02.893576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:02.899080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:03.232432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:03.243845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:03.245346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:03.255366 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb040bc7-ab66-4a48-a181-c66c836245c2 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.655133 Sep 14 09:20:03.268418 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 457/886] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:02 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:03.487117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:03.496744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b828c2e-9d7a-412e-9708-1fa575ae5d78 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1664 microversion: 2.1 time: 0.625853 Sep 14 09:20:03.532397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 430/887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:02 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1664 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:03.565750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:03.566962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:03.574404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:03.574898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:03.575512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:03.577183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:03.577820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:03.578475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:03.592555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:03.614649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:03.615761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:03.618128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:03.635387 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] Creating event network-changed:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:20:03.642216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-caa70890-5ec0-4f2a-be6c-ecf71674f1cb req-75f8d3f1-106b-4c53-8e46-4814df51f0bd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053973 Sep 14 09:20:03.643499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 431/888] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:03.649384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:03.650717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:03.658099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:03.659112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:03.661006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:03.661995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:03.662679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:03.663355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.016976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.031337 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-131f2a03-3d51-497e-8271-4fd2c48971a4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.469013 Sep 14 09:20:04.033655 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 458/889] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:03 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:04.225971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.239177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.241202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.241903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ce95998-234a-4bb5-89b0-11c71148b168 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.596925 Sep 14 09:20:04.248365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 432/890] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:03 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:04.289447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:04.290071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:04.318971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.319492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.321827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.322675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.323222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.323576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.337017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6865b8ea-16eb-4958-83a9-583407022460", "name": "network-vif-deleted", "tag": "3c43a081-809d-4017-9c6a-97d846370981"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:04.398362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.398979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.399591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.427604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] Creating event network-vif-deleted:3c43a081-809d-4017-9c6a-97d846370981 for instance 6865b8ea-16eb-4958-83a9-583407022460 on n-h1-851028-12 Sep 14 09:20:04.443870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-62edd3ee-c1ba-4c3d-a62c-6233f3368844 req-44aca795-a753-4b1d-a457-cf9846afbc99 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116761 Sep 14 09:20:04.447761 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 433/891] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:04.535237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:04.536478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:04.567713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.575601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.577185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.581738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.583147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.596090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.598461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.601235 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ff2a71f-b4ad-41d5-82e7-ced10afe54c7 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.315819 Sep 14 09:20:04.601603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.602084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.616332 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 459/892] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:04 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:04.703758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:04.704574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:04.705168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:04.705636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lazy-loading 'fault' on Instance uuid 6865b8ea-16eb-4958-83a9-583407022460 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:04.849117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73ce9c120ce24272bafa2f172995b978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30258bc21b14d8a9036ab6f6b78319b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:04.874755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2be64e42-914b-4cd0-bc2f-353904766795 tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 200 len: 1315 microversion: 2.1 time: 0.343714 Sep 14 09:20:04.876453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 434/893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:04 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:05.059858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:05.065969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:05.095520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:05.097543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:05.098048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:05.098488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:05.099224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:05.099692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:05.100157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:05.298559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:05.304668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:05.350785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:05.354703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:05.357900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:05.363965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:05.365354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:05.367861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:05.948192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:05.974997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:06.025824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.039284 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47335d5f-b0c2-448e-8053-706111aadaaa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.984679 Sep 14 09:20:06.041180 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 460/894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:05 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:06.051302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:06.052351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:06.065239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:06.066594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:06.067310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:06.083816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:06.084947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:06.085621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:06.237295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.247235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.258258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.263906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8813ea01-52dd-4967-9fa5-6b1d23893124 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.992286 Sep 14 09:20:06.264856 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 435/895] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:05 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:06.271320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec89ed0f-1b9f-44b6-9e70-630b05e30828", "tag": "56ca66b6-112c-45eb-ab64-a99a64dcf8a1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:06.284609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:06.285933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:06.286614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:06.314038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.370340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.372263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] Creating event network-changed:56ca66b6-112c-45eb-ab64-a99a64dcf8a1 for instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 on n-h1-851028-12 Sep 14 09:20:06.376801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:06.407975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3db91cfc-a496-44b3-82a7-27d2312fc2e3 req-34caecaf-7ac3-4cd9-8a66-612f6280e35e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138641 Sep 14 09:20:06.409226 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e4cd7c75-8a95-4f8e-a02f-438cb6836405 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.366711 Sep 14 09:20:06.412509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 436/896] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:06.416910 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 461/897] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:06 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:06.449598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:06.450694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [instance: 6865b8ea-16eb-4958-83a9-583407022460] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:06.473206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:06.476821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:06.477446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:06.478450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:06.480232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:06.481670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:06.511376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] HTTP exception thrown: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Request method failure captured: Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 HTTP/1.1 Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZxwh5D2WD6EYS3jPNoVupKQGD8r6WbDNXWR7_P5s7MMMErq5iyLIFhgFJuP0Kap8RoIQPL23Wv5V3gIYTfOvJrBp3z5MmW-SIzvYSQn0y1t_jyTY8igwjq8riKfeugtnL-PRPNIdssfeEkWLganVC_FHkYUXcMFpIHcVODmMDfrPgc Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b30258bc21b14d8a9036ab6f6b78319b Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestFqdnHostnames-1275347782 Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:06.518240 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b30258bc21b14d8a9036ab6f6b78319b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b30258bc21b14d8a9036ab6f6b78319b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b30258bc21b14d8a9036ab6f6b78319b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b30258bc21b14d8a9036ab6f6b78319b"}]}] Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestFqdnHostnames-1275347782 Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b30258bc21b14d8a9036ab6f6b78319b Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1275347782 Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestFqdnHostnames-1275347782-project Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 73ce9c120ce24272bafa2f172995b978 Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestFqdnHostnames-1275347782-project Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. Sep 14 09:20:06.519868 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6865b8ea-16eb-4958-83a9-583407022460'} Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:06.520700 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. Sep 14 09:20:06.521929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.524644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Returning 404 to user: Instance 6865b8ea-16eb-4958-83a9-583407022460 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:06.525754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f853d59-e9bd-420e-9086-c2a773c8989c tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460" status: 404 len: 111 microversion: 2.1 time: 0.108727 Sep 14 09:20:06.527219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 437/898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:06 2022] GET /compute/v2.1/servers/6865b8ea-16eb-4958-83a9-583407022460 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:06.541770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1952eaa-be01-44ce-8616-90ec72ad47bd tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] Calling method '.version_select at 0x7f693fd0d550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:06.560764 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d1952eaa-be01-44ce-8616-90ec72ad47bd tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [894a88dd-6d39-414d-8114-be0be4da06cf] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:20:06.744720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9be823e1-f8d1-46f0-9650-443c4cf2842f tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f836280>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrt9a3DsA3ojqhZ43QI+x+VkJffqoenp3HlPisQDzYky7hQWM1YRDKg4XklJk/P8391O5OBH120I7JLUxfTKBjklxS5quWC6i9B/sPgu0DpQLG3JSq3fU2D5A50vXBB6A=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9be823e1-f8d1-46f0-9650-443c4cf2842f tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 257 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:06.753198 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:06.755022 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrt9a3DsA3ojqhZ43QI+x+VkJffqoenp3HlPisQDzYky7hQWM1YRDKg4XklJk/P8391O5OBH120I7JLUxfTKBjklxS5quWC6i9B/sPgu0DpQLG3JSq3fU2D5A50vXBB6A=="}} Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrt9a3DsA3ojqhZ43QI+x+VkJffqoenp3HlPisQDzYky7hQWM1YRDKg4XklJk/P8391O5OBH120I7JLUxfTKBjklxS5quWC6i9B/sPgu0DpQLG3JSq3fU2D5A50vXBB6A=='}}} Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.755867 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:06.758100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:20:06.765278 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:20:06.767250 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 14 09:20:06.767250 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.767250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9be823e1-f8d1-46f0-9650-443c4cf2842f tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:06.767250 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9be823e1-f8d1-46f0-9650-443c4cf2842f tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.336097 Sep 14 09:20:06.767250 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 462/899] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:06 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:06.770587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f89f040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1618034319", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:06.796195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:06.811414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for user 8cd2f66b937a41fcaf3a39c5f84346ba and project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:06.859313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 2167 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1618034319", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:06.877550 n-d-851028-12 devstack@n-api.service[122443]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1618034319', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:06.879777 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fea74139-25f0-4a0b-8eab-9515fbd110db tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.114427 Sep 14 09:20:06.882900 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 463/900] 10.222.0.90 () {60 vars in 1160 bytes} [Wed Sep 14 09:20:06 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:20:06.893738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a01900f-72d2-4254-9140-e20dab2d6aa2 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f8ae310>, body: {"keypair": {"name": "tempest-keypair-488123660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiKBbTYWXfSmHubag86nUMoDNJBUc3piyObHzbVYv0UcFYehwFmQjZEKgubCZnMFfJRIjDbFj9lQdsTSqBVX6YlBQHtaQkONSNSpZxGggZIBe52Fl54+AyMs6+FGmBfuw=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:06.916512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5a01900f-72d2-4254-9140-e20dab2d6aa2 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:06.921793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5a01900f-72d2-4254-9140-e20dab2d6aa2 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for user 8cd2f66b937a41fcaf3a39c5f84346ba and project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:06.967625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a01900f-72d2-4254-9140-e20dab2d6aa2 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079212 Sep 14 09:20:06.969062 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 464/901] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:20:06.983349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "name": "network-vif-unplugged", "status": "completed", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:07.006334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.007202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.007373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.059008 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] Creating event network-vif-unplugged:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h1-851028-12 Sep 14 09:20:07.067144 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-04093d81-c5a3-4f80-a5de-af13fd82d1e0 req-b1c2aa9b-af11-405d-9ff9-023dcc6b9b56 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092588 Sep 14 09:20:07.069021 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 465/902] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:07.076034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f89f790>, body: {"keypair": {"name": "tempest-keypair-488123660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwkhm+R8ZnNi/KQ9ijOlNkAnUB4hsATcnR/tzcNBhtCW7ZVJVz+RTdvQjxYGZ+QaL6l4LvTbAls+GcWJbHlBAbzDE6X6sjKfSjWI/zirHUZtU0lEy3EYoIdxj7OIZtfHg=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:07.096012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:07.102792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for user 8cd2f66b937a41fcaf3a39c5f84346ba and project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:07.153399 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] HTTP exception thrown: Key pair 'tempest-keypair-488123660' already exists. Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 272 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "tempest-keypair-488123660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwkhm+R8ZnNi/KQ9ijOlNkAnUB4hsATcnR/tzcNBhtCW7ZVJVz+RTdvQjxYGZ+QaL6l4LvTbAls+GcWJbHlBAbzDE6X6sjKfSjWI/zirHUZtU0lEy3EYoIdxj7OIZtfHg=="}} Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: exception: Key pair 'tempest-keypair-488123660' already exists. Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-488123660', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwkhm+R8ZnNi/KQ9ijOlNkAnUB4hsATcnR/tzcNBhtCW7ZVJVz+RTdvQjxYGZ+QaL6l4LvTbAls+GcWJbHlBAbzDE6X6sjKfSjWI/zirHUZtU0lEy3EYoIdxj7OIZtfHg=='}}} Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '8cd2f66b937a41fcaf3a39c5f84346ba-tempest-keypair-488123660' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 14 09:20:07.158858 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi session.flush() Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result.read() Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 14 09:20:07.163241 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '8cd2f66b937a41fcaf3a39c5f84346ba-tempest-keypair-488123660' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 14, 9, 20, 7, 133281), 'updated_at': None, 'name': 'tempest-keypair-488123660', 'user_id': '8cd2f66b937a41fcaf3a39c5f84346ba', 'fingerprint': '5f:5a:72:af:df:6b:dd:e1:79:7e:50:dd:01:36:b6:ee', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwkhm+R8ZnNi/KQ9ijOlNkAnUB4hsATcnR/tzcNBhtCW7ZVJVz+RTdvQjxYGZ+QaL6l4LvTbAls+GcWJbHlBAbzDE6X6sjKfSjWI/zirHUZtU0lEy3EYoIdxj7OIZtfHg==', 'type': 'ssh'}] Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair.create() Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._create() Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-488123660' already exists. Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 14 09:20:07.168682 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-488123660' already exists. Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-488123660' already exists. Sep 14 09:20:07.175040 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.181943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 409 to user: Key pair 'tempest-keypair-488123660' already exists. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:07.182879 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-72513ba9-26f0-4699-b320-5516a556466e tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.112080 Sep 14 09:20:07.186900 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 466/903] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:07 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:07.199017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:07.202850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:07.210819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.211319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.211817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.212742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.213192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.213614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.531512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.540421 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-29cd19bb-c887-4906-8c27-41d5ea72ca50 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.355012 Sep 14 09:20:07.541030 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 467/904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:07 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:07.545754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-324969b2-77a5-47cb-90d5-4091c16e4961 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Calling method '.version_select at 0x7f693f87c550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:07.572260 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [None req-d1952eaa-be01-44ce-8616-90ec72ad47bd tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] [894a88dd-6d39-414d-8114-be0be4da06cf] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 48204. Sep 14 09:20:07.576592 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-324969b2-77a5-47cb-90d5-4091c16e4961 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488123660" status: 202 len: 0 microversion: 2.1 time: 0.033943 Sep 14 09:20:07.578218 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 468/905] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488123660 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:07.586611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:07.587877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:07.596642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.597444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.598060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.598986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.599603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.600223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.623374 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1952eaa-be01-44ce-8616-90ec72ad47bd tempest-ServersTestFqdnHostnames-1275347782 tempest-ServersTestFqdnHostnames-1275347782-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603315805" status: 202 len: 0 microversion: 2.1 time: 1.091776 Sep 14 09:20:07.624554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 438/906] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603315805 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:20:07.635814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:07.636475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:07.654064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.654940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.655581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.659724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.660474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.661092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.857949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.880133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.884933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.886062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.900914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.901793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db3b30a1-35d3-4326-a8eb-07b55db3ab60 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1542 microversion: 2.91 time: 0.273126 Sep 14 09:20:07.923733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:07.923733 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-663768e8-ff5d-4b5f-864d-93d4459af5f8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.331691 Sep 14 09:20:07.923733 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 469/907] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:07 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:07.925171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c49a904f-6974-4187-932a-df8cd7477645 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f836310>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIZNL4klepNOfsRW018B4osuZ1GbXhudC4MrXlffQID6PjC2rzcAN62Es5ODOI9ed6BUwR0pUld4/CZW3eo34OHa8yzBA4EMdf1F/aQarx3QiOMZWyJQDGUYsfS45NlcQ=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:07.925678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 439/908] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:07 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1542 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c49a904f-6974-4187-932a-df8cd7477645 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 247 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIZNL4klepNOfsRW018B4osuZ1GbXhudC4MrXlffQID6PjC2rzcAN62Es5ODOI9ed6BUwR0pUld4/CZW3eo34OHa8yzBA4EMdf1F/aQarx3QiOMZWyJQDGUYsfS45NlcQ=="}} Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIZNL4klepNOfsRW018B4osuZ1GbXhudC4MrXlffQID6PjC2rzcAN62Es5ODOI9ed6BUwR0pUld4/CZW3eo34OHa8yzBA4EMdf1F/aQarx3QiOMZWyJQDGUYsfS45NlcQ=='}}} Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi '' Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:20:07.928882 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c49a904f-6974-4187-932a-df8cd7477645 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:07.932843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c49a904f-6974-4187-932a-df8cd7477645 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009132 Sep 14 09:20:07.938939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:07.939681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:07.944992 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 470/909] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:07.950292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.950968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.951607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:07.951983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f812820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865387148", "public_key": " "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:07.952908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:07.953596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:07.955269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.004167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:08.004387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:20:08.021007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for user 8cd2f66b937a41fcaf3a39c5f84346ba and project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:08.055542 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 95 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865387148", "public_key": " "}} Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1865387148', 'public_key': ' '}}} Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.059304 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f2f6ad2-dba0-4a95-951f-3ae6a0989e36 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.116501 Sep 14 09:20:08.063845 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 471/910] 10.222.0.90 () {60 vars in 1158 bytes} [Wed Sep 14 09:20:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:20:08.077754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0437c0c2-08e9-4ea2-8869-0ff35292a389 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f868af0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQaiAEjnXDLK3YuKRk6xIw2MKg7J/X7w+9TawQn+O33uLozi0BN8a5e9aZ1AW33yOLpkT4jACnZ2T8bWGMlyqUVklLCUq8ldlylbwjvwmhqn1gKh6JjfrF/tTB+g0EX9g=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0437c0c2-08e9-4ea2-8869-0ff35292a389 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 507 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQaiAEjnXDLK3YuKRk6xIw2MKg7J/X7w+9TawQn+O33uLozi0BN8a5e9aZ1AW33yOLpkT4jACnZ2T8bWGMlyqUVklLCUq8ldlylbwjvwmhqn1gKh6JjfrF/tTB+g0EX9g=="}} Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQaiAEjnXDLK3YuKRk6xIw2MKg7J/X7w+9TawQn+O33uLozi0BN8a5e9aZ1AW33yOLpkT4jACnZ2T8bWGMlyqUVklLCUq8ldlylbwjvwmhqn1gKh6JjfrF/tTB+g0EX9g=='}}} Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 14 09:20:08.084387 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.087614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0437c0c2-08e9-4ea2-8869-0ff35292a389 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:08.089973 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0437c0c2-08e9-4ea2-8869-0ff35292a389 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017198 Sep 14 09:20:08.097311 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 472/911] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:08 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:08.104005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Action: 'create', calling method: .version_select at 0x7f693f89f700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-346619899", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:08.132077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:08.138387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Getting quotas for user 8cd2f66b937a41fcaf3a39c5f84346ba and project 146b4e5903fb4030a7d0e38b7a93df08. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 117 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-346619899", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: exception: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-346619899', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:20:08.209977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:08.217999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3787ef94-f201-4d88-920e-9f5eecc77b42 tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.109199 Sep 14 09:20:08.230782 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 473/912] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:20:08 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:20:08.237559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-589cba40-77a8-40ad-ba43-7a489aa7da48 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 204 len: 0 microversion: 2.1 time: 0.310372 Sep 14 09:20:08.238248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4304b813-224c-4b0f-a8b3-2a82fe6ec2aa tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Calling method '.version_select at 0x7f693f855e50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:08.252459 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 440/913] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:07 2022] DELETE /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:20:08.256273 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4304b813-224c-4b0f-a8b3-2a82fe6ec2aa tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.258140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4304b813-224c-4b0f-a8b3-2a82fe6ec2aa tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Request method failure captured: Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1761651574 HTTP/1.1 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzFosiQGRXwfXGQXztUETi_dniNqBew3PksDkVIVVLKT4lOrb-BMNkLI5SOeuIbv3dyRCse0nW6C_1ztg97dYjtn4lh2lJIPHkokEGhjgbVCidg8I_83FxKKd-Pz5RrXXAViN8DAOhjnhGjY8tVZzf003-C8miNCB27ZzGwnBBg2gk Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_146b4e5903fb4030a7d0e38b7a93df08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/146b4e5903fb4030a7d0e38b7a93df08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/146b4e5903fb4030a7d0e38b7a93df08"}]}] Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 146b4e5903fb4030a7d0e38b7a93df08 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1550370196 Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1550370196-project Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: exception: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'tempest-keypair-non-existent-1761651574'} Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise self.value Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.258799 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba Sep 14 09:20:08.267815 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:08.270415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:08.270510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4304b813-224c-4b0f-a8b3-2a82fe6ec2aa tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1761651574 not found for user 8cd2f66b937a41fcaf3a39c5f84346ba {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:08.270510 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4304b813-224c-4b0f-a8b3-2a82fe6ec2aa tempest-KeyPairsNegativeTestJSON-1550370196 tempest-KeyPairsNegativeTestJSON-1550370196-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1761651574" status: 404 len: 145 microversion: 2.1 time: 0.029850 Sep 14 09:20:08.270510 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 474/914] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:20:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1761651574 => generated 145 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:08.304208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.304590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.305027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.305747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.312521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.314844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.580536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:08.582174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:08.604786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.608791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.611734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.613863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.615199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.615916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.918279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:08.932045 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45f53c67-d562-49ed-bf18-2ce9dbc4780b tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1712 microversion: 2.1 time: 0.677896 Sep 14 09:20:08.952814 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 441/915] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:08 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1712 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:08.962938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:08.963770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:08.980194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.980786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.981301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:08.982089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:08.982754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:08.984538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.019819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:09.029386 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1096b3e0-e1b6-4ad7-99dd-16b8394b9e84 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.459625 Sep 14 09:20:09.051818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 475/916] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:08 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:09.064446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:09.068768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:09.081669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:09.082573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:09.084427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.088770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:09.089333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:09.089834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.198018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:09.217346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:09.219187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:09.238936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-115780b5-ba38-4a37-928d-1b94856c8a77 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1529 microversion: 2.91 time: 0.284039 Sep 14 09:20:09.240264 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 442/917] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:08 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1529 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:09.272474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:09.273488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:09.286063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:09.286660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:09.287646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.288617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:09.289286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:09.289922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.801929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] Lazy-loading 'services' on Instance uuid 24a4f613-5efc-4454-ba25-ad283ece36df {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:09.812703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:09.856904 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-951fa75e-9508-45c1-966f-53ca0a048a3e tempest-UnshelveToHostMultiNodesTest-254489214 tempest-UnshelveToHostMultiNodesTest-254489214-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1936 microversion: 2.91 time: 0.587942 Sep 14 09:20:09.890426 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 443/918] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:09 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1936 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:09.913204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:09.958195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:09.958886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:09.959101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:09.998992 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] Creating event network-changed:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h1-851028-12 Sep 14 09:20:10.015224 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-32f5a6c4-9bb3-4b89-8f82-327186bea3b6 req-4991291d-8680-4434-b36c-8999eff690ef service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120313 Sep 14 09:20:10.016099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 444/919] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:10.052736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:10.058310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:10.072291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.072968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.073497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:10.074377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.074921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.075423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:10.134170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:20:10.299315 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a2812f8-9d09-4099-a333-76481a1543c0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "DELETE /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 204 len: 0 microversion: 2.91 time: 0.280310 Sep 14 09:20:10.305118 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 445/920] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:20:10 2022] DELETE /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:20:10.320337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:10.321125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:10.349265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.349775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.350219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:10.350945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.351406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.351831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:10.479054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:10.491448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:10.492925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:10.498587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ce2cd3c0-11cc-488f-83a2-5249d45b25a0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.444097 Sep 14 09:20:10.501886 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 476/921] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:09 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:10.511664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:10.512314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:10.527723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.528654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.529097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:10.529804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:10.530254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:10.530678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:11.289016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:11.302507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:11.305776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fc2eed5-54ae-44f8-a187-d566f5e15e96 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.802812 Sep 14 09:20:11.308827 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 477/922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:10 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:11.313863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:11.323246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:11.327975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-336bf5b6-25d0-4d76-b3e5-583f40f6f725 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1712 microversion: 2.1 time: 1.021230 Sep 14 09:20:11.329584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 446/923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:10 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1712 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:11.333022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:11.333731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:11.334271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:11.339151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:11.339151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:11.339151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:11.532944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:11.534025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:11.547086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:11.551611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:11.552417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:11.553224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:11.555084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:11.555762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:11.556440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:11.564825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:11.568381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:11.581169 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-709f5d63-fd28-4e90-9cec-4c33ef9bcb50 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.269308 Sep 14 09:20:11.583954 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 478/924] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:11 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:12.046933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:12.062586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:12.065878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:12.067791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a9d1ae8-48b9-473e-bdac-6daa12b05730 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.540873 Sep 14 09:20:12.069031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 447/925] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:11 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:12.332698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:12.333603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:12.340748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:12.341704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:12.342870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:12.344036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:12.345393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:12.346132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:12.365975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:12.366713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:12.379442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:12.380056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:12.382649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:12.383512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:12.385504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:12.392564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:12.750671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:12.763544 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc76b216-6762-44b1-b71c-8ac65adf89c8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.436614 Sep 14 09:20:12.779921 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 479/926] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:12 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:13.037697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.050417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22cc3f2e-b9b0-47ea-9e3a-ed5dcdedff8c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1712 microversion: 2.1 time: 0.697426 Sep 14 09:20:13.052475 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 448/927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:12 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1712 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:13.058956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:13.060271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:13.060656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Calling method '.version_select at 0x7f693f868ca0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:13.090076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.090984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.091640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.091776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.095347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.095655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.096420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.097069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.097756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.098350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.098613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.099211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.163005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:13.167129 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b6f73755-e57a-40fa-addd-3cd3408aeadb tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] 10.222.0.90 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.396511 Sep 14 09:20:13.173866 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 480/928] 10.222.0.90 () {58 vars in 1122 bytes} [Wed Sep 14 09:20:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:13.181144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec89ed0f-1b9f-44b6-9e70-630b05e30828", "name": "network-vif-plugged", "status": "completed", "tag": "56ca66b6-112c-45eb-ab64-a99a64dcf8a1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:13.206413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.224946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.225768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.264237 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] Creating event network-vif-plugged:56ca66b6-112c-45eb-ab64-a99a64dcf8a1 for instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 on n-h1-851028-12 Sep 14 09:20:13.277736 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7ccaac3c-5ec2-4be7-afcf-f496af97ac11 req-17126fb1-2317-48e1-9f75-97ccea13de6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099808 Sep 14 09:20:13.279307 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 481/929] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:13.319598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:13.321074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:13.340888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.349095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.349929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.351711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.353923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.354367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.400276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.411475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.419885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1f14d130ab4801ab4af77ceb1f5471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c040b15f5387486682fe2b57aede25ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.431109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f543c33d-a91b-48dd-afd3-5cfc85d50ea0 tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 200 len: 1535 microversion: 2.91 time: 0.377157 Sep 14 09:20:13.432459 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 449/930] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:13 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 1535 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:13.443416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2069601350", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:13.525092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:20:13.714995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.726018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.735790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:13.737072 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-59df8357-c90e-405d-ba0c-027fbcb52db2 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.456547 Sep 14 09:20:13.738193 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 482/931] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:13 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:13.793783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:13.795116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:13.810374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.810899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.811345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.812148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:13.812806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:13.813938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:13.826734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:14.086988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:14.110052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Getting quotas for project 4bbaba31705d4d6d9bffc9a547b07610. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:20:14.131323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:14.141330 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b9c4e9d-ed53-48b6-88ba-8227df30148d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1318 microversion: 2.1 time: 0.351432 Sep 14 09:20:14.157511 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 483/932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:13 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:14.162975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:14.163595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:14.167128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Getting quotas for user 621066183e174ee4a7f4b322b64314ab and project 4bbaba31705d4d6d9bffc9a547b07610. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:20:14.199853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.200792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.205886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.207526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.219497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 14 09:20:14.221825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.223562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Request method failure captured: Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 1752 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzMaTNqz2963BoNYIdR6IhAtA4LBPqZDDjiFu4-FaqWnj7AEvOAwJqBFhcXE7AtrgNCAJPBWVMPtmxBwIOUikUydjapZV-y1wliIrgD3WTNlLo-PCYngjBx5sDJutPBeoGkqaujAVQAI3uM3v0zNPd9BrNzeRqvx7hf49HOqRMmX70 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4bbaba31705d4d6d9bffc9a547b07610 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1916298743 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4bbaba31705d4d6d9bffc9a547b07610", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4bbaba31705d4d6d9bffc9a547b07610"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4bbaba31705d4d6d9bffc9a547b07610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4bbaba31705d4d6d9bffc9a547b07610"}]}] Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1916298743 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4bbaba31705d4d6d9bffc9a547b07610 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1916298743 Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 621066183e174ee4a7f4b322b64314ab Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2069601350", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:20:14.225389 n-d-851028-12 devstack@n-api.service[122444]: exception: Maximum number of metadata items exceeds 128 Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-2069601350', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:14.228127 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 14 09:20:14.231436 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.243369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:14.244514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d2f3843-e54f-485e-b643-105db3a388e1 tempest-AbsoluteLimitsNegativeTestJSON-1916298743 tempest-AbsoluteLimitsNegativeTestJSON-1916298743-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.810935 Sep 14 09:20:14.245116 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 450/933] 10.222.0.90 () {60 vars in 1148 bytes} [Wed Sep 14 09:20:13 2022] POST /compute/v2.1/servers => generated 87 bytes in 812 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:20:14.386657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:14.409724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-040b14e7-b03f-46fa-af91-b7f1b36362f8 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1645 microversion: 2.1 time: 0.250662 Sep 14 09:20:14.420113 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 484/934] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:14 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1645 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:14.462631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:14.464273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] [instance: 24a4f613-5efc-4454-ba25-ad283ece36df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:14.486187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.488434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.489177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.490179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.490873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.494975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.515146 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] HTTP exception thrown: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Request method failure captured: Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df HTTP/1.1 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwmScS0GQNPj9z3sJLIdTrjrheU-vXed_6_3mihraxwy5LhenMXAfGav7WFLe1cB647fxH-yYg6oy-F3h6UcLn_-jx5_VOrBtfOSuCLx7gGezevOOZh75P-022mxU6tnjqFOcyPyQwJhVpHsYXoh6O5qpz8Tb3XV1jX3mloQ9soRCw Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.91 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c040b15f5387486682fe2b57aede25ec Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1262295871 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c040b15f5387486682fe2b57aede25ec", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c040b15f5387486682fe2b57aede25ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c040b15f5387486682fe2b57aede25ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c040b15f5387486682fe2b57aede25ec"}]}] Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1262295871 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c040b15f5387486682fe2b57aede25ec Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1262295871 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-UnshelveToHostMultiNodesTest-1262295871-project Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: df1f14d130ab4801ab4af77ceb1f5471 Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1262295871-project Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '24a4f613-5efc-4454-ba25-ad283ece36df'} Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. Sep 14 09:20:14.518647 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. Sep 14 09:20:14.522790 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:14.527424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] Returning 404 to user: Instance 24a4f613-5efc-4454-ba25-ad283ece36df could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:14.529175 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2df34bc1-f09d-4153-b164-f2b28bba47ab tempest-UnshelveToHostMultiNodesTest-1262295871 tempest-UnshelveToHostMultiNodesTest-1262295871-project] 10.222.0.90 "GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df" status: 404 len: 111 microversion: 2.91 time: 0.070443 Sep 14 09:20:14.530987 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 451/935] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:14 2022] GET /compute/v2.1/servers/24a4f613-5efc-4454-ba25-ad283ece36df => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:14.656141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa26f8cb-f4a0-4e68-86dd-0423d8559934", "name": "network-vif-deleted", "tag": "66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:14.684396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.685244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.686009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.737910 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] Creating event network-vif-deleted:66c56bbe-72c4-49e4-9e5c-8d83d7d3e6b3 for instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 on n-h1-851028-12 Sep 14 09:20:14.765895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:14.766724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:14.768236 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-eca12fc3-fb2a-4e5d-bfab-74f004c1e160 req-3d19c3b9-73ca-4a13-8705-95e2b90093df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102485 Sep 14 09:20:14.773207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 485/936] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:14.784962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.789290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.792737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:14.793794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:14.794729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:14.795931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.182597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:15.183583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:15.203391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.206337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.206813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.207567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.212235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.212725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.267400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:15.280285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:15.285688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:15.288960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-993ef151-2d5d-43af-a86d-414fc1e43bcf tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.527622 Sep 14 09:20:15.289741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 452/937] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:14 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:20:15.447282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:15.447919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:15.464812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.466043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.467135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.468047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.468655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.471616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.569087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:15.570531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:15.571908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:15.574109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lazy-loading 'fault' on Instance uuid fa26f8cb-f4a0-4e68-86dd-0423d8559934 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:16.103810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55337a61f6f54038a60f21aa891ccee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd45ebdf7b6f3452bb868bec5bd60ca4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:16.116727 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-210c42f6-4186-4301-aa78-1303e307256c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 200 len: 1353 microversion: 2.1 time: 0.674823 Sep 14 09:20:16.120663 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 453/938] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:15 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 1353 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:16.132054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:16.177316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:16.178439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:16.180758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:16.219267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:16.231774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] Creating event network-vif-plugged:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:20:16.236443 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6c8c55f-5142-4697-98ec-e3ed3dbfcfb0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1467 microversion: 2.1 time: 1.059356 Sep 14 09:20:16.255934 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 486/939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:15 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1467 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:16.256274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ac5d8cba-f799-4730-b0c1-1cdf36a5f14b req-bb3b0e15-5a1a-4179-b065-4caab36be29a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125395 Sep 14 09:20:16.256274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 454/940] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:16.293819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:16.293819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:16.335258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:16.336145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:16.341270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:16.344562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:16.345233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:16.345681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:16.465962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8b689a9-19f5-497c-bb42-34550aa4b733 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f7e53a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-194422051", "description": "tempest-description-1799437452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:16.850338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:16.882400 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2e77094-4c9a-43b8-b4c9-bf5020365f5d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1317 microversion: 2.1 time: 0.606386 Sep 14 09:20:16.890174 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b8b689a9-19f5-497c-bb42-34550aa4b733 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.648331 Sep 14 09:20:16.892139 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 487/941] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:20:16 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:16.892483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 455/942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:16 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:16.903216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:16.904009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:16.906004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8110e474-7d6a-4c3d-8f97-3e38538e24ad tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f855af0>, body: {"security_group_rule": {"parent_group_id": "fa399e9d-f7bd-47a9-8822-279f895bc7f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:16.916153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:16.917058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:16.917789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:16.920847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:16.924219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:16.924845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:17.839559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:17.859070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:17.867620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:17.874781 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54f83e5a-6cd7-472a-a796-30b066ff8f61 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.980978 Sep 14 09:20:17.878674 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 456/943] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:16 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:17.901291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:17.904006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:17.936530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:17.937068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:17.937537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:17.944569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:17.947610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:17.948175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:18.009524 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 HTTP/1.1 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'fa26f8cb-f4a0-4e68-86dd-0423d8559934'} Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.017708 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:18.022099 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.023340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:18.028690 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bd64e43-0256-4de6-9de6-3de5f8594b13 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 404 len: 111 microversion: 2.1 time: 0.147126 Sep 14 09:20:18.029312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 457/944] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:17 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:18.061232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:18.064388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:18.093537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:18.094027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:18.094951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:18.095861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:18.109161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:18.109631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:18.428605 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8110e474-7d6a-4c3d-8f97-3e38538e24ad tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.526654 Sep 14 09:20:18.430774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 488/945] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:18.437369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:18.441179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:18.459879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:18.460929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:18.461977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:18.463438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:18.465397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:18.466104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:18.507562 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 HTTP/1.1 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'db70afe2-8bc3-4daa-b118-de8ddc4fd012'} Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:18.511116 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:18.515528 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:18.521590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:18.522881 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ceb0fe5a-8ccd-44dc-b274-4486fdaeed3e tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 404 len: 111 microversion: 2.1 time: 0.090839 Sep 14 09:20:18.524694 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 489/946] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:18 2022] DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:18.535520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7a36e53-efab-4ccf-bb02-16db739e1d02 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f9620d0>, body: {"security_group_rule": {"parent_group_id": "fa399e9d-f7bd-47a9-8822-279f895bc7f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:19.071883 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-d7a36e53-efab-4ccf-bb02-16db739e1d02 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7a36e53-efab-4ccf-bb02-16db739e1d02 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 138 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: {"security_group_rule": {"parent_group_id": "fa399e9d-f7bd-47a9-8822-279f895bc7f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: exception: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fa399e9d-f7bd-47a9-8822-279f895bc7f8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:19.074317 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7a36e53-efab-4ccf-bb02-16db739e1d02 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: This rule already exists in group fa399e9d-f7bd-47a9-8822-279f895bc7f8 {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d7a36e53-efab-4ccf-bb02-16db739e1d02 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.548881 Sep 14 09:20:19.080485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 490/947] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:18 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 550 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:19.084984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:19.085609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:19.115223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:19.115678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:19.116159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:19.120765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:19.121250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:19.121694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:19.135505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:19.163348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b98046af-af53-4a8e-8448-7c9f49115118 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1317 microversion: 2.1 time: 1.127818 Sep 14 09:20:19.174899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 458/948] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:18 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:19.178293 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 HTTP/1.1 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'db70afe2-8bc3-4daa-b118-de8ddc4fd012'} Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.180155 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:19.184318 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a989db17-ac3d-4c65-8bfa-4b6cd50cea5f tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 404 len: 111 microversion: 2.1 time: 0.103757 Sep 14 09:20:19.186729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:19.187401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:19.195573 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 491/949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:19 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:19.208767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:19.209958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:19.210687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:19.213482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c096a77-f915-43cb-af2d-a27ac5edd4e1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693f836af0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:19.234241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:19.235786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:19.240410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:20.134888 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c096a77-f915-43cb-af2d-a27ac5edd4e1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-group-rules/31f1da4b-37f2-4b87-85da-f682f5a23cb9" status: 202 len: 0 microversion: 2.1 time: 0.937401 Sep 14 09:20:20.136758 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 492/950] 10.222.0.90 () {58 vars in 1287 bytes} [Wed Sep 14 09:20:19 2022] DELETE /compute/v2.1/os-security-group-rules/31f1da4b-37f2-4b87-85da-f682f5a23cb9 => generated 0 bytes in 941 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:20.155604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1aacd4c2-deaf-4b8a-8704-44c3ff76fe71 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '.version_select at 0x7f693f89f8b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:20.193585 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1aacd4c2-deaf-4b8a-8704-44c3ff76fe71 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037761214" status: 202 len: 0 microversion: 2.1 time: 0.055103 Sep 14 09:20:20.198262 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 493/951] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:20:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037761214 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:20.207989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52271e29-1c47-4ab5-bb11-26cb9ee71004 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f836c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1883267820", "description": "tempest-description-159826052"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:20.301345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:20.316092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:20.321715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:20.322956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bf8c0679-2128-4907-85a1-ae382202f21c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.146996 Sep 14 09:20:20.323537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 459/952] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:19 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:20.340415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:20.341037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:20.353037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:20.362808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:20.363579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:20.364566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:20.365220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:20.365840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:21.007415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:21.024358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5dcee6b-c19a-4e00-a3a8-126a4a33059a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1467 microversion: 2.1 time: 0.693342 Sep 14 09:20:21.026675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 460/953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:20 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1467 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:21.055086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1272574641"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:21.062488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:21.092697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:21.093204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:21.093661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:21.094719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:21.112272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:21.112634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:21.266277 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52271e29-1c47-4ab5-bb11-26cb9ee71004 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.065865 Sep 14 09:20:21.268371 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 494/954] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:20:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:21.281586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d20ea56-6059-42ec-af88-88e26378d1d1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f7e5ee0>, body: {"security_group_rule": {"parent_group_id": "6a2c4d00-bb1f-4856-a79e-82680bedfbd2", "ip_protocol": "tcp", "from_port": 1647702304, "to_port": 22}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:21.429359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:21.493657 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01078c1e-ccbe-45a9-ac96-6ad7141c2e80 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "POST /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.446904 Sep 14 09:20:21.500940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 461/955] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:20:21 2022] POST /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 14 09:20:21.507119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:21.508257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:21.517329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:21.518026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:21.518796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:21.519973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:21.522216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:21.524904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:21.618481 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-6d20ea56-6059-42ec-af88-88e26378d1d1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Invalid port range 1647702304:22. Former value cannot be greater than the later Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d20ea56-6059-42ec-af88-88e26378d1d1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 146 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: {"security_group_rule": {"parent_group_id": "6a2c4d00-bb1f-4856-a79e-82680bedfbd2", "ip_protocol": "tcp", "from_port": 1647702304, "to_port": 22}} Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid port range 1647702304:22. Former value cannot be greater than the later Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6a2c4d00-bb1f-4856-a79e-82680bedfbd2', 'ip_protocol': 'tcp', 'from_port': 1647702304, 'to_port': 22}}} Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1647702304:22. Former value cannot be greater than the later Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1647702304:22. Former value cannot be greater than the later Sep 14 09:20:21.620100 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1647702304:22. Former value cannot be greater than the later Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d20ea56-6059-42ec-af88-88e26378d1d1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: Invalid port range 1647702304:22. Former value cannot be greater than the later {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:21.624042 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6d20ea56-6059-42ec-af88-88e26378d1d1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.344963 Sep 14 09:20:21.627428 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 495/956] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:21 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:20:21.637225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-468e141c-8a84-4518-9ccf-cbfd402bcf4c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f78d3a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:21.709491 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-468e141c-8a84-4518-9ccf-cbfd402bcf4c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.080119 Sep 14 09:20:21.710095 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 496/957] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:21 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:21.730979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-883ddbae-c608-4f14-917f-4a81a23e01cd tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f8369d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-188542728", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:21.732896 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-883ddbae-c608-4f14-917f-4a81a23e01cd tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Security group id should be uuid Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-883ddbae-c608-4f14-917f-4a81a23e01cd tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 130 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-188542728", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: exception: Security group id should be uuid Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-188542728', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:21.734416 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:21.738780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 14 09:20:21.738780 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:21.738780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-883ddbae-c608-4f14-917f-4a81a23e01cd tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: Security group id should be uuid {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:21.738780 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-883ddbae-c608-4f14-917f-4a81a23e01cd tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017114 Sep 14 09:20:21.748657 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 497/958] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:21 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:20:21.758974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cb91807e-e690-4030-8494-674612b22cc1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f8ae5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-936326814", "description": "tempest-description-1301044333"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:22.185232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:22.208342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:22.210239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:22.211719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f150d53a-2f71-406b-9520-0efe9d4de366 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 0.709404 Sep 14 09:20:22.212984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 462/959] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:21 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:22.683366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ca9c54c-df79-4676-99be-385b04cdb3f8 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.734033 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb91807e-e690-4030-8494-674612b22cc1 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.979916 Sep 14 09:20:22.734817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 498/960] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:20:21 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:20:22.740520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfd908a9-855b-4981-8bc9-e78d93dcf451 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8aec10>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.742146 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ca9c54c-df79-4676-99be-385b04cdb3f8 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1234278336" status: 202 len: 0 microversion: 2.1 time: 0.064967 Sep 14 09:20:22.744675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 463/961] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:20:22 2022] DELETE /compute/v2.1/flavors/1234278336 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:22.758875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cb8e852-94f1-4e9f-9cac-400b54c92353 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693fa19940>, body: {"security_group_rule": {"parent_group_id": "d1812112-127b-4237-a8aa-a4e78fcceda4", "ip_protocol": "tempest-999-1570202947", "from_port": 22, "to_port": 22}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:22.806598 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfd908a9-855b-4981-8bc9-e78d93dcf451 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.070109 Sep 14 09:20:22.807283 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 499/962] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:22 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:22.812192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d97d3e23-2b7f-4006-921c-b4c59dc2094a tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.851909 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d97d3e23-2b7f-4006-921c-b4c59dc2094a tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.043249 Sep 14 09:20:22.871154 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 500/963] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:20:22 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:22.879542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d01d7663-661d-45b6-9bde-ccf09574d882 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.903010 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d01d7663-661d-45b6-9bde-ccf09574d882 tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/422970518" status: 202 len: 0 microversion: 2.1 time: 0.028466 Sep 14 09:20:22.907884 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 501/964] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:20:22 2022] DELETE /compute/v2.1/flavors/422970518 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:20:22.913447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a8fcf98-b8c9-45df-b5f6-2b87685e803c tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.943102 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a8fcf98-b8c9-45df-b5f6-2b87685e803c tempest-ServersWithSpecificFlavorTestJSON-677930719 tempest-ServersWithSpecificFlavorTestJSON-677930719-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032907 Sep 14 09:20:22.944071 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 502/965] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:20:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:22.973668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:22.974520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:22.997949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:22.998529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:22.998997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.002354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.002845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.003645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.021663 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 HTTP/1.1 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'fa26f8cb-f4a0-4e68-86dd-0423d8559934'} Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:23.024807 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.029575 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.031314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:23.033103 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ba3eea88-564e-4926-ad79-0e6507172d05 tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 404 len: 111 microversion: 2.1 time: 0.064517 Sep 14 09:20:23.034756 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 503/966] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:22 2022] DELETE /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:20:23.044241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:23.045127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: fa26f8cb-f4a0-4e68-86dd-0423d8559934] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:23.054716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.056314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.056683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.057906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.058373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.059075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.077654 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 HTTP/1.1 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'fa26f8cb-f4a0-4e68-86dd-0423d8559934'} Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.080176 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance fa26f8cb-f4a0-4e68-86dd-0423d8559934 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e7187ce-7df8-4492-a90b-8183bdab5b0c tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934" status: 404 len: 111 microversion: 2.1 time: 0.043129 Sep 14 09:20:23.084440 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 504/967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:23 2022] GET /compute/v2.1/servers/fa26f8cb-f4a0-4e68-86dd-0423d8559934 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:23.097895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:23.098413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:23.104939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=22 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:23.107521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.108055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.108650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.109544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.110138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.111138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.129286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:23.132237 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 HTTP/1.1 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'db70afe2-8bc3-4daa-b118-de8ddc4fd012'} Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:23.134195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aa4d9acd-866f-479e-8767-97a240b7ff7a tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 404 len: 111 microversion: 2.1 time: 0.043591 Sep 14 09:20:23.138956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 505/968] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:20:23 2022] DELETE /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:23.142467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2cb8e852-94f1-4e9f-9cac-400b54c92353 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Invalid IP protocol tempest-999-1570202947. Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cb8e852-94f1-4e9f-9cac-400b54c92353 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 157 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: {"security_group_rule": {"parent_group_id": "d1812112-127b-4237-a8aa-a4e78fcceda4", "ip_protocol": "tempest-999-1570202947", "from_port": 22, "to_port": 22}} Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid IP protocol tempest-999-1570202947. Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd1812112-127b-4237-a8aa-a4e78fcceda4', 'ip_protocol': 'tempest-999-1570202947', 'from_port': 22, 'to_port': 22}}} Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1570202947. Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1570202947. Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.143948 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1570202947. Sep 14 09:20:23.148915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.149727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:23.149727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] [instance: db70afe2-8bc3-4daa-b118-de8ddc4fd012] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:23.149901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cb8e852-94f1-4e9f-9cac-400b54c92353 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: Invalid IP protocol tempest-999-1570202947. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:23.151241 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cb8e852-94f1-4e9f-9cac-400b54c92353 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.405418 Sep 14 09:20:23.156591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 464/969] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:22 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 407 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:20:23.162514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a74369f4-b130-4c53-bd07-296586a1a952 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693fcfe5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-512723893", "description": "tempest-description-1598673231"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:23.169278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.169713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.170208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.170928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.171390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.171823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.190588 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] HTTP exception thrown: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Request method failure captured: Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 HTTP/1.1 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZwgTXJeX1dpzG2dPQ8OiMT3oI7xJhkbDQ5QROsCiNwPn6LNY7_DJ2pXWN0vjKvAHPTDLxetAFFxemOzGxtdnIO7iajpZEVf_SBzRIYH99iK3UFusuHOYalCGz9BSOipkKE0l7nYIw7MrqufGUT7LNzamLKgrD86Dk5LDwRwlItRM28 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d45ebdf7b6f3452bb868bec5bd60ca4c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d45ebdf7b6f3452bb868bec5bd60ca4c"}]}] Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d45ebdf7b6f3452bb868bec5bd60ca4c Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 55337a61f6f54038a60f21aa891ccee1 Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-317029897-project Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'db70afe2-8bc3-4daa-b118-de8ddc4fd012'} Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.192223 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] Returning 404 to user: Instance db70afe2-8bc3-4daa-b118-de8ddc4fd012 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:23.196500 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6b185447-e612-4f32-b393-1cf4bdb96fba tempest-ServersWithSpecificFlavorTestJSON-317029897 tempest-ServersWithSpecificFlavorTestJSON-317029897-project] 10.222.0.90 "GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012" status: 404 len: 111 microversion: 2.1 time: 0.052765 Sep 14 09:20:23.199007 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 506/970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:20:23 2022] GET /compute/v2.1/servers/db70afe2-8bc3-4daa-b118-de8ddc4fd012 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:23.245620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:23.246746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:23.256921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.257504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.258251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:23.259031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:23.259500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:23.259988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:24.194928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:24.253892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:24.269582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:24.273262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:24.276222 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-886dc96b-e1cc-4289-af12-43a6144fb172 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1813 microversion: 2.25 time: 1.036975 Sep 14 09:20:24.301143 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 507/971] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:23 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1813 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:20:24.309305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2570ca29-2a2d-4255-a87f-197568bf9f4a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f89f040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:24.387221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2570ca29-2a2d-4255-a87f-197568bf9f4a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.084364 Sep 14 09:20:24.388514 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 508/972] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:24 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:24.389193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a74369f4-b130-4c53-bd07-296586a1a952 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.230641 Sep 14 09:20:24.389787 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 465/973] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:20:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:24.405841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95a0de25-c5d5-412d-ba88-d4608f3e0a90 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693f880c10>, body: {"security_group_rule": {"parent_group_id": "cb1cb0da-664a-495e-acff-f79fdb5529e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:24.591874 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-95a0de25-c5d5-412d-ba88-d4608f3e0a90 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95a0de25-c5d5-412d-ba88-d4608f3e0a90 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 138 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: {"security_group_rule": {"parent_group_id": "cb1cb0da-664a-495e-acff-f79fdb5529e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cb1cb0da-664a-495e-acff-f79fdb5529e9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 09:20:24.594841 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 14 09:20:24.599696 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:20:24.601574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95a0de25-c5d5-412d-ba88-d4608f3e0a90 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:24.602720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-95a0de25-c5d5-412d-ba88-d4608f3e0a90 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.201537 Sep 14 09:20:24.615384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e065894-5a46-47c3-b1cd-666a426c941a tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693fd0dee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-582306429", "description": "tempest-description-1597605748"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:24.620348 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 509/974] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:24 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:20:25.316151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:25.317705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:25.332970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:25.334904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:25.336739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:25.337593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:25.337956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:25.342082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:25.379569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e065894-5a46-47c3-b1cd-666a426c941a tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.766009 Sep 14 09:20:25.380796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 466/975] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:20:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:25.395074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cf40127-91a6-49fc-96c8-b65958a8fa6f tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f69440ee700>, body: {"security_group_rule": {"parent_group_id": "e8838cd2-3a81-44fc-8b2a-9d8c479157c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1764091487}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:26.093542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5cf40127-91a6-49fc-96c8-b65958a8fa6f tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cf40127-91a6-49fc-96c8-b65958a8fa6f tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 146 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: {"security_group_rule": {"parent_group_id": "e8838cd2-3a81-44fc-8b2a-9d8c479157c7", "ip_protocol": "tcp", "from_port": 22, "to_port": 1764091487}} Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e8838cd2-3a81-44fc-8b2a-9d8c479157c7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1764091487}}} Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 Sep 14 09:20:26.097179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 Sep 14 09:20:26.101245 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.104069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cf40127-91a6-49fc-96c8-b65958a8fa6f tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 400 to user: Invalid port range 22:1764091487. Valid TCP ports should be between 1-65535 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:26.105170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cf40127-91a6-49fc-96c8-b65958a8fa6f tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.714612 Sep 14 09:20:26.106947 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 467/976] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:25 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 716 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:20:26.131364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f7214c5-8eb3-46a4-8522-c0bb3f4080d2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fc36700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:26.229184 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f7214c5-8eb3-46a4-8522-c0bb3f4080d2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.120878 Sep 14 09:20:26.232920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 468/977] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:26 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:26.241889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Action: 'create', calling method: .version_select at 0x7f693fa19f70>, body: {"security_group_rule": {"parent_group_id": "df502b6e-8b4b-4784-ba27-ef885da68c16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:26.308370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:26.310931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:20:26.311287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Neutron security group df502b6e-8b4b-4784-ba27-ef885da68c16 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:20:26.311821 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.311821 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 138 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: {"security_group_rule": {"parent_group_id": "df502b6e-8b4b-4784-ba27-ef885da68c16", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'df502b6e-8b4b-4784-ba27-ef885da68c16', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:20:26.318557 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] Sep 14 09:20:26.322556 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.327379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 404 to user: Security group df502b6e-8b4b-4784-ba27-ef885da68c16 does not exist Sep 14 09:20:26.327379 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1d36ac03-4dda-4a46-b6b3-e8d165415c05'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:26.328731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65d08c05-c707-4bb7-924e-1ef2cab47bea tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.095031 Sep 14 09:20:26.337521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 469/978] 10.222.0.90 () {60 vars in 1195 bytes} [Wed Sep 14 09:20:26 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:26.346295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693fa19700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:26.351104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:26.357505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:20:26.363611 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-500ffd20-0455-491f-89e0-d2f6fef18c1c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1803 microversion: 2.25 time: 1.053554 Sep 14 09:20:26.365702 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 510/979] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:25 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1803 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:26.391982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b7640afe-0457-4004-b1fc-4729d308921a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '.version_select at 0x7f693f812820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:26.397710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7640afe-0457-4004-b1fc-4729d308921a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:26.398878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7640afe-0457-4004-b1fc-4729d308921a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:26.399615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7640afe-0457-4004-b1fc-4729d308921a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:26.420170 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b7640afe-0457-4004-b1fc-4729d308921a tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 1288 microversion: 2.25 time: 0.033056 Sep 14 09:20:26.432803 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 511/980] 10.222.0.90 () {60 vars in 1184 bytes} [Wed Sep 14 09:20:26 2022] GET /compute/v2.1/os-migrations => generated 1288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:20:26.441651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:26.442864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:26.446041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:20:26.446701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Neutron security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 not found {{(pid=122444) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 14 09:20:26.447225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] HTTP exception thrown: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.447225 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.449997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Request method failure captured: Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-group-rules/79bdc160-4d00-4405-9292-2f76b2b7b469 HTTP/1.1 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzP7FFbPzzhRxexAOxjW5U4XeldfxNHVrfLF1Zf-Wb9Rb9rLJ6m3NsrQw5JS6HUuaGO8fX4rZaC6bptKhGv9vAcegj-71RBFXufDnrnW4VSJi4Jon0hqQV2rqL1XjnNVWdqPtds2xBA12HbLyM_v-Yh87Ajn4cwBpBJy7PMAYOu0EQ Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_eee7e85651014ca2b4fcfbae2ed5b1ca", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/eee7e85651014ca2b4fcfbae2ed5b1ca"}]}] Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: eee7e85651014ca2b4fcfbae2ed5b1ca Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d9910026d07c439d943b19a29d8c99b8 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-168192819-project Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '79bdc160-4d00-4405-9292-2f76b2b7b469'} Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:20:26.450309 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] Sep 14 09:20:26.454518 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:20:26.456949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:26.456949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:26.457115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Returning 404 to user: Security group rule 79bdc160-4d00-4405-9292-2f76b2b7b469 does not exist Sep 14 09:20:26.457115 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f625a384-b0c6-437a-a597-af01aee5bcde'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:20:26.457274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:26.457354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a56d7856-f1d5-42fd-a35f-07aeafebe215 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-group-rules/79bdc160-4d00-4405-9292-2f76b2b7b469" status: 404 len: 199 microversion: 2.1 time: 0.113065 Sep 14 09:20:26.457438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:26.457520 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 470/981] 10.222.0.90 () {58 vars in 1287 bytes} [Wed Sep 14 09:20:26 2022] DELETE /compute/v2.1/os-security-group-rules/79bdc160-4d00-4405-9292-2f76b2b7b469 => generated 199 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:20:26.459935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:26.475846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4df91996-fea5-44e5-a2d8-4ee3eadb6827 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693fa190d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:27.172718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:27.201268 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b87039d3-0f1a-4c48-8203-f51cc5aec277 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 2424 microversion: 2.25 time: 0.761094 Sep 14 09:20:27.215922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 512/982] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:26 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 2424 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:27.243335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:27.244477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:27.261289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:27.262420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:27.264223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:27.265229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:27.268211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:27.268884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:27.678066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4df91996-fea5-44e5-a2d8-4ee3eadb6827 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/e8838cd2-3a81-44fc-8b2a-9d8c479157c7" status: 202 len: 0 microversion: 2.1 time: 1.218561 Sep 14 09:20:27.682097 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 471/983] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:20:26 2022] DELETE /compute/v2.1/os-security-groups/e8838cd2-3a81-44fc-8b2a-9d8c479157c7 => generated 0 bytes in 1224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:20:27.691266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b2739b6-9072-4469-8db0-6c526cf36eeb tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fc36f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:27.823473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b2739b6-9072-4469-8db0-6c526cf36eeb tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.140013 Sep 14 09:20:27.824651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 472/984] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:27 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:27.842379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8a58975-a50f-4078-8562-810519ef60ed tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f69440ee3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:28.279756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:28.332966 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fdd6634-fc9b-44f8-bf9e-b864e78f236f tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 2424 microversion: 2.25 time: 1.098023 Sep 14 09:20:28.353706 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 513/985] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:20:27 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 2424 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:20:28.559386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:28.562458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:28.581120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:28.582231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:28.592161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:28.593183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:28.597126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:28.602720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:28.917788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lazy-loading 'services' on Instance uuid f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:20:29.135057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8a58975-a50f-4078-8562-810519ef60ed tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/cb1cb0da-664a-495e-acff-f79fdb5529e9" status: 202 len: 0 microversion: 2.1 time: 1.308823 Sep 14 09:20:29.136409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 473/986] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:20:27 2022] DELETE /compute/v2.1/os-security-groups/cb1cb0da-664a-495e-acff-f79fdb5529e9 => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:29.144497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c95fbe07-2850-4f77-b80b-0b0ba96c5027 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f69444e1f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:29.224741 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77ba1ad3-afc7-4365-a027-eeab50819b40 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments/0eb04419-1e4e-425c-9ef9-75740dcf724c" status: 202 len: 0 microversion: 2.25 time: 0.690506 Sep 14 09:20:29.236995 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 514/987] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Sep 14 09:20:28 2022] DELETE /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments/0eb04419-1e4e-425c-9ef9-75740dcf724c => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:20:29.247357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4b2a863-2e7a-43ca-9fc4-20d02be9d743 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693f78d670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:29.276551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c95fbe07-2850-4f77-b80b-0b0ba96c5027 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.137084 Sep 14 09:20:29.285795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 474/988] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:29 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:29.293527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:29.296391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:29.349347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:29.351183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:29.351873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:29.356818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:29.357306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:29.363990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:29.498180 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-148e70a0-79e0-487d-aca1-098812acf52d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.216716 Sep 14 09:20:29.509776 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 475/989] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:29 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:29.615119 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d4b2a863-2e7a-43ca-9fc4-20d02be9d743 tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/d1812112-127b-4237-a8aa-a4e78fcceda4" status: 202 len: 0 microversion: 2.1 time: 0.374743 Sep 14 09:20:29.621719 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 515/990] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:20:29 2022] DELETE /compute/v2.1/os-security-groups/d1812112-127b-4237-a8aa-a4e78fcceda4 => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:29.636680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3eef2976-4227-4356-8bee-de7e235291cc tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693fa758b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:30.128069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3eef2976-4227-4356-8bee-de7e235291cc tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/6a2c4d00-bb1f-4856-a79e-82680bedfbd2" status: 202 len: 0 microversion: 2.1 time: 0.506614 Sep 14 09:20:30.128883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 476/991] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:20:29 2022] DELETE /compute/v2.1/os-security-groups/6a2c4d00-bb1f-4856-a79e-82680bedfbd2 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:30.140097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f5ae2e6e-5bc2-43b0-bbb5-de54958d1ffb tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] Calling method '.version_select at 0x7f693f812820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:30.293864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b19f050d-f20d-4884-88b4-ce4c5eed1d8d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa58430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:30.374213 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b19f050d-f20d-4884-88b4-ce4c5eed1d8d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.084419 Sep 14 09:20:30.385108 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 477/992] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:30 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:30.514840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:30.522438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:30.536476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:30.536907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:30.537322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:30.538041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:30.540898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:30.541346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:30.615002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5933b82e-60e8-4920-859a-7576063ab2e9 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.106975 Sep 14 09:20:30.626333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 478/993] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:30 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:30.667063 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f5ae2e6e-5bc2-43b0-bbb5-de54958d1ffb tempest-SecurityGroupRulesNegativeTestJSON-168192819 tempest-SecurityGroupRulesNegativeTestJSON-168192819-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/fa399e9d-f7bd-47a9-8822-279f895bc7f8" status: 202 len: 0 microversion: 2.1 time: 0.529876 Sep 14 09:20:30.678079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 516/994] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:20:30 2022] DELETE /compute/v2.1/os-security-groups/fa399e9d-f7bd-47a9-8822-279f895bc7f8 => generated 0 bytes in 545 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:20:31.107476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:31.130818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:31.131527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:31.134669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:31.173479 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] Creating event network-vif-plugged:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:20:31.192581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c36acba6-cdb7-4c81-adaf-fd191055d97e req-7c325210-032b-4951-a569-4d146b7fecea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089042 Sep 14 09:20:31.198884 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 479/995] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:20:31.391722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-444b8fb9-2d12-4974-bd88-9a63bb006330 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f790820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:31.493860 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-444b8fb9-2d12-4974-bd88-9a63bb006330 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.106765 Sep 14 09:20:31.504056 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 517/996] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:31 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:20:31.630978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:31.634852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:31.660637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:31.662722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:31.663721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:31.666351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:31.667358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:31.669006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:31.773362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f61ce24-2f2d-4bed-83a7-f0e73bc4556e tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.147417 Sep 14 09:20:31.784286 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 480/997] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:31 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:32.512526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfa9833a-074a-48c7-9586-3dda071a0b1f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f807d30>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:32.615204 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfa9833a-074a-48c7-9586-3dda071a0b1f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.108043 Sep 14 09:20:32.629801 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 518/998] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:32 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:32.789969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:32.795607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:32.814132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:32.818481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:32.819270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:32.826218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:32.827024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:32.827694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:32.912349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9cfd3c6-1ac6-4863-bc0f-403fab7baeaa tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126446 Sep 14 09:20:32.917823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 481/999] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:32 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:33.637974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-531500e6-8ee2-4563-b832-a67f29ff13f0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f7904c0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:33.782507 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-531500e6-8ee2-4563-b832-a67f29ff13f0 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.148682 Sep 14 09:20:33.783512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 519/1000] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:33 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:33.925822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:33.928020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:33.941986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:33.942767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:33.948948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:33.950041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:33.950833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:33.951463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:34.035473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5818c16f-b2b5-405b-952c-06f3093255e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113906 Sep 14 09:20:34.052340 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 482/1001] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:33 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:34.803214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fac9836-15cf-4785-8e63-c15a08804e6a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f7320d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:34.892091 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fac9836-15cf-4785-8e63-c15a08804e6a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.093789 Sep 14 09:20:34.900920 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 520/1002] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:34 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:35.058622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:35.061266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:35.074038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:35.087877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:35.096606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:35.097830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:35.098419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:35.098981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:35.239150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-161b2e73-85b0-4e8e-8e6c-40d380e9c716 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.185621 Sep 14 09:20:35.244912 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 483/1003] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:35 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:35.909970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1cb7308-9614-47f7-a4c2-6c5bb3d773b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f741f70>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:35.974351 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1cb7308-9614-47f7-a4c2-6c5bb3d773b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.069988 Sep 14 09:20:35.974935 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 521/1004] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:35 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:36.253651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:36.255823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:36.273949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:36.284436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:36.285168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:36.286097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:36.288963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:36.296603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:36.452090 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1e5167c-5be7-42bd-8357-abebc36d2db0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.202921 Sep 14 09:20:36.467216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 484/1005] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:36 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:36.993221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d168212c-8f52-4cd8-9fc7-a23144406f13 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f880b80>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:37.088114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d168212c-8f52-4cd8-9fc7-a23144406f13 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.100688 Sep 14 09:20:37.088701 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 522/1006] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:36 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:37.468837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:37.472869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:37.508186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:37.509067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:37.509740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:37.510732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:37.511596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:37.512355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:37.590042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d58c7d21-78f5-4087-87fb-99fe03646bf4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.125493 Sep 14 09:20:37.595409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 485/1007] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:37 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:38.104676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16104983-3ca1-487b-a9d5-170635a2d0ac tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f7415e0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:38.204565 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-16104983-3ca1-487b-a9d5-170635a2d0ac tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.090477 Sep 14 09:20:38.225848 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 523/1008] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:38 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:38.603663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:38.607322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:38.621723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:38.625207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:38.626980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:38.629621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:38.630346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:38.633591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:38.717681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e1719ee-ff8f-412e-90aa-e2092837bce1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118785 Sep 14 09:20:38.724214 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 486/1009] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:38 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:39.227861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:39.230257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:39.234484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4012adf1-0ce0-487e-bb75-7b213a69e4f6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f836700>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:39.335739 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4012adf1-0ce0-487e-bb75-7b213a69e4f6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.108631 Sep 14 09:20:39.348319 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 524/1010] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:39 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:39.734830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:39.737874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:39.754372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:39.755124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:39.757152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:39.758075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:39.764219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:39.764884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:39.866487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2bcebe2-cf90-4cc8-9e9b-477934ab5f92 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139294 Sep 14 09:20:39.877876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 487/1011] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:39 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:40.351489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0707ee3e-eab8-46d1-acce-e81e0c5c4128 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f741f70>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:40.464001 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0707ee3e-eab8-46d1-acce-e81e0c5c4128 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.115517 Sep 14 09:20:40.465303 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 525/1012] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:40 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:40.892786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:40.895425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:40.933775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:40.934948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:40.935656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:40.936684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:40.937413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:40.938397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:41.010723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2902bc8-2498-4ca5-895d-fca92da7e09a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124362 Sep 14 09:20:41.021289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 488/1013] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:40 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:20:41.484260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-360140ab-f7b4-487d-9498-dae6595ca8ee tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f732310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:41.581146 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-360140ab-f7b4-487d-9498-dae6595ca8ee tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.103734 Sep 14 09:20:41.582820 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 526/1014] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:41 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:42.032450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:42.037543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:20:42.093515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:42.096929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:42.100914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:42.101924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:20:42.105012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:20:42.109930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:20:42.266492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b3f8f6d-f218-4b2e-9294-6abc24663932 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.243073 Sep 14 09:20:42.284737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 489/1015] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:20:42 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5/os-volume_attachments => generated 25 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:42.598444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9e0d7d3-e12e-4c63-9cba-c83dfd6dd338 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f7c8a60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:42.675706 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9e0d7d3-e12e-4c63-9cba-c83dfd6dd338 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.082669 Sep 14 09:20:42.678442 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 527/1016] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:42 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:43.693789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4b83a58-8f6b-439d-8a81-56e4712f7d00 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fc52ca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:43.767817 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4b83a58-8f6b-439d-8a81-56e4712f7d00 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.078012 Sep 14 09:20:43.772394 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 490/1017] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:43 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:44.793476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7d6c14df-0a3d-41ca-ad9c-aaef19e56ac5 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f75a040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:44.908780 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7d6c14df-0a3d-41ca-ad9c-aaef19e56ac5 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1455 microversion: 2.1 time: 0.124862 Sep 14 09:20:44.909396 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 528/1018] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:44 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:20:45.928156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbae9146-aedd-4a01-8427-2fc46ea3b33f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa29a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:20:47.540423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-870818306", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "003564fa-1b55-4009-b4b0-9a0593450554"}, {"uuid": "8bc79efc-ae37-4130-a450-ea238391a68d"}, {"uuid": "003564fa-1b55-4009-b4b0-9a0593450554"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:20:52.076997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:52.265397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:20:57.582245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:00.303469 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbae9146-aedd-4a01-8427-2fc46ea3b33f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1464 microversion: 2.1 time: 14.380231 Sep 14 09:21:00.314229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 491/1019] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:20:45 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1464 bytes in 14384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:00.323733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] validate_networks() for [('003564fa-1b55-4009-b4b0-9a0593450554', None, None, None, None, None), ('8bc79efc-ae37-4130-a450-ea238391a68d', None, None, None, None, None), ('003564fa-1b55-4009-b4b0-9a0593450554', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:21:00.846392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fff03664-ee51-4b6c-9ebc-87eab7365d43 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Action: 'create', calling method: .version_select at 0x7f69443381f0>, body: {"keypair": {"name": "tempest-keypair-1227485078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSBr1bcwY6AyX0mc+zOhJkvJ/T6gd4BXRR6VJJsZ0ycA4A6cj5PiFB+PCcqRY+ItLH/3QjUDPpZlDdnd3pvPVBdsZdlsQt191zarMVi9Bdy9dPFg7TiftWBFocHdIaHJw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:00.906512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fff03664-ee51-4b6c-9ebc-87eab7365d43 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for project 825ea15fe0f146febd1f7688696919f1. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:00.913920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fff03664-ee51-4b6c-9ebc-87eab7365d43 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for user 1ea0d4dffcad4fee8c815aad29679973 and project 825ea15fe0f146febd1f7688696919f1. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:00.966425 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fff03664-ee51-4b6c-9ebc-87eab7365d43 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.659047 Sep 14 09:21:00.971677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 492/1020] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:21:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:01.335704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Action: 'create', calling method: .version_select at 0x7f693fa3e040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:01.463406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Getting quotas for project 84d203cf20dc44bd8e24f6d45fef2069. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:01.473523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Getting quotas for user cf49cbb7e1f54435811e1bb98a461477 and project 84d203cf20dc44bd8e24f6d45fef2069. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:01.629109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Getting quotas for project 84d203cf20dc44bd8e24f6d45fef2069. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:01.644662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Getting quotas for user cf49cbb7e1f54435811e1bb98a461477 and project 84d203cf20dc44bd8e24f6d45fef2069. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:01.694802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed2a0f4a-b703-4b2b-a6cf-e42910f110ca tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.718453 Sep 14 09:21:01.707780 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 493/1021] 10.222.0.90 () {62 vars in 1214 bytes} [Wed Sep 14 09:21:00 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:01.741387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcf3e169-3807-4326-a8f7-f235c373fc37 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa3eca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:01.916012 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcf3e169-3807-4326-a8f7-f235c373fc37 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 200 len: 1464 microversion: 2.1 time: 0.199537 Sep 14 09:21:01.916620 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 494/1022] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:01 2022] GET /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:01.928248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b1bdf83-1491-4ccf-88e3-9a69284fc57b tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:02.048979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b1bdf83-1491-4ccf-88e3-9a69284fc57b tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.123593 Sep 14 09:21:02.050857 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 495/1023] 10.222.0.90 () {60 vars in 1193 bytes} [Wed Sep 14 09:21:01 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:02.086274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:02.089547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:02.120518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:02.123785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:02.126215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:02.129730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:02.132835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:02.135047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:03.683586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:03.696075 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d8706a0-1b7a-47f7-9e60-8d46d0c9927e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1467 microversion: 2.1 time: 1.630892 Sep 14 09:21:03.696675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 496/1024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:02 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1467 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:03.717276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f1bc12a-547c-4b41-af49-0ffa263eb927 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:03.763653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f1bc12a-547c-4b41-af49-0ffa263eb927 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec" status: 200 len: 235 microversion: 2.64 time: 0.065866 Sep 14 09:21:03.772652 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 497/1025] 10.222.0.90 () {60 vars in 1304 bytes} [Wed Sep 14 09:21:03 2022] GET /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec => generated 235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:03.783223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1443346127"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:03.787219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:03.796105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:03.796897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:03.797570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:03.798534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:03.799190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:03.799796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:04.162562 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd95a554-755d-4da9-8c73-e40a3b17abb3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "POST /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828/action" status: 202 len: 0 microversion: 2.1 time: 0.384996 Sep 14 09:21:04.167329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 498/1026] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:21:03 2022] POST /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:21:04.182752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f551e71-f170-4126-b526-3f59773c4838 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:04.265709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f551e71-f170-4126-b526-3f59773c4838 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec" status: 204 len: 0 microversion: 2.64 time: 0.096840 Sep 14 09:21:04.266362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 499/1027] 10.222.0.90 () {60 vars in 1307 bytes} [Wed Sep 14 09:21:04 2022] DELETE /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:21:04.285554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7fd3b26-c26c-4fbb-b69b-78b4fdc25d60 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa3dd30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:04.429437 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7fd3b26-c26c-4fbb-b69b-78b4fdc25d60 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.154808 Sep 14 09:21:04.432438 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 500/1028] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:04 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:04.457715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54b86498-ffc8-491c-8a41-af8cbcb83d63 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:04.476154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-54b86498-ffc8-491c-8a41-af8cbcb83d63 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] HTTP exception thrown: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54b86498-ffc8-491c-8a41-af8cbcb83d63 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Request method failure captured: Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec HTTP/1.1 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZz4QLZOUCm1wKHIDFjmYPcDVgXlWxg8WOfM9IXqxOOkr7orQzneSraoC2jk6JBLQEKDISU-2LgLBcBPvYKm0A9cgvr9JZqYamZTjBDP5dSCCzkgdwwF1k7Tlz3_n1oHaym4Q_w2177JaLDrgbpzmXboleaIXJxdmqSbfb6BcIUlsLg Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.64 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 84d203cf20dc44bd8e24f6d45fef2069 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroup264TestJSON-2045168007 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_84d203cf20dc44bd8e24f6d45fef2069", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/84d203cf20dc44bd8e24f6d45fef2069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/84d203cf20dc44bd8e24f6d45fef2069"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/84d203cf20dc44bd8e24f6d45fef2069"}]}] Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroup264TestJSON-2045168007 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 84d203cf20dc44bd8e24f6d45fef2069 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2045168007 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroup264TestJSON-2045168007-project Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: cf49cbb7e1f54435811e1bb98a461477 Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroup264TestJSON-2045168007-project Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd36ea79c-8b2d-49c2-b5b5-179eca3cb1ec'} Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:21:04.514780 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. Sep 14 09:21:04.520301 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:21:04.522784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54b86498-ffc8-491c-8a41-af8cbcb83d63 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] Returning 404 to user: Instance group d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:21:04.527304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54b86498-ffc8-491c-8a41-af8cbcb83d63 tempest-ServerGroup264TestJSON-2045168007 tempest-ServerGroup264TestJSON-2045168007-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec" status: 404 len: 117 microversion: 2.64 time: 0.093501 Sep 14 09:21:04.529206 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 501/1029] 10.222.0.90 () {60 vars in 1307 bytes} [Wed Sep 14 09:21:04 2022] DELETE /compute/v2.1/os-server-groups/d36ea79c-8b2d-49c2-b5b5-179eca3cb1ec => generated 117 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:21:04.557449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-796224987", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5e6e918b-a89f-44f4-bc4b-88619faf5651"}], "security_groups": [{"name": "tempest-securitygroup--1174090334"}], "key_name": "tempest-keypair-1227485078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:05.335817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] validate_networks() for [('5e6e918b-a89f-44f4-bc4b-88619faf5651', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:21:06.195869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:21:06.195869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:21:06.195869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:21:06.197426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:21:06.197426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:21:06.225209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:06.226590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:06.227251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:06.229278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:06.244834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:06.246993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:06.327771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Getting quotas for project 421a08fa24cf4b89abc73bc3770d6a40. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:06.337880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Getting quotas for user 374349250ea545b8936dff89d329be60 and project 421a08fa24cf4b89abc73bc3770d6a40. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:06.374302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:21:06.380957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:21:06.531078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8a792ac4-45be-49a3-bae0-450970e0c184 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.992799 Sep 14 09:21:06.536927 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 529/1030] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 19002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:21:06.958889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-765516fa-4ad5-4f75-a1f9-618f79e1ca46 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1440479346", "id": 368574583, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:07.025157 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-765516fa-4ad5-4f75-a1f9-618f79e1ca46 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.484515 Sep 14 09:21:07.037485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 530/1031] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:06 2022] POST /compute/v2.1/flavors => generated 427 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:07.042931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7985b0a-fe51-481f-89c1-391aa3f6fadf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f7c8430>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.112086 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e7985b0a-fe51-481f-89c1-391aa3f6fadf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.083338 Sep 14 09:21:07.122258 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 531/1032] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:07.128365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:07.140483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.141329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.141962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.155888 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] Creating event network-vif-unplugged:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:21:07.162611 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ea781a26-3be6-429f-af6b-a7064b071f2b req-20d5c86e-3527-4b28-8fcc-f40a243c2e22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038628 Sep 14 09:21:07.177252 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 532/1033] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:07.188036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1fd1743-02f7-425e-aad6-92065868ed79 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.196297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a1fd1743-02f7-425e-aad6-92065868ed79 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:07.441312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for project 825ea15fe0f146febd1f7688696919f1. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:07.465720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for user 1ea0d4dffcad4fee8c815aad29679973 and project 825ea15fe0f146febd1f7688696919f1. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:07.508679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:21:07.510840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:21:07.512897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:21:07.514295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:21:07.515720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:21:07.575639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.576156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.584268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.585339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:07.592701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:07.593453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:07.639616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a1fd1743-02f7-425e-aad6-92065868ed79 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:07.650684 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a1fd1743-02f7-425e-aad6-92065868ed79 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1212 microversion: 2.1 time: 0.469964 Sep 14 09:21:07.653022 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 533/1034] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1212 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:07.673574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cb430796-ac35-4b93-a6fe-197674f1ba63 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.683019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for project 825ea15fe0f146febd1f7688696919f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:07.700522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Getting quotas for user 1ea0d4dffcad4fee8c815aad29679973 and project 825ea15fe0f146febd1f7688696919f1. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:07.729337 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb430796-ac35-4b93-a6fe-197674f1ba63 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/368574583" status: 202 len: 0 microversion: 2.1 time: 0.074996 Sep 14 09:21:07.736213 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 534/1035] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:21:07 2022] DELETE /compute/v2.1/flavors/368574583 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:07.748017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee5a2e3b-6e72-4cc9-97f5-a06c29f5e472 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.769399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:21:07.777137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:21:07.809100 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee5a2e3b-6e72-4cc9-97f5-a06c29f5e472 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071738 Sep 14 09:21:07.830254 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 535/1036] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:07.837079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-225be321-1bc3-46c7-91a4-31734b893cb5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1098775135", "id": 804396489, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:07.889103 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-225be321-1bc3-46c7-91a4-31734b893cb5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.056350 Sep 14 09:21:07.898654 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 536/1037] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:07 2022] POST /compute/v2.1/flavors => generated 414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:07.925425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cb13a764-8412-419c-815b-5eb00309c7c3 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:07.977536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43e5196f-e3bd-4e04-b3f6-ea9cd1c45da5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.443397 Sep 14 09:21:07.993148 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 502/1038] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:21:08.006533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99ef5e67-2a3a-47bd-944d-4fc1c8264871 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:08.007150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99ef5e67-2a3a-47bd-944d-4fc1c8264871 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:08.067397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb13a764-8412-419c-815b-5eb00309c7c3 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.138958 Sep 14 09:21:08.070182 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 537/1039] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:08.132166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f4291f14-39ec-4247-bbeb-b5490b02110e tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:08.237957 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f4291f14-39ec-4247-bbeb-b5490b02110e tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/804396489" status: 202 len: 0 microversion: 2.1 time: 0.121499 Sep 14 09:21:08.251818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 538/1040] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:21:08 2022] DELETE /compute/v2.1/flavors/804396489 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:08.271433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2ec0a3cb-3f4f-4305-9ce7-2f54ff3c2cce tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f732af0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:08.842384 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2ec0a3cb-3f4f-4305-9ce7-2f54ff3c2cce tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.588400 Sep 14 09:21:08.849295 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 539/1041] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:08 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:08.859587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25bafa46-c241-41ac-95d9-5fb1588e115d tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:08.913554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-25bafa46-c241-41ac-95d9-5fb1588e115d tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061880 Sep 14 09:21:08.944227 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 540/1042] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:08.949187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:08.949810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:08.970349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:08.970969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:08.971421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:08.972192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:08.972647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:08.975335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:09.225737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99ef5e67-2a3a-47bd-944d-4fc1c8264871 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:09.237793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99ef5e67-2a3a-47bd-944d-4fc1c8264871 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1269 microversion: 2.1 time: 1.242693 Sep 14 09:21:09.240727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 503/1043] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:07 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1269 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:09.280080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5fcb1b10-a2ed-46b3-aa13-723f9e03bef5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1865450053", "id": 1962602812, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:09.352348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5fcb1b10-a2ed-46b3-aa13-723f9e03bef5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.108765 Sep 14 09:21:09.366870 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 504/1044] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:09 2022] POST /compute/v2.1/flavors => generated 429 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:09.380309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a397b0e8-27e8-4170-9589-0e0de7e70bf3 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.431646 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a397b0e8-27e8-4170-9589-0e0de7e70bf3 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1962602812" status: 202 len: 0 microversion: 2.1 time: 0.063220 Sep 14 09:21:09.432329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 505/1045] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:21:09 2022] DELETE /compute/v2.1/flavors/1962602812 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:09.448536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45b55e50-1309-41f0-a652-1c97d2cb577e tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.474037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:09.538390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45b55e50-1309-41f0-a652-1c97d2cb577e tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097538 Sep 14 09:21:09.541472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 506/1046] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:09.580364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09c5fda1-a639-4eb9-905a-f9637e6eaf12 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2141947993", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:09.622804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:09.648618 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35027292-bee6-4116-8837-0cad711de249 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1264 microversion: 2.1 time: 0.702358 Sep 14 09:21:09.650883 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 541/1047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:08 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1264 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:09.665654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09c5fda1-a639-4eb9-905a-f9637e6eaf12 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.089931 Sep 14 09:21:09.666266 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 507/1048] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:09 2022] POST /compute/v2.1/flavors => generated 507 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:09.682165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e964b64-57af-4b84-a463-f0fa0d0ff851 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.746272 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e964b64-57af-4b84-a463-f0fa0d0ff851 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/33885665-1961-4078-94b7-ceeb99023f53" status: 202 len: 0 microversion: 2.1 time: 0.067281 Sep 14 09:21:09.747484 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 542/1049] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:21:09 2022] DELETE /compute/v2.1/flavors/33885665-1961-4078-94b7-ceeb99023f53 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:09.757626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a64f9162-0410-4f23-9e23-8c7c90f3a3c5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.852906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a64f9162-0410-4f23-9e23-8c7c90f3a3c5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.099117 Sep 14 09:21:09.856223 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 508/1050] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:09.864556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-600b5c1b-cdd1-46b6-9d6e-14808581fe64 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f732310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:09.892389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e57e78f9-11fc-4267-8ae2-d6cdaa10cbd8 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-418601971", "id": "4a4faaf0-94ae-46a6-8572-82a00e295605", "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:09.964050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e57e78f9-11fc-4267-8ae2-d6cdaa10cbd8 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.077136 Sep 14 09:21:09.964678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 509/1051] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:09 2022] POST /compute/v2.1/flavors => generated 506 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:10.004122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e0c7b97-374e-4edb-8b70-611cb0a8ec50 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.029311 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-600b5c1b-cdd1-46b6-9d6e-14808581fe64 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.170148 Sep 14 09:21:10.039684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 543/1052] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:09 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:10.098646 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e0c7b97-374e-4edb-8b70-611cb0a8ec50 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/4a4faaf0-94ae-46a6-8572-82a00e295605" status: 202 len: 0 microversion: 2.1 time: 0.118759 Sep 14 09:21:10.099257 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 510/1053] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:21:09 2022] DELETE /compute/v2.1/flavors/4a4faaf0-94ae-46a6-8572-82a00e295605 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:10.113914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e01bf520-7a17-4e4c-91e2-d1e30d5b7cb6 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.182828 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e01bf520-7a17-4e4c-91e2-d1e30d5b7cb6 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076260 Sep 14 09:21:10.185595 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 544/1054] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:10.215309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c74f3d33-543a-45cb-826e-beb8fe5c3f50 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-256047905", "id": 1831483659, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:10.286526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.287164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:10.310524 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c74f3d33-543a-45cb-826e-beb8fe5c3f50 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.098177 Sep 14 09:21:10.335633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 511/1055] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:10 2022] POST /compute/v2.1/flavors => generated 413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:10.367398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-687fd1b1-97f4-456e-b7ae-2a5001241403 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.372506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:10.373015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:10.373464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:10.374195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:10.374656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:10.375285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:10.405851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-687fd1b1-97f4-456e-b7ae-2a5001241403 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/1831483659" status: 200 len: 413 microversion: 2.1 time: 0.066199 Sep 14 09:21:10.416269 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 512/1056] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:21:10 2022] GET /compute/v2.1/flavors/1831483659 => generated 413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:10.819480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff225aac-70a0-4779-bac1-ca2b08206d5e tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.888978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff225aac-70a0-4779-bac1-ca2b08206d5e tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.471441 Sep 14 09:21:10.900444 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 513/1057] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:10 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:10.907321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:10.908260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:10.919587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:10.924425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:10.925150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:10.926086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:10.928786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:10.932645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:12.418611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:12.448046 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc9cbd68-515e-4d5c-98f9-66f4ed754f8b tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1321 microversion: 2.1 time: 2.160832 Sep 14 09:21:12.450255 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 545/1058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:10 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1321 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:12.465538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-415b10ac-42d9-45df-becb-765b7cfd4671 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.536912 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-415b10ac-42d9-45df-becb-765b7cfd4671 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1831483659" status: 202 len: 0 microversion: 2.1 time: 0.080430 Sep 14 09:21:12.543202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 546/1059] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:21:12 2022] DELETE /compute/v2.1/flavors/1831483659 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:12.553716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e3b5028-5b71-4884-95e5-5aaf995fcb4c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8803a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.656373 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e3b5028-5b71-4884-95e5-5aaf995fcb4c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.107984 Sep 14 09:21:12.675323 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 547/1060] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:12 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:12.682618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a20d36b-97bf-4364-8469-7b41287a0b74 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:12.723829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:12.757573 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9fb39a53-4574-4777-a07f-0e8ec8c61502 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1270 microversion: 2.1 time: 1.846338 Sep 14 09:21:12.761318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 514/1061] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:10 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1270 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:12.767469 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a20d36b-97bf-4364-8469-7b41287a0b74 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081168 Sep 14 09:21:12.790722 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 548/1062] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:12.796985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43f3f31f-2783-47d2-a5ae-5b1ba9f915eb tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-400512479", "id": 1305200384, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:12.861545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43f3f31f-2783-47d2-a5ae-5b1ba9f915eb tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.068280 Sep 14 09:21:12.872943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 515/1063] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:12 2022] POST /compute/v2.1/flavors => generated 429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:12.874788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-337a9238-059c-406f-bc3d-6d25c1cc6fb2 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "1305200384"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:12.945633 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-337a9238-059c-406f-bc3d-6d25c1cc6fb2 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] HTTP exception thrown: Flavor 1305200384 could not be found. Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-337a9238-059c-406f-bc3d-6d25c1cc6fb2 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Request method failure captured: Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 107 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZz_UG0FNWYF_rwvp-KM2mhLTMhdkPb9hh2jbUvyW7Vro6DE95bhI3ZDyqKeKcObQMubWFMxB_6TraHuv4apoXr-oXjMwNQ_Hpj3rEjURNQ_HEMgcnm8IaHlzyC_jAa1jL_wAZex8c7DS1K424aOzLGtDvK3AK4Tl_K-F4TRjjDBMZM Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 926daf6f6f5744c6ad7dd8ce1a971e4b Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-FlavorsAdminTestJSON-1325005590 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_926daf6f6f5744c6ad7dd8ce1a971e4b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/926daf6f6f5744c6ad7dd8ce1a971e4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/926daf6f6f5744c6ad7dd8ce1a971e4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/926daf6f6f5744c6ad7dd8ce1a971e4b"}]}] Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-FlavorsAdminTestJSON-1325005590 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 926daf6f6f5744c6ad7dd8ce1a971e4b Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1325005590 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-FlavorsAdminTestJSON-1325005590-project Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: bed9ec16bdcf410599e1af708c717182 Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-FlavorsAdminTestJSON-1325005590-project Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "test", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "1305200384"}} Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: exception: Flavor 1305200384 could not be found. Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '1305200384'}}} Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1305200384 could not be found. Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:21:12.957268 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1305200384 could not be found. Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1305200384 could not be found. Sep 14 09:21:12.962314 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:21:12.971112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-337a9238-059c-406f-bc3d-6d25c1cc6fb2 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Returning 400 to user: Flavor 1305200384 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:21:12.975755 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-337a9238-059c-406f-bc3d-6d25c1cc6fb2 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.097131 Sep 14 09:21:12.976620 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 549/1064] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:12 2022] POST /compute/v2.1/servers => generated 81 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:21:12.986288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abb1e9fa-6f14-45c4-8236-132510c1a3f4 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.045781 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abb1e9fa-6f14-45c4-8236-132510c1a3f4 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1305200384" status: 202 len: 0 microversion: 2.1 time: 0.063506 Sep 14 09:21:13.048795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 516/1065] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:21:12 2022] DELETE /compute/v2.1/flavors/1305200384 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:13.060689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ae19331-f131-4ebd-a055-4712243b0eb5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.124038 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ae19331-f131-4ebd-a055-4712243b0eb5 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070612 Sep 14 09:21:13.137079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 550/1066] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:13.183173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8cf219d6-d70a-4d3a-800d-434571c83e5a tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1265985951", "id": 5432958, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:13.241478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8cf219d6-d70a-4d3a-800d-434571c83e5a tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.1 time: 0.081789 Sep 14 09:21:13.245061 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 517/1067] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:13.264542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffa009d3-a555-45a9-95c2-138adb8e99f4 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1224005300", "id": 1528918436, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:13.311581 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ffa009d3-a555-45a9-95c2-138adb8e99f4 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.057485 Sep 14 09:21:13.321291 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 551/1068] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:13 2022] POST /compute/v2.1/flavors => generated 414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:13.338870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e78994c9-7e0b-4949-a23c-9e9c1ccb9547 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.389010 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e78994c9-7e0b-4949-a23c-9e9c1ccb9547 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 409 microversion: 2.1 time: 0.057842 Sep 14 09:21:13.397022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 518/1069] 10.222.0.90 () {58 vars in 1169 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:13.410847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7a3f0b9-fee9-4a1c-a648-213660ebd0bc tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.445964 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7a3f0b9-fee9-4a1c-a648-213660ebd0bc tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 409 microversion: 2.1 time: 0.038885 Sep 14 09:21:13.458520 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 552/1070] 10.222.0.90 () {58 vars in 1177 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 409 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:13.476108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6e07bdd-be41-425b-bde4-377448b0e19c tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.483779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.484934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:13.506963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:13.512853 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6e07bdd-be41-425b-bde4-377448b0e19c tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 409 microversion: 2.1 time: 0.044784 Sep 14 09:21:13.514429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:13.516800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:13.518821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:13.524829 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 519/1071] 10.222.0.90 () {58 vars in 1171 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 409 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:13.525422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:13.526244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:13.552067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2799fb4a-8a9f-4f6c-8a6b-b14741f9c5dd tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.596938 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2799fb4a-8a9f-4f6c-8a6b-b14741f9c5dd tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 409 microversion: 2.1 time: 0.059949 Sep 14 09:21:13.605648 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 520/1072] 10.222.0.90 () {58 vars in 1169 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:13.630702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be5eaaed-8186-4ae6-9924-255320a61ab8 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.752510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be5eaaed-8186-4ae6-9924-255320a61ab8 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.136952 Sep 14 09:21:13.754794 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 521/1073] 10.222.0.90 () {58 vars in 1169 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:13.772116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd9268aa-a763-440a-9c10-23c11483d916 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fda8040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.898247 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd9268aa-a763-440a-9c10-23c11483d916 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.142863 Sep 14 09:21:13.906707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 522/1074] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:13.920462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11d13a2e-e221-4010-a2e2-b8bdb35d9bce tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:13.954747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:13.972328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12028aed-2129-4f71-bddb-ab8f983ac054 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1327 microversion: 2.1 time: 0.501073 Sep 14 09:21:13.989961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11d13a2e-e221-4010-a2e2-b8bdb35d9bce tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.081219 Sep 14 09:21:13.993830 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 553/1075] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1327 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:13.995238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 523/1076] 10.222.0.90 () {58 vars in 1175 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.009552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.011690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:14.019261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5770e6e3-0404-4e03-8f61-4a57fe35d774 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.040730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:14.041778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:14.042996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:14.044377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:14.047188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:14.049562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:14.087752 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5770e6e3-0404-4e03-8f61-4a57fe35d774 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.072753 Sep 14 09:21:14.101089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 524/1077] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.119857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae75e960-f137-4054-8148-cddefef55656 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.163054 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae75e960-f137-4054-8148-cddefef55656 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.046975 Sep 14 09:21:14.165124 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 525/1078] 10.222.0.90 () {58 vars in 1169 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:14.188562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0d5d436-719b-418f-b666-ae6f45782400 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.229911 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0d5d436-719b-418f-b666-ae6f45782400 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1528918436" status: 202 len: 0 microversion: 2.1 time: 0.045809 Sep 14 09:21:14.231833 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 526/1079] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:21:14 2022] DELETE /compute/v2.1/flavors/1528918436 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:14.242397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97848844-fbf4-4317-8258-3bcb9ba607d9 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.310736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97848844-fbf4-4317-8258-3bcb9ba607d9 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070151 Sep 14 09:21:14.324810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 527/1080] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.338234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d5c0f02-b5b1-4a51-b35d-b2c6e3b7da76 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.396067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d5c0f02-b5b1-4a51-b35d-b2c6e3b7da76 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/5432958" status: 202 len: 0 microversion: 2.1 time: 0.069138 Sep 14 09:21:14.399680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 528/1081] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:21:14 2022] DELETE /compute/v2.1/flavors/5432958 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:21:14.421369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cc2ad2e-18ba-40a8-be5e-d806f9b837ba tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.569730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cc2ad2e-18ba-40a8-be5e-d806f9b837ba tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.168583 Sep 14 09:21:14.582239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 529/1082] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.619355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c88cf5b4-9a36-4fbd-a0ca-3451d45b2676 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1427767083", "id": 34356241, "os-flavor-access:is_public": "False"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:14.713764 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c88cf5b4-9a36-4fbd-a0ca-3451d45b2676 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.100488 Sep 14 09:21:14.717314 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 530/1083] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:14.736320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73e63d8d-ffbd-41b6-a763-168765516a61 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.819428 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73e63d8d-ffbd-41b6-a763-168765516a61 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093309 Sep 14 09:21:14.821593 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 531/1084] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:14.844113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70070454-ebdd-4101-bc45-c7957d52df11 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:14.928480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70070454-ebdd-4101-bc45-c7957d52df11 tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089272 Sep 14 09:21:14.940688 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 532/1085] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:14.946706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aae8f4db-54a8-47f5-9d3a-a5c62ea925fa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693ff00700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.096607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aae8f4db-54a8-47f5-9d3a-a5c62ea925fa tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.157381 Sep 14 09:21:15.102538 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 533/1086] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:14 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:15.134656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ec9b9dc-0187-4fca-a0a2-16a08b251984 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.178378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:15.191685 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1d65dfbe-899a-4a80-9fa9-8563201b92a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1312 microversion: 2.1 time: 1.196249 Sep 14 09:21:15.200321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 554/1087] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:13 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1312 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:15.217474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.224861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:15.246684 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ec9b9dc-0187-4fca-a0a2-16a08b251984 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/34356241" status: 202 len: 0 microversion: 2.1 time: 0.141358 Sep 14 09:21:15.248433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 534/1088] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:21:15 2022] DELETE /compute/v2.1/flavors/34356241 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:15.257041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c39f262-089e-4ff7-bd0d-cce352b30b51 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.257599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.263535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.267102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.268161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:15.268866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:15.277188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:15.314049 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c39f262-089e-4ff7-bd0d-cce352b30b51 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060327 Sep 14 09:21:15.321400 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 535/1089] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:15.349933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e80d4d9b-6917-474e-a9a6-cb68c6e5e0ad tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-876748946", "id": 398307470, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:15.396672 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e80d4d9b-6917-474e-a9a6-cb68c6e5e0ad tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.050009 Sep 14 09:21:15.397906 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 536/1090] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:21:15 2022] POST /compute/v2.1/flavors => generated 410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:15.415602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82172380-ce62-4795-8b7c-dc0c70dc768d tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.498936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82172380-ce62-4795-8b7c-dc0c70dc768d tempest-FlavorsAdminTestJSON-1325005590 tempest-FlavorsAdminTestJSON-1325005590-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.084849 Sep 14 09:21:15.501472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 537/1091] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:15.552680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fec72b8-d955-4d98-82cb-7b34bea94566 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.570544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:15.602497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fec72b8-d955-4d98-82cb-7b34bea94566 tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/398307470" status: 202 len: 0 microversion: 2.1 time: 0.063756 Sep 14 09:21:15.604186 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 538/1092] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:21:15 2022] DELETE /compute/v2.1/flavors/398307470 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:21:15.621677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d93f9a90-4801-40b5-8a62-987319e8ec2a tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:15.669446 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d93f9a90-4801-40b5-8a62-987319e8ec2a tempest-FlavorsAdminTestJSON-1820503167 tempest-FlavorsAdminTestJSON-1820503167-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051268 Sep 14 09:21:15.671045 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 539/1093] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:15.764385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:15.775252 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f9619aa-cf10-474f-bc5d-0d99aa46b1f8 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1327 microversion: 2.1 time: 0.573399 Sep 14 09:21:15.819452 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 555/1094] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:15 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1327 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:16.115976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf6354cb-7907-4315-9484-0c9cad9763b3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa3e940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.225612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.226386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:16.244601 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf6354cb-7907-4315-9484-0c9cad9763b3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.132930 Sep 14 09:21:16.246970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 540/1095] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:16.275132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.277238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.278808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.280798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.282897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.284752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.286013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:16.823955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:16.823955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:16.839386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.844000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.846687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:16.848490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:16.851031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:16.851765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:17.029314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:17.044138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-62e00bab-29ca-4314-b312-0c2d1672efd4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1312 microversion: 2.1 time: 0.819376 Sep 14 09:21:17.069420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:17.069944 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 556/1096] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1312 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:17.109116 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccb37617-d5a6-4d77-a628-a30bd686235c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1327 microversion: 2.1 time: 0.298938 Sep 14 09:21:17.127535 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 541/1097] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:16 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1327 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:17.273370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e869a727-2c5d-4c09-8d65-a63b815df87d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f6cfa60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:17.402487 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e869a727-2c5d-4c09-8d65-a63b815df87d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.141606 Sep 14 09:21:17.414059 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 557/1098] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:17 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:17.860727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec89ed0f-1b9f-44b6-9e70-630b05e30828", "name": "network-vif-plugged", "status": "completed", "tag": "56ca66b6-112c-45eb-ab64-a99a64dcf8a1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:17.874855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:17.902117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:17.902612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:17.903050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:17.958533 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] Creating event network-vif-plugged:56ca66b6-112c-45eb-ab64-a99a64dcf8a1 for instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 on n-h1-851028-12 Sep 14 09:21:17.970561 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e5a5947e-f942-473a-8a98-a71dca22e2b9 req-89f28771-a400-466f-9a52-6c44b9c786d6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114182 Sep 14 09:21:17.976336 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 542/1099] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:18.076452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:18.082840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:18.083855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:18.113838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.117657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.118554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.119578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.124158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.124882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.160309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:18.162360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:18.185625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.189397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.193970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:18.196951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:18.197617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:18.200207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:19.211667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:19.227713 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d3a5e80-7b31-4f52-8141-0e8d22cf963a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 1.071524 Sep 14 09:21:19.228362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 543/1100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:18 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:19.249256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30a61368-7600-4cd3-9e46-1d3ca2add160 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa3ed30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:19.272436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=24 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:19.319813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:19.340234 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d8cf2483-4aa6-4b23-8f10-8136a94357f0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1333 microversion: 2.1 time: 1.261350 Sep 14 09:21:19.342619 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 558/1101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:18 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1333 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:19.407786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30a61368-7600-4cd3-9e46-1d3ca2add160 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.174777 Sep 14 09:21:19.420518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 544/1102] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:19 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:20.257956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:20.259528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:20.318485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.323079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.324171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:20.325872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.327062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.328371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:20.370869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:20.383552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:20.415357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.423789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.424815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:20.427815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:20.429491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:20.430311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:22.883615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:22.895324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:22.904082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43f51c18-f873-437a-8e0b-68edf19191aa tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1333 microversion: 2.1 time: 2.541555 Sep 14 09:21:22.906131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 545/1103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:20 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1333 bytes in 2545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:22.927371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1b2f6f3-6358-45d4-acc8-7151ec1668d2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa19dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:23.034963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:23.051838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2dd88684-4787-4c71-9485-e8672be4b98c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 2.789969 Sep 14 09:21:23.056504 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 559/1104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:20 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:23.953508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:23.955456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:24.058613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.059290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.060166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:24.061561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:24.062384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:24.082223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.278445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:25.293172 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44e59a4f-6ae3-4b66-8447-c06af46c7ebd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.347044 Sep 14 09:21:25.296892 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 560/1105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:23 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:25.303037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:25.312435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:25.345985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.350674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.351398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:25.352479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:25.353261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:25.357411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.575037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1b2f6f3-6358-45d4-acc8-7151ec1668d2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 3.667614 Sep 14 09:21:26.581255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 546/1106] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:22 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 3674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:26.600335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:26.611728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:26.639036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.642050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.642810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.646649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:26.647356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:26.651101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:26.665651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:26.678751 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d3aec280-96a9-4009-ae3d-aeff665a6159 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 1.379797 Sep 14 09:21:26.679730 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 561/1107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:25 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:27.116382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759f2aaa-607d-4ef4-91f1-b8054be58873", "tag": "e8b9f92f-2e76-4935-879d-1e9a934aaa31"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:27.188342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:27.214695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:27.216509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:27.270016 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] Creating event network-changed:e8b9f92f-2e76-4935-879d-1e9a934aaa31 for instance 759f2aaa-607d-4ef4-91f1-b8054be58873 on n-h1-851028-12 Sep 14 09:21:27.289632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1fc669fe-a01f-419c-a40c-92a92cb97fd4 req-29cff6d0-73ff-4826-81d1-f78c6f3e34f5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.604079 Sep 14 09:21:27.296816 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 562/1108] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:27.588734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:27.599730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83bbbdd1-15ea-44a8-b4ff-929bc051adf1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f807c10>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:27.605461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a142bda-10c1-4b52-9b70-fdd8048f84b1 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.020851 Sep 14 09:21:27.611594 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 547/1109] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:26 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:27.718015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:27.719074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:27.735069 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83bbbdd1-15ea-44a8-b4ff-929bc051adf1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.141961 Sep 14 09:21:27.752391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:27.755513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:27.760621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:27.760862 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 563/1110] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:27 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:27.793713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:27.794353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:27.794819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.623555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1af882c0-6974-4c57-aef8-a3e62dbd49e0 tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Action: 'create', calling method: .version_select at 0x7f693f6c28b0>, body: {"keypair": {"name": "tempest-keypair-650298534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRDEZTN/Hqc1+xuujUo0kShrq4Ue01dBeD0puDvI8U7uSdqhuiCmFKBon+78CI7mQOMGJPFUNyySHm2mv2Zo1ahZa5/KzwtVAHx3vD51Nr3V1+8fNMkbZL6Vs6PovUl8Q=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:28.640682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:28.769638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1af882c0-6974-4c57-aef8-a3e62dbd49e0 tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Getting quotas for project 83fcb3f45712407e8f91df18822444b0. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:28.791660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1af882c0-6974-4c57-aef8-a3e62dbd49e0 tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Getting quotas for user 12bb94d1bc2d4c9b96af7f257cfc3d57 and project 83fcb3f45712407e8f91df18822444b0. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:28.882163 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1af882c0-6974-4c57-aef8-a3e62dbd49e0 tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.684424 Sep 14 09:21:28.889330 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 564/1111] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:21:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:21:28.894876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:28.912947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:28.942719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.950153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.952470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:28.965339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:28.970449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:28.981778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:30.990025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:31.035521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fdbd2acf-7b84-40a5-8d12-18cdb795384c tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 3.322852 Sep 14 09:21:31.066625 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 548/1112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:27 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 3354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:21:31.094578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:31.103164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=71 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:31.130050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4f38b0e-44fc-43bf-987b-68de9aa67db7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 2.226722 Sep 14 09:21:31.130159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d121898a-b050-46dd-b174-b57e92663d31 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693ff00040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:31.145645 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 565/1113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:28 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:31.362854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d121898a-b050-46dd-b174-b57e92663d31 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.293605 Sep 14 09:21:31.364743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 549/1114] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:31 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:32.083042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:32.083763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:32.134875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.151092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:32.152590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:32.178839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.179158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.197342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.202134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.205388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.225221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.225806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.234635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:32.247953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:32.258016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:32.258568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:33.040489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:33.049879 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-611d7139-5aab-4161-9641-ee2284c7c550 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 0.972311 Sep 14 09:21:33.063136 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 566/1115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:32 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:33.082793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b313b114-42e8-4b27-ab11-916657767d29 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f807670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:33.191360 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b313b114-42e8-4b27-ab11-916657767d29 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.123631 Sep 14 09:21:33.192842 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 567/1116] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:33 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:33.248633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:33.258424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80e32aa7-641f-4a40-bcdb-871a1ff1a606 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.113360 Sep 14 09:21:33.262788 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 550/1117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:32 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:33.518766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5564123b-59c1-4840-8597-11471348a9d3 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-326302904", "id": 1351050116, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:33.577814 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5564123b-59c1-4840-8597-11471348a9d3 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.379110 Sep 14 09:21:33.590976 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 568/1118] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:21:33 2022] POST /compute/v2.1/flavors => generated 448 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:33.861319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-186766462", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "b41e49db-121e-4bc1-879b-5eb8e9fa3036"}], "block_device_mapping_v2": [{"uuid": "7bb969f1-b9f8-46c8-8373-754c2a642acc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:34.239751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90ce0ab3-0c0a-443b-91a4-1105674044fb tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:34.263491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90ce0ab3-0c0a-443b-91a4-1105674044fb tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] 10.222.0.90 "GET /compute/v2.1/flavors/1351050116" status: 200 len: 448 microversion: 2.55 time: 0.671076 Sep 14 09:21:34.292416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 551/1119] 10.222.0.90 () {60 vars in 1199 bytes} [Wed Sep 14 09:21:33 2022] GET /compute/v2.1/flavors/1351050116 => generated 448 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:34.300933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] validate_networks() for [('b41e49db-121e-4bc1-879b-5eb8e9fa3036', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:21:34.318700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:34.335667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:34.360203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.377004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.379411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:34.381578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:34.384255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:34.386373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.318141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:35.331962 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6604b062-cb14-47e7-b212-ab8fae19c76d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 1.033885 Sep 14 09:21:35.352337 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 552/1120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:34 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:35.369418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "tag": "f7010d96-6cff-4a41-ad67-0cf7844f54cd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:35.391011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:35.391887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:35.392745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.420737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] Creating event network-changed:f7010d96-6cff-4a41-ad67-0cf7844f54cd for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:21:35.441744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d9cebc89-2ee3-4361-aa0a-baf82e97e01f req-81d87e60-3908-4b65-8a9f-1e83d51148b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087803 Sep 14 09:21:35.443001 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 553/1121] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:35.459988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b8ec2db-095d-4c10-8e97-f4596b0358af tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa27820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:35.619327 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b8ec2db-095d-4c10-8e97-f4596b0358af tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1455 microversion: 2.1 time: 0.173486 Sep 14 09:21:35.620029 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 554/1122] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:35 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1455 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:35.644843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c49d830-8e79-4adc-b7d1-1b3a11913769 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] Action: 'update', calling method: .version_select at 0x7f694561f940>, body: {"flavor": {"description": "new"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:35.747587 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c49d830-8e79-4adc-b7d1-1b3a11913769 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] 10.222.0.90 "PUT /compute/v2.1/flavors/1351050116" status: 200 len: 449 microversion: 2.55 time: 0.125355 Sep 14 09:21:35.748250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 555/1123] 10.222.0.90 () {62 vars in 1219 bytes} [Wed Sep 14 09:21:35 2022] PUT /compute/v2.1/flavors/1351050116 => generated 449 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:21:35.773590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:35.777095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:35.799663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:35.804600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:35.809651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:35.815730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:35.820426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:35.821246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.880627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:21:36.881181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:21:36.882017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:21:36.882537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:21:36.883156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:21:36.883295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:36.900174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a75e972-d490-4e9f-9982-dc33192625a4 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.150735 Sep 14 09:21:36.903418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 556/1124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:35 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:36.911961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-047f6e11-7532-4568-9ce1-5a578b320522 tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:36.941012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.942088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.944313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.950199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:36.951160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:36.962596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:36.979323 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-047f6e11-7532-4568-9ce1-5a578b320522 tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.073884 Sep 14 09:21:36.992843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 557/1125] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:21:36 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:37.010040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:37.010970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:37.024171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:37.024587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:37.025037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:37.030195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:37.030683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:37.031123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:37.043368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:37.062242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Getting quotas for user c92c2abda1124946b2adcb0b0560fd0c and project 639c54e3be9d48d983b7e6e83436d107. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:37.192591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:21:37.194920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bb969f1-b9f8-46c8-8373-754c2a642acc',volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:21:37.421545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:37.445122 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5aeb26ff-31d1-42c6-aebb-874b173b3079 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 0.450454 Sep 14 09:21:37.446587 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 558/1126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:36 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:37.457890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0a6c9d0-c41a-424c-8793-ab782f3e7262 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa3e5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:37.529622 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f9be1129-d84b-4b43-bfae-3e18b377f9e6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.679883 Sep 14 09:21:37.540648 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 569/1127] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:21:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 14 09:21:37.550663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51a2d3ff-d5e5-4a5f-8357-15243cfaf1f8 tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:37.645823 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51a2d3ff-d5e5-4a5f-8357-15243cfaf1f8 tempest-FlavorsV255TestJSON-1483873215 tempest-FlavorsV255TestJSON-1483873215-project] 10.222.0.90 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.101107 Sep 14 09:21:37.652617 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 570/1128] 10.222.0.90 () {60 vars in 1166 bytes} [Wed Sep 14 09:21:37 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:37.664896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:37.667581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:37.962678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:37.977111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:37.980388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:37.983720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-23a7ed6e-34f2-425c-98ec-b122851ccd83 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1103 microversion: 2.25 time: 0.329055 Sep 14 09:21:37.987201 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 571/1129] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:37 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1103 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:38.000688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0dae8ba-350d-4279-b0e9-8101c38ca535 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:38.045914 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0dae8ba-350d-4279-b0e9-8101c38ca535 tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1351050116" status: 202 len: 0 microversion: 2.55 time: 0.056224 Sep 14 09:21:38.046873 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 572/1130] 10.222.0.90 () {60 vars in 1202 bytes} [Wed Sep 14 09:21:37 2022] DELETE /compute/v2.1/flavors/1351050116 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:21:38.055672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:38.056753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:38.073396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:38.074665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:38.076763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:38.078697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:38.080448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:38.081081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:38.669913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:38.694103 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c6cfddb-8d4b-471b-b914-3710a224f556 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.642348 Sep 14 09:21:38.700232 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 573/1131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:38 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:38.728842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b09f27ce-f19d-4a80-9c34-fabfab4255cf tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:38.792409 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b09f27ce-f19d-4a80-9c34-fabfab4255cf tempest-FlavorsV255TestJSON-377712175 tempest-FlavorsV255TestJSON-377712175-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.085966 Sep 14 09:21:38.795785 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 574/1132] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:21:38 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:38.809971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:38.825259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:38.849740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:38.853209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:38.858011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:38.862426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:38.864463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:38.867383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:39.730899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:39.742443 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79719952-d863-4ac7-a09b-f25e30f13691 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 0.943141 Sep 14 09:21:39.743429 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 575/1133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:38 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:39.763728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:39.764748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:39.788017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:39.800702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:39.801569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:39.802567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:39.803259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:39.804368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:40.132667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:40.164921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:40.172753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:40.183681 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3c66147-3093-444a-b10e-2b44e52111db tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1232 microversion: 2.25 time: 0.430901 Sep 14 09:21:40.185013 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 576/1134] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:39 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1232 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:40.204143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:40.210630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:40.233795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:40.234600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:40.235322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:40.236261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:40.238949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:40.239623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:41.650134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:41.668861 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cc6159f7-a111-4234-a0c0-8272ae19f01d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.474030 Sep 14 09:21:41.669947 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 577/1135] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:40 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:41.704196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "tag": "8759aae5-38c3-45c3-85e3-4d9b81218209"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:41.729677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:41.731461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:41.732156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:41.771528 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] Creating event network-changed:8759aae5-38c3-45c3-85e3-4d9b81218209 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:21:41.783619 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8dc323a8-df71-4a77-8b7a-6a67e28dce02 req-75c27d6d-5511-4171-bde7-4597b51bc1a8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090313 Sep 14 09:21:41.789589 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 578/1136] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:41.805184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:41.807347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:41.829405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:41.830080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:41.830939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:41.832821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:41.835710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:41.836501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:42.464224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:42.479002 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1a1da6b7-4913-4b86-8d80-7e45df19fed1 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 0.687871 Sep 14 09:21:42.479986 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 579/1137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:41 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:42.496565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:42.497282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:42.513011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:42.513434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:42.513878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:42.530597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:42.532516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:42.534409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:42.850030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:42.866290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:42.871449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:42.877391 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02aae16d-948e-4008-8743-fc06bf277109 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1250 microversion: 2.25 time: 0.391910 Sep 14 09:21:42.880464 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 580/1138] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:42 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1250 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:43.378682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759f2aaa-607d-4ef4-91f1-b8054be58873", "name": "network-vif-plugged", "status": "completed", "tag": "e8b9f92f-2e76-4935-879d-1e9a934aaa31"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:43.424386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:43.428595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:43.429226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:43.471038 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] Creating event network-vif-plugged:e8b9f92f-2e76-4935-879d-1e9a934aaa31 for instance 759f2aaa-607d-4ef4-91f1-b8054be58873 on n-h1-851028-12 Sep 14 09:21:43.490591 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-faf45858-4a9d-4a79-aafe-8b8eac82b086 req-b6df2824-b712-4277-abc9-d138b1bfadbc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.607587 Sep 14 09:21:43.490830 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 581/1139] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:43.539391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:43.543823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:43.559698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:43.566786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:43.567410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:43.568312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:43.568908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:43.569442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:44.348380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:44.363608 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92f0772d-fe6f-4628-99dd-d0a5b4fb59fc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.871524 Sep 14 09:21:44.383036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 582/1140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:43 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:44.389653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:44.390636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:44.406083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:44.406840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:44.407748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:44.409212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:44.410418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:44.416721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:45.000001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:45.022621 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da8eef8d-4a8d-4cc1-8233-155a4beb299a tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1395 microversion: 2.1 time: 0.642214 Sep 14 09:21:45.023207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 583/1141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:44 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1395 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:45.032740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:45.044093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:45.062096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:45.069084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:45.070175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:45.074068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:45.075850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:45.080204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:45.815025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:45.831281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:45.847807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:45.849405 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbf49e74-2dd0-43b3-a39a-0c1bfedf7982 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1292 microversion: 2.25 time: 0.825083 Sep 14 09:21:45.850553 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 584/1142] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:45 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1292 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:45.855315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:45.871580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:45.897801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:45.898616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:45.899171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:45.903767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:45.906398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:45.907050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:46.769238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:46.796843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ffc7ad32-941d-4a3a-b4c4-30cffb991ec9 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.944924 Sep 14 09:21:46.799073 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 585/1143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:45 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:46.806499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:46.823129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:46.841519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:46.849450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:46.850056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:46.852924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:46.856766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:46.860528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:47.012364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:47.016687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:47.430822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=39 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:47.972048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:47.987491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:48.001334 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9dcf21b-5d48-4640-92a9-e17beaaf990d tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1576 microversion: 2.1 time: 1.200578 Sep 14 09:21:48.015395 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 586/1144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:46 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1576 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:48.021629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "tag": "3650c541-d9ea-4d9c-9a5c-5d07e8889037"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:48.055239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:48.063049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:48.064905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:48.102382 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] Creating event network-changed:3650c541-d9ea-4d9c-9a5c-5d07e8889037 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:21:48.122628 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a493d6e2-4f97-4cdb-be23-5b22cce9588d req-0d9ea6c9-fa6f-4d9d-a7b6-ede3e7879ea9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105365 Sep 14 09:21:48.126527 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 587/1145] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:48.144604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:48.150081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:48.195183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:48.199424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:48.200601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:48.202216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:48.203005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:48.203982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:48.737137 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d0a6c9d0-c41a-424c-8793-ab782f3e7262 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1464 microversion: 2.1 time: 11.284933 Sep 14 09:21:48.740130 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 559/1146] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:37 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1464 bytes in 11293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:48.794282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:48.802786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:48.838987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:48.841759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:48.844446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:48.854574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:48.857679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:48.881210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:50.130330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:50.140254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:50.141760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:50.150117 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a3cbbe27-e90d-4f25-b65a-4da0a68db884 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1292 microversion: 2.25 time: 2.021628 Sep 14 09:21:50.150345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 588/1147] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:48 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1292 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:50.194867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:50.206307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:50.228978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:50.229469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:50.229904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:50.230604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:50.231056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:50.231535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:50.634504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:50.650736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5131ec6-9b4e-4638-8e8e-3ecefcee4eb0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 1.909353 Sep 14 09:21:50.656863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 560/1148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:48 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:50.671118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-929caa7a-473a-4cd9-b0d4-b846614376d3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f95c670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:52.088607 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cf384799-9bca-4e12-ad68-76997c95aea5 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.893235 Sep 14 09:21:52.090314 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 589/1149] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:21:50 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873/os-interface => generated 284 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:52.108231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e31a44a-3fd4-4994-8b71-ecce712707ce", "tag": "bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:52.155418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:52.157671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:52.158443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:52.203881 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] Creating event network-changed:bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb for instance 4e31a44a-3fd4-4994-8b71-ecce712707ce on n-h2-851028-12 Sep 14 09:21:52.210954 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-b66153ba-d72c-4e8f-885e-5081ee1080f1 req-c3723b9f-524d-46ef-a82f-baed987eb230 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113483 Sep 14 09:21:52.211958 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 590/1150] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:52.222034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:52.222750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:52.263760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:52.267975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:52.288587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:52.290221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:52.293262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:52.296403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:53.616491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:53.636565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:53.647938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:53.653516 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a89afc40-bd62-4f52-b18f-861156cef5d5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1292 microversion: 2.25 time: 1.438942 Sep 14 09:21:53.661959 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 591/1151] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:52 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1292 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:53.704459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:53.706357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:53.735224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:53.739712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:53.740901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:53.741891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:53.745416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:53.749148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:53.768344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:54.363239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:54.374935 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-89e474c9-22cd-4a12-b38e-4d6d67edbcd0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.710686 Sep 14 09:21:54.386141 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 592/1152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:53 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:54.744460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Calling method '.version_select at 0x7f693f6dc310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:54.745413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.745906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.746652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:54.784927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.785798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.786562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:54.809613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.810170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.810615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:54.832967 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c48a842a-eced-44e0-bc4d-a11ac2c6c347 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.445010 Sep 14 09:21:54.833602 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 593/1153] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:54.846272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec89ed0f-1b9f-44b6-9e70-630b05e30828", "name": "network-vif-unplugged", "status": "completed", "tag": "56ca66b6-112c-45eb-ab64-a99a64dcf8a1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:54.886822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.887492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.887813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:54.901143 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] Creating event network-vif-unplugged:56ca66b6-112c-45eb-ab64-a99a64dcf8a1 for instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 on n-h1-851028-12 Sep 14 09:21:54.907843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0b938c88-78a4-4728-8ab9-525e6c94ba22 req-2e95c129-6b8e-4864-963a-f96b99c00c81 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072287 Sep 14 09:21:54.908837 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 594/1154] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:54.917000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:54.918433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:54.925529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.926156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.926791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:54.927988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:54.928599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:54.929180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:55.223762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:55.240375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:55.247173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:55.251578 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d453b27c-61b4-4cf1-8ece-bcaa7e9202e1 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1292 microversion: 2.25 time: 0.338667 Sep 14 09:21:55.256418 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 595/1155] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:54 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1292 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:55.266874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Calling method '.version_select at 0x7f693f6dc1f0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:55.271425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:55.273596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:55.274570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:55.320242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:55.322292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:55.323234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:55.391755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:55.393533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:55.394269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:55.394929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:55.420440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78353d3a-f62d-4a30-8be8-6eecc2e3edb6 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/n-h2-851028-12/servers" status: 200 len: 434 microversion: 2.1 time: 0.158426 Sep 14 09:21:55.432656 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 596/1156] 10.222.0.90 () {58 vars in 1215 bytes} [Wed Sep 14 09:21:55 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-12/servers => generated 434 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:55.518109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: .version_select at 0x7f693f6dcc10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1779317983", "policies": ["affinity"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:55.538350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:55.542990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:55.622911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:55.632711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:55.661529 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41c387df-24c7-49bf-8c87-441e61973024 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.227287 Sep 14 09:21:55.665106 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 597/1157] 10.222.0.90 () {60 vars in 1174 bytes} [Wed Sep 14 09:21:55 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:55.674741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:55.675800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:55.695116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:55.696712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:55.699192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:55.701993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:55.702761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:55.705111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.008380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:56.018790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d362997-6ebd-4208-8332-0c9561c8ff8c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.351588 Sep 14 09:21:56.019925 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 598/1158] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:55 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:56.025866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Calling method '.version_select at 0x7f693f69a310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:56.027942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.028439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.028881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.047219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.047544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.048601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.062917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.063459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.064075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.074794 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80db7299-aff7-4119-88cd-f1789cc313e5 tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.053464 Sep 14 09:21:56.081483 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 599/1159] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:21:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:56.086591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: .version_select at 0x7f693f812040>, body: {"server_group": {"name": "tempest-server-group-538559832", "policies": ["affinity"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:56.117706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:56.123276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:56.189656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:56.196793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:56.214315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-329f0ec3-761e-4341-b180-df4ca6734fdc tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.131597 Sep 14 09:21:56.223511 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 600/1160] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:21:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:56.242166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Calling method '.version_select at 0x7f693f68a8b0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:56.244599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.245092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.245534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.267859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.268388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.268830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.279120 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7508a8af-c4a7-4fc6-ab55-9b55e06d827f tempest-HypervisorAdminUnderV252Test-290138923 tempest-HypervisorAdminUnderV252Test-290138923-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors/n-h2-851028-12/search" status: 200 len: 105 microversion: 2.1 time: 0.053948 Sep 14 09:21:56.289801 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 601/1161] 10.222.0.90 () {58 vars in 1212 bytes} [Wed Sep 14 09:21:56 2022] GET /compute/v2.1/os-hypervisors/n-h2-851028-12/search => generated 105 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:56.296631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: .version_select at 0x7f693f6cfd30>, body: {"server_group": {"name": "tempest-server-group-538559832", "policies": ["affinity"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:56.351349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:56.363009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:56.442334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:56.469230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:56.515799 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1109efa8-020f-44e5-a295-70d36e7efea1 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.222279 Sep 14 09:21:56.516907 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 602/1162] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:21:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:56.528664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:56.531991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:56.548853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.551296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.552012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:56.552965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:56.559431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:56.561988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:57.025596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:57.041540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:57.045277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:57.046279 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb19b177-67b6-4f9f-9c2c-49ae5753691f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.526298 Sep 14 09:21:57.050711 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 603/1163] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:56 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:57.059958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-54d8a2b8-e198-4669-921d-eeac5d111100 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:57.224669 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-54d8a2b8-e198-4669-921d-eeac5d111100 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/352f9cb9-afb9-4087-b1e9-1b52e691629d" status: 204 len: 0 microversion: 2.1 time: 0.172745 Sep 14 09:21:57.225535 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 604/1164] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:21:57 2022] DELETE /compute/v2.1/os-server-groups/352f9cb9-afb9-4087-b1e9-1b52e691629d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:21:57.234691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:57.242699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:57.245654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:57.253168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:57.254010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:57.254639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:57.255598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:57.256263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:57.257002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:57.515065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:57.526621 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5454c95a-11f0-45ee-8bed-3d5b0cb73594 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.296318 Sep 14 09:21:57.528247 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 605/1165] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:57 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:57.534317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:57.535499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:57.544482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:57.545230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:57.545845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:57.547175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:57.548097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:57.548833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:57.983762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:57.996410 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e40b5dc0-292e-41a1-8cbb-6b9d4c616234 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1576 microversion: 2.1 time: 0.466674 Sep 14 09:21:57.997151 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 606/1166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:57 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1576 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:58.018476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "759f2aaa-607d-4ef4-91f1-b8054be58873", "tag": "e8b9f92f-2e76-4935-879d-1e9a934aaa31"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:58.073724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:58.074368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:58.074368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:58.145771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] Creating event network-changed:e8b9f92f-2e76-4935-879d-1e9a934aaa31 for instance 759f2aaa-607d-4ef4-91f1-b8054be58873 on n-h1-851028-12 Sep 14 09:21:58.166141 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-499e40a6-a479-4360-928f-1dd1288b73a0 req-8fcad0fb-b450-4e9c-aed6-1365a426a384 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163777 Sep 14 09:21:58.170945 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 607/1167] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:58.209354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-42794b04-42a0-4221-8729-379379e40696 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:58.289625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-42794b04-42a0-4221-8729-379379e40696 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.116417 Sep 14 09:21:58.290117 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 608/1168] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:21:58 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:58.300663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:58.317594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:58.340386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:58.340879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:58.343206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:58.343206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:58.343206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:58.345965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:58.665225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:58.680860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:58.685574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:58.690295 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5593443b-13e7-43dc-90a9-0b882338a471 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.398996 Sep 14 09:21:58.690924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 609/1169] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:58 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:21:58.722441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2584fa61-723b-4dc6-a9df-d59fcf7d6204 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:58.799317 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2584fa61-723b-4dc6-a9df-d59fcf7d6204 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/b4f1b802-0513-4d1d-8911-54870c155b58" status: 204 len: 0 microversion: 2.1 time: 0.085840 Sep 14 09:21:58.800352 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 610/1170] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:21:58 2022] DELETE /compute/v2.1/os-server-groups/b4f1b802-0513-4d1d-8911-54870c155b58 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:21:58.815495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:58.817286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:21:58.818440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:58.835061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:58.842965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:58.843836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:58.844920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:58.846136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:58.846809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:59.454902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:21:59.472566 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1b35465-23f6-4872-aa0a-1cef9da0507f tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.669496 Sep 14 09:21:59.488043 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 611/1171] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:21:58 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:21:59.509653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5368ffe4-acf7-43f9-a4bb-87c96d73c44d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:59.562375 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5368ffe4-acf7-43f9-a4bb-87c96d73c44d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.067485 Sep 14 09:21:59.564125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 612/1172] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:21:59 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:59.587660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: .version_select at 0x7f693f6681f0>, body: {"server_group": {"name": "tempest-server-group-1792706412", "policies": ["affinity"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:21:59.640927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:59.647385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:59.817523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:21:59.825391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:21:59.861689 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af255d40-b38c-406d-90c2-c134d71c300f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.285747 Sep 14 09:21:59.870796 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 613/1173] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:21:59 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:21:59.882337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:21:59.882997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:21:59.899979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:59.900523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:59.901111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:21:59.901841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:21:59.902445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:21:59.903442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:00.116651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:00.137348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:00.139384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:00.140759 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9883a57-9809-43b8-bcd0-610b059cc7fd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.268821 Sep 14 09:22:00.143374 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 614/1174] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:21:59 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:00.148708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-57429213-5847-4490-9286-be310f8d31ce tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:00.195968 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-57429213-5847-4490-9286-be310f8d31ce tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/7cb27b6a-efd7-4875-a6a2-13d11f986eff" status: 204 len: 0 microversion: 2.1 time: 0.051234 Sep 14 09:22:00.198688 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 615/1175] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:00 2022] DELETE /compute/v2.1/os-server-groups/7cb27b6a-efd7-4875-a6a2-13d11f986eff => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:00.214424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f436ddb-c256-4441-bb9f-e1c83f493ea7 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:00.248454 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f436ddb-c256-4441-bb9f-e1c83f493ea7 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040563 Sep 14 09:22:00.249933 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 616/1176] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:22:00 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:00.267481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: .version_select at 0x7f693f812040>, body: {"server_group": {"name": "tempest-server-group-1070786218", "policies": ["anti-affinity"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:00.363025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:00.377538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:00.489937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:00.509340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_groups'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:00.541469 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1662c2c-8d24-4691-96ea-48f367bdf1c0 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.281673 Sep 14 09:22:00.552570 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 617/1177] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:22:00 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:22:00.559242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:00.561731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:00.590679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:00.591700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:00.594447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:00.597808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:00.600726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:00.601600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:00.648827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:01.023650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:01.069934 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f1fd90c-f08e-48b9-875d-f4d6c0767e48 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.518019 Sep 14 09:22:01.071154 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 618/1178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:00 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:01.080345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c66b2d8-980f-4aff-9b1c-5283a23696b6 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:01.133053 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c66b2d8-980f-4aff-9b1c-5283a23696b6 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/1113eb88-bafe-42da-8b5a-59150ad40515" status: 204 len: 0 microversion: 2.1 time: 0.060451 Sep 14 09:22:01.134707 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 619/1179] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:01 2022] DELETE /compute/v2.1/os-server-groups/1113eb88-bafe-42da-8b5a-59150ad40515 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:01.141376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-plugged", "status": "completed", "tag": "3650c541-d9ea-4d9c-9a5c-5d07e8889037"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:01.170094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:01.170878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:01.171708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:01.205703 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] Creating event network-vif-plugged:3650c541-d9ea-4d9c-9a5c-5d07e8889037 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:01.215641 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e07207dd-431a-4635-aeb1-b22296725f7f req-01cc9aa8-bff8-42c9-9c65-588781fcb386 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078674 Sep 14 09:22:01.218619 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 620/1180] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:01.249203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af0fcdb1-3a3c-4d02-9965-e4c9138c6c25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:01.325659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:01.334701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af0fcdb1-3a3c-4d02-9965-e4c9138c6c25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.114735 Sep 14 09:22:01.336290 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 621/1181] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:22:01 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:01.374266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:01.380604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:01.415733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:01.416268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:01.416896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:01.426514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:01.428146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:01.429378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:01.893661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:01.907758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:01.915066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:01.916793 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-805f3c7f-ef05-4b1c-8b92-ac8a7d6f7ff3 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.575159 Sep 14 09:22:01.924291 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 622/1182] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:01 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:01.931346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-670699397", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "a8942890-f0a8-4a2b-b512-dbacc75eb9aa"}]}, "os:scheduler_hints": {"group": "dc9dc657-1ad2-4bbb-b690-4a096003dc6c"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:04.365631 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-929caa7a-473a-4cd9-b0d4-b846614376d3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 200 len: 1464 microversion: 2.1 time: 13.705434 Sep 14 09:22:04.366529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 561/1183] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:21:50 2022] GET /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 1464 bytes in 13707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:04.369152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] validate_networks() for [('a8942890-f0a8-4a2b-b512-dbacc75eb9aa', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:22:04.372794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:04.373671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:04.381614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:04.382559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:04.383283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:04.384290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:04.384975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:04.385626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:04.755043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:04.775222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e2e9cb9-12e0-456c-b3bd-8f12c6435b91 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.407355 Sep 14 09:22:04.776475 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 562/1184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:04 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:04.781839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:04.783456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:04.801135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:04.805108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:04.806149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:04.807990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:04.809226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:04.810043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.131117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:05.143456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:05.148507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:05.152559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a38fc334-aedb-41e8-be9b-4d0a02527dd8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.374829 Sep 14 09:22:05.160639 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 563/1185] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:04 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:05.169765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-plugged", "status": "completed", "tag": "f7010d96-6cff-4a41-ad67-0cf7844f54cd"}, {"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-plugged", "status": "completed", "tag": "8759aae5-38c3-45c3-85e3-4d9b81218209"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:05.208426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.209297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.210238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.241629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Creating event network-vif-plugged:f7010d96-6cff-4a41-ad67-0cf7844f54cd for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:05.242403 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] Creating event network-vif-plugged:8759aae5-38c3-45c3-85e3-4d9b81218209 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:05.249649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-230937ff-fb8b-49a3-9f5d-2eda816f8a04 req-0ed03614-1c28-4df8-807a-bf1df631bebe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084546 Sep 14 09:22:05.250771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 564/1186] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:05.389048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:22:05.391160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:22:05.393917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:22:05.395114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:22:05.395846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:22:05.418631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.419429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.420223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.421409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.423046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.428901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.483250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:05.496888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:05.516763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:22:05.520892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:22:05.632553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122443) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 14 09:22:05.697317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7dc06752-5a13-4040-b25e-fa4f851bbf9d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Action: 'create', calling method: .version_select at 0x7f6944066dc0>, body: {"keypair": {"name": "tempest-keypair-753148466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuy1Lgsk/430EqOr6nQdtreBp1c/ENuVA1WF1umF9H1/LcsngMbt+b8S021KQKl5jjXwLWXbxEF5IQlNMK+GtWS/5ow33CQAe9Tlm/LTaiKTZ6N/+4bodtjCNaDve4SsA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:05.713774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_group_members'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:05.719252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7dc06752-5a13-4040-b25e-fa4f851bbf9d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Getting quotas for project 7c1bfe90d9954ab5a92d43f1c4511b52. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:05.723634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_group_members'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:05.725489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7dc06752-5a13-4040-b25e-fa4f851bbf9d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Getting quotas for user 70ada7bba23b4508851f61fb101cdd12 and project 7c1bfe90d9954ab5a92d43f1c4511b52. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:05.785728 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7dc06752-5a13-4040-b25e-fa4f851bbf9d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.532114 Sep 14 09:22:05.786723 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 565/1187] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:22:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:05.811177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:05.814881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:05.840660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.841299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.841762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.844389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.845460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.845993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.846584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_group_members'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:05.853066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Getting quotas for user 5525a97f4700405e978b1a01c383c193 and project ac3b7575ae704d109cf9298ed02a1c65. Resources: {'server_group_members'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:05.910809 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d4dcec5b-1335-4098-be12-f69d1988d6c2 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.984828 Sep 14 09:22:05.912173 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 623/1188] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:22:05.917623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:05.919681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:05.934774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.936664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.939718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:05.943874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:05.948431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:05.949432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:06.000596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:06.472221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:06.481398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d1b43e3-15d2-43d4-9125-cecf755b6649 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1467 microversion: 2.1 time: 0.692654 Sep 14 09:22:06.491765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 566/1189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:05 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1467 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:06.506455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:06.511091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d16c2653-fc43-48a4-8909-22fd614222ea tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:06.511735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d16c2653-fc43-48a4-8909-22fd614222ea tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:06.537783 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ece0a4b8-8d93-494e-ab37-add63cde5a81 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1354 microversion: 2.1 time: 0.623950 Sep 14 09:22:06.539589 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 624/1190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:05 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1354 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:06.565643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:06.570311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:06.592081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:06.592948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:06.593563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:06.598423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:06.598845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:06.599293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:06.630538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d16c2653-fc43-48a4-8909-22fd614222ea tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:06.637730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d16c2653-fc43-48a4-8909-22fd614222ea tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1212 microversion: 2.1 time: 0.144464 Sep 14 09:22:06.639518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 567/1191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:06 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1212 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:06.645469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-562424884"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:06.648544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:06.666164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:06.666678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:06.667127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:06.667867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:06.668350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:06.668779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:07.057063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:07.071602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:07.075433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:07.083587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21eb7cd5-3406-40f0-9927-f3f569e55f20 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.542481 Sep 14 09:22:07.084861 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 625/1192] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:06 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:07.182880 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f475a75-724e-422f-bbec-d282c4204479 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "POST /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9/action" status: 202 len: 0 microversion: 2.1 time: 0.539570 Sep 14 09:22:07.185748 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 568/1193] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:22:06 2022] POST /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:22:07.197524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e758bb2c-73de-4b06-9021-d4c12d50d43f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f6683a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:07.342037 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e758bb2c-73de-4b06-9021-d4c12d50d43f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.146073 Sep 14 09:22:07.353734 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 626/1194] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:07 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:07.565891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:07.566921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:07.587994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:07.667541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:07.668813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:07.681785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:07.682296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:07.685172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:07.686011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:07.689949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:07.690865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:07.897287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:07.912868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd6263cc-a50a-4e72-95e9-d227a39bf547 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1264 microversion: 2.1 time: 0.245217 Sep 14 09:22:07.914038 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 627/1195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:07 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:22:07.994168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:08.019051 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e959a0d-fc9b-4199-9e0c-72bfe3586607 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1804 microversion: 2.1 time: 0.459725 Sep 14 09:22:08.020163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 569/1196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:07 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1804 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:08.045711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.046473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:08.054960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.055718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.056346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.057323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.057948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.058567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.091281 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5fe84a1c-8424-409a-b649-246f51fa6f3d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2/ips" status: 200 len: 218 microversion: 2.1 time: 0.051289 Sep 14 09:22:08.092955 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 628/1197] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:22:08 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2/ips => generated 218 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:08.105286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.106321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:08.121467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.123930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.124434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.125080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.127271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:08.129721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.130441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.132382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.143678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.145103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.148196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.149594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.154392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.154867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.195726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:22:08.352198 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ff7c2c8-2842-451e-92a6-78e021db17ce tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "DELETE /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 204 len: 0 microversion: 2.1 time: 0.250231 Sep 14 09:22:08.352985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 570/1198] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:22:08 2022] DELETE /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:08.361517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e31a44a-3fd4-4994-8b71-ecce712707ce", "name": "network-vif-plugged", "status": "completed", "tag": "bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:08.377672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.378166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.378846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.434243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] Creating event network-vif-plugged:bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb for instance 4e31a44a-3fd4-4994-8b71-ecce712707ce on n-h2-851028-12 Sep 14 09:22:08.453118 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c1940efb-b1b4-4e06-9206-c07dc86d83d7 req-d9c2e14c-a29a-43e6-880e-010e00b21d59 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098073 Sep 14 09:22:08.453305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 571/1199] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:08.459011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-842edf1c-7ff2-475f-905e-3794a34de2fe tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa19ca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.521286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:08.537732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:08.541986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:08.547050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e02bc6b-c754-453e-8b61-f1889690a057 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.429824 Sep 14 09:22:08.555250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-842edf1c-7ff2-475f-905e-3794a34de2fe tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.100550 Sep 14 09:22:08.555863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 572/1200] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:08 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:08.564924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 629/1201] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:08 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:08.569701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.570444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:08.585328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.585830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.586278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.586997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.587456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.588885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.873920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:08.889565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a0470e6-48bc-4d67-931e-6a425d89166a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1810 microversion: 2.1 time: 0.332194 Sep 14 09:22:08.891060 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 573/1202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:08 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:08.942824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:08.943672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:08.970698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.971222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.973693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:08.974729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:08.975199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:08.975632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:09.063138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:09.073806 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b79f2cbd-235b-4552-907e-82f18cc126ed tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1270 microversion: 2.1 time: 0.134809 Sep 14 09:22:09.074734 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 630/1203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:08 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:09.578090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:09.578719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:09.579985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-609b2394-b507-4fbc-bf4e-edd8782c44b3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f9de040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:09.587938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:09.589237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:09.589683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:09.592259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:09.592367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:09.592738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:09.654290 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-609b2394-b507-4fbc-bf4e-edd8782c44b3 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.085796 Sep 14 09:22:09.655819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 574/1204] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:09 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:22:09.809725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:09.820134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:09.823153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:09.824620 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc663fb8-a887-4ae0-adfc-0d008fea029b tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1280 microversion: 2.25 time: 0.252448 Sep 14 09:22:09.825398 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 631/1205] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:09 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:22:09.919927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:09.920481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:09.930242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:09.931071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:09.931721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:09.932732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:09.933839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:09.934478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:10.098856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:10.100667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:10.117215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:10.118372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:10.119472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:10.120527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:10.123153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:10.123153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:10.283857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:10.290029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:10.295842 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b90452e4-82dd-4c16-8db0-34b601f2b3cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1810 microversion: 2.1 time: 0.378802 Sep 14 09:22:10.298512 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 575/1206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:09 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1810 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:10.301232 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64e69382-b5a0-4c87-ba71-0f427fcedc25 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1270 microversion: 2.1 time: 0.207226 Sep 14 09:22:10.309328 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 632/1207] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:10 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:10.680229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f4d3b19-c6f7-4023-9fe0-0796a91cffb6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f9de040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:10.798038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f4d3b19-c6f7-4023-9fe0-0796a91cffb6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.127492 Sep 14 09:22:10.809773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 576/1208] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:10 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:10.852912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:10.853936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:10.861995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:10.862583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:10.863452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:10.864654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:10.865341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:10.868433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.211768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:11.224957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:11.226794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:11.229328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c580169-be84-49e6-b535-772dba40a7c4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1476 microversion: 2.25 time: 0.380347 Sep 14 09:22:11.230827 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 633/1209] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:10 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:11.328555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:11.330098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:11.341868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.344101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.344870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.346749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.348581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.349243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.555700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:11.557088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:11.577905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.578373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.581711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.583165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.583988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.584435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.702008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:11.742789 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cc057dd8-61e8-4f42-bf5b-26188a16324c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1810 microversion: 2.1 time: 0.422765 Sep 14 09:22:11.756089 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 634/1210] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:11 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1810 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:11.756089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:11.756089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:11.759929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.760595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.761027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.761753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:11.762208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:11.762629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:11.815225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 4e31a44a-3fd4-4994-8b71-ecce712707ce {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:11.832981 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3610f1be-a635-4e29-a91d-b7cd1554faad tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1970 microversion: 2.25 time: 0.578190 Sep 14 09:22:11.833627 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 577/1211] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:11 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1970 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:11.838918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1679965951", "imageRef": "fb57d923-cd4e-4881-9c02-2f7e3c7a803f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c3420d68-a94c-4f78-9ebc-25f762b58525"}], "security_groups": [{"name": "tempest-securitygroup--388112468"}], "key_name": "tempest-keypair-753148466", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:12.138404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:12.153606 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3d255b63-e632-4b1f-883b-0c6e0d07e401 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 0.407995 Sep 14 09:22:12.158285 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 635/1212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:11 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:12.202926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3768e584-8f29-49f4-8a0f-8aeb285ff68e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f87cc10>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:12.233113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] validate_networks() for [('c3420d68-a94c-4f78-9ebc-25f762b58525', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:22:12.385984 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3768e584-8f29-49f4-8a0f-8aeb285ff68e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.224632 Sep 14 09:22:12.386592 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 636/1213] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:12 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:12.423662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:12.427635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:12.458635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:12.466615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:12.467301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:12.469003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:12.469629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:12.471968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:12.860542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 4e31a44a-3fd4-4994-8b71-ecce712707ce {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:12.895739 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f81adbb-48c9-4d13-8be4-e68475628960 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1970 microversion: 2.25 time: 0.504561 Sep 14 09:22:12.896498 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 637/1214] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:12 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1970 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:12.904486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-deleted", "tag": "f7010d96-6cff-4a41-ad67-0cf7844f54cd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:12.931738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:12.936103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:12.938103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:12.971479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] Creating event network-vif-deleted:f7010d96-6cff-4a41-ad67-0cf7844f54cd for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:12.992106 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-55d78661-a6dd-48d3-84a2-089227f63d51 req-95136a3a-b64c-4632-bea0-e97afe91aabf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093370 Sep 14 09:22:12.992650 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 638/1215] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:12.999992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:13.000711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:13.017302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.017720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.018170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.018900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.023672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.027298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.265253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:22:13.265714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:22:13.266328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:22:13.268175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:22:13.268922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:22:13.297611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.298572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.303212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.304320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.307188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.307800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.373525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Getting quotas for project 7c1bfe90d9954ab5a92d43f1c4511b52. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:13.394458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Getting quotas for user 70ada7bba23b4508851f61fb101cdd12 and project 7c1bfe90d9954ab5a92d43f1c4511b52. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:13.462489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:22:13.464917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fb57d923-cd4e-4881-9c02-2f7e3c7a803f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:22:13.496040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:13.515667 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06e257d8-88a7-4810-938f-6a42c7e88b9a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1789 microversion: 2.1 time: 0.519653 Sep 14 09:22:13.527920 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 639/1216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:12 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1789 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:13.527920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:13.531343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.532168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.533214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.540743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.541670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.542404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.619834 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-67a9962a-f3a9-4227-ab5d-bc7b999357f0 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.096609 Sep 14 09:22:13.620668 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 640/1217] 10.222.0.90 () {60 vars in 1217 bytes} [Wed Sep 14 09:22:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:22:13.633721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-plugged", "status": "completed", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:13.649431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac53e659-3278-40c7-8745-5e14683564d2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.814579 Sep 14 09:22:13.656788 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 578/1218] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:22:13.663102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:13.663726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:13.664296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.665026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.670105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.709663 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] Creating event network-vif-plugged:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:22:13.728592 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ba121848-96c8-42bf-9b88-6d04f98a4e25 req-004ec6a4-6338-4def-8611-6ccb74e34539 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104138 Sep 14 09:22:13.728840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.729466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.729921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.730493 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 641/1219] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:13.730654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.738917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.742053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.746071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad7508a8-5e00-4f62-81e9-410f70407da7 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f617040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:13.886373 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad7508a8-5e00-4f62-81e9-410f70407da7 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.154542 Sep 14 09:22:13.888893 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 642/1220] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:13 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:13.921716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851028-12", "block_migration": "auto"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:13.935306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:13.972288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.973102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.975395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:13.979439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:13.980472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:13.981640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:14.068029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'flavor' on Instance uuid 4e31a44a-3fd4-4994-8b71-ecce712707ce {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:14.106941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Going to try to live migrate instance to n-h1-851028-12 {{(pid=122443) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:22:14.293018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:14.305676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc2401f7-9a2d-4680-96c5-a298839d3d32 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 0.646522 Sep 14 09:22:14.308566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 579/1221] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:13 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:14.324392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88ad4063-ff1d-44d8-89fd-ed13466228ad tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:14.326790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88ad4063-ff1d-44d8-89fd-ed13466228ad tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:14.895198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88ad4063-ff1d-44d8-89fd-ed13466228ad tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:14.912095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88ad4063-ff1d-44d8-89fd-ed13466228ad tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1245 microversion: 2.1 time: 0.596587 Sep 14 09:22:14.924597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 580/1222] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:14 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1245 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:14.933345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:14.942249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:14.978301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:14.978827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:14.979272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:14.980032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:14.980550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:14.981033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:15.564275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:15.590251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19ff30f1-bcd8-4373-8901-fd95c75ee9d2 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1674 microversion: 2.1 time: 0.663123 Sep 14 09:22:15.595515 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 581/1223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:14 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1674 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:15.615493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1cb4ed2-6433-48cb-adb2-271363a172e1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f96e3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:15.739372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1cb4ed2-6433-48cb-adb2-271363a172e1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1454 microversion: 2.1 time: 0.140826 Sep 14 09:22:15.740577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 582/1224] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:15 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:15.757569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:15.768893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:15.804470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:15.804995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:15.805436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:15.806160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:15.816521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:15.817395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:15.864426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=54 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:16.330004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:16.357312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52e80bed-142a-49af-af4c-597d6382df6f tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 0.611215 Sep 14 09:22:16.357962 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 583/1225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:15 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:16.403116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-unplugged", "status": "completed", "tag": "3650c541-d9ea-4d9c-9a5c-5d07e8889037"}, {"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-unplugged", "status": "completed", "tag": "8759aae5-38c3-45c3-85e3-4d9b81218209"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:16.458110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:16.458576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:16.459020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:16.475414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:16.529249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Creating event network-vif-unplugged:3650c541-d9ea-4d9c-9a5c-5d07e8889037 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:16.530477 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] Creating event network-vif-unplugged:8759aae5-38c3-45c3-85e3-4d9b81218209 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:16.550541 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e1a46d5a-2f5e-465b-9853-d6e25d901671 req-bbaedbd4-eb84-472b-9d91-ff080259003c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.177056 Sep 14 09:22:16.553853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 584/1226] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:16.583326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:16.585564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:16.632460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:16.635050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:16.636691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:16.638993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:16.639582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:16.641363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:17.049229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:17.063536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20d80b31-6ae2-4906-a275-d654fd603f49 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1305 microversion: 2.1 time: 0.507221 Sep 14 09:22:17.081677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 585/1227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:16 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1305 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:17.095465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba0d719c-da2c-4027-a3f3-8aa3258123ad", "tag": "6df657d5-8d41-4527-beb0-28ae1b88ce42"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:17.114894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:17.115635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:17.116367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:17.150635 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] Creating event network-changed:6df657d5-8d41-4527-beb0-28ae1b88ce42 for instance ba0d719c-da2c-4027-a3f3-8aa3258123ad on n-h2-851028-12 Sep 14 09:22:17.208506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0ca8d7e5-13cb-4b3d-b8d6-bfb0c8bd9d1a req-781b221e-86f1-45ae-876a-03dde58820eb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118371 Sep 14 09:22:17.209378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 586/1228] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:17.258246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:17.262925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:17.290781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:17.291734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:17.300061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:17.306077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:17.307068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:17.307740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:19.755931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:19.777552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00a60f2c-1524-4757-995f-059d1389fea3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 200 len: 1653 microversion: 2.1 time: 2.564974 Sep 14 09:22:19.780572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 587/1229] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:17 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 1653 bytes in 2570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:19.805247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7de9aba4-1540-48ab-a15c-9665534ccf47 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f92f5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:20.167587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2d6b7f77-1192-4a9b-b2f3-dfb29eb85ddc tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce/action" status: 202 len: 0 microversion: 2.25 time: 6.266023 Sep 14 09:22:20.168381 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 643/1230] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:22:13 2022] POST /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce/action => generated 0 bytes in 6267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:20.173921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:20.175096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:20.215587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:20.216537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:20.217171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:20.218446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:20.223270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:20.224098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:20.256762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:22.167019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:22.181549 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-952e7610-8f6f-4c4f-9450-a8ae30387d51 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 2.012138 Sep 14 09:22:22.182817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 644/1231] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:20 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:22.198563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:22.203598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:22.220895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:22.221870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:22.222835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:22.223998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:22.224735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:22.237345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.031411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:23.040565 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f297f16-94b4-47b1-92c1-6643454469d7 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1303 microversion: 2.1 time: 0.855319 Sep 14 09:22:23.046580 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 645/1232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:22 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1303 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:23.060666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-deleted", "tag": "3650c541-d9ea-4d9c-9a5c-5d07e8889037"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:23.096933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.097734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.100115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.146677 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] Creating event network-vif-deleted:3650c541-d9ea-4d9c-9a5c-5d07e8889037 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:23.164235 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1f6758e0-af49-41d0-9e6a-263409bd9f8b req-68654fb4-db2c-4b54-a05f-f6d55cad407b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115577 Sep 14 09:22:23.166260 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 646/1233] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:23.180564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:23.183490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:23.202550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.204726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.206372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.209327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.211326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.211648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.340434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:23.569051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:23.696115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:23.708761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:23.714281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:23.719701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3f5429c-5a0a-40d6-89e4-a6d0c51b87c6 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.551964 Sep 14 09:22:23.724867 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 647/1234] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:23 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:23.731625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:23.732543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:23.740178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.741169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.741867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.742854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.743552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.744333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.760735 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 HTTP/1.1 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'be720a80-1a22-466a-8619-d16bd58f5ac2'} Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:23.762923 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:22:23.768292 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:23.771843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:23.773035 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad5fc567-540d-4c4d-989a-b070f21bd22a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 404 len: 111 microversion: 2.1 time: 0.046967 Sep 14 09:22:23.774144 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 648/1235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:23 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:23.799713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:23.805570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:23.812922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Searching by: {'deleted': False, 'project_id': '825ea15fe0f146febd1f7688696919f1'} {{(pid=122443) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:22:23.824649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.825528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.826194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:23.827149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:23.827837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:23.828536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:24.107531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.multi_cell_list [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122443) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:22:24.404754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-39b9ab6b-164d-4fe6-a7d5-d82d61b680a7 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.629077 Sep 14 09:22:24.416401 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 649/1236] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:22:23 2022] GET /compute/v2.1/servers => generated 333 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:24.421863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:24.422704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:24.431405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:24.432211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:24.432842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:24.434917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:24.436270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:24.436885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:24.906670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=14 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:25.409102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:25.419371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5674d55-8c0d-47d7-be2d-3997ef6278b5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 1.001480 Sep 14 09:22:25.430830 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 650/1237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:24 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:25.436305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:25.437280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:25.449869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:25.451784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:25.456716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:25.457537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:25.458516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:25.459249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:25.459933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:26.105717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:26.118786 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b920d747-34bb-432c-a648-dcd2bb88f527 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.684108 Sep 14 09:22:26.134504 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 651/1238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:25 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:26.139922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:26.170645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:26.170645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Searching by: {'deleted': False, 'project_id': '825ea15fe0f146febd1f7688696919f1'} {{(pid=122443) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:22:26.186799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:26.193951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:26.194474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:26.198762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:26.199249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:26.202683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:26.454220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.multi_cell_list [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122443) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:22:26.661486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:26.681154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:26.686775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:26.689410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:27.276098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:28.978971 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7b5c137d-00ad-4c7d-8f81-0485367f05bb tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 2.854223 Sep 14 09:22:28.979570 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 652/1239] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:22:26 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 2857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:28.984110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:28.984717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:29.012551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:29.013140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:29.013577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:29.014291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:29.014739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:29.015158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:29.761786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=14 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:29.880067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:29.895084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:29.900248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:29.901383 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c82de76a-f66a-4157-9a41-41b8bc9d984a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.920855 Sep 14 09:22:29.906329 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 653/1240] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:28 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:29.921170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0d719c-da2c-4027-a3f3-8aa3258123ad", "name": "network-vif-plugged", "status": "completed", "tag": "6df657d5-8d41-4527-beb0-28ae1b88ce42"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:29.942322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:29.949033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:29.949709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:29.969384 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] Creating event network-vif-plugged:6df657d5-8d41-4527-beb0-28ae1b88ce42 for instance ba0d719c-da2c-4027-a3f3-8aa3258123ad on n-h2-851028-12 Sep 14 09:22:29.986899 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0ac66c14-140c-4cf8-9316-a1b25fe1db13 req-1756d22f-a1d0-4611-a4d8-2425344ab767 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078420 Sep 14 09:22:29.996817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 654/1241] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:30.020851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be720a80-1a22-466a-8619-d16bd58f5ac2", "name": "network-vif-deleted", "tag": "8759aae5-38c3-45c3-85e3-4d9b81218209"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:30.054526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:30.061523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:30.062225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:30.090890 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] Creating event network-vif-deleted:8759aae5-38c3-45c3-85e3-4d9b81218209 for instance be720a80-1a22-466a-8619-d16bd58f5ac2 on n-h1-851028-12 Sep 14 09:22:30.099440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-56ccb863-dbde-4361-b4a0-4b47122a5b09 req-fdf0bd6c-9da8-4c23-94b1-f1d9d0813f41 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100854 Sep 14 09:22:30.108569 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 655/1242] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:30.115286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:30.116335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:30.141726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:30.147854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:30.148567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:30.153842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:30.154555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:30.155165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:30.847326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:30.866938 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-be8ca40a-d80c-4510-8e0f-5df5b4c16db5 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1312 microversion: 2.1 time: 0.746650 Sep 14 09:22:30.870181 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 656/1243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:30 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1312 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:30.885238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:30.890023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:30.921532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:30.925356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:30.926093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:30.927038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:30.927676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:30.928425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:31.707414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:31.742513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a297aef-b967-4f81-af9b-4474bee52c1d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.869822 Sep 14 09:22:31.761490 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 657/1244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:30 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:32.287413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29ae59e-6c87-480d-94be-f95f9485e4d2", "tag": "98133eb2-b7e0-4a79-9f3d-4170106ca9b1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:32.310989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:32.311473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:32.311933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:32.387657 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] Creating event network-changed:98133eb2-b7e0-4a79-9f3d-4170106ca9b1 for instance f29ae59e-6c87-480d-94be-f95f9485e4d2 on n-h1-851028-12 Sep 14 09:22:32.415801 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-6fec2049-8d91-44cb-b58b-722626043846 req-9862026b-e001-45de-afc6-f83ecd3bf5f7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.649630 Sep 14 09:22:32.425337 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 658/1245] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:32.461651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-11b97a1c-0be4-4b1e-b5da-ccaf8275da98 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:32.504014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-11b97a1c-0be4-4b1e-b5da-ccaf8275da98 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.075356 Sep 14 09:22:32.516836 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 659/1246] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:22:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:32.538691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:32.544547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:32.595531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:32.595531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:32.599028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:32.600012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:32.608102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:32.611584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:33.490950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:33.505047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:33.506670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:33.507869 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21c656e8-e3b4-4c2e-be6f-8e9920aa1455 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.987066 Sep 14 09:22:33.550469 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 660/1247] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:32 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:33.558439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:33.566084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:33.584822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:33.585645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:33.586255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:33.590693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:33.591410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:33.592035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:34.215652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:34.230593 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9b1b14bb-dd12-416f-a1c1-a8ad49268421 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1497 microversion: 2.1 time: 0.676881 Sep 14 09:22:34.234333 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 661/1248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:33 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1497 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:34.253414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:34.254080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:34.302758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:34.306138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:34.309330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:34.311292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:34.318651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:34.319431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:35.816189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:35.841139 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b256c3af-1d8c-40b2-aa23-2ee67ab5d629 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 1.604011 Sep 14 09:22:35.846273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 662/1249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:34 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:35.871105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:35.873616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:35.912922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:35.913814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:35.914446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:35.915469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:35.918865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:35.922346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.000845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:22:36.096812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7de9aba4-1540-48ab-a15c-9665534ccf47 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1463 microversion: 2.1 time: 16.312679 Sep 14 09:22:36.097545 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 588/1250] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:19 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1463 bytes in 16315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:36.113754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:36.144005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:36.193156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_groups [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Querying cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) for 1 instances {{(pid=122444) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 09:22:36.197255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.199850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.202180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.295818 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d098dbf2-eaf1-4bdf-b7b6-a717c72e1e85 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "DELETE /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 204 len: 0 microversion: 2.1 time: 0.444945 Sep 14 09:22:36.296915 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 663/1251] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:22:35 2022] DELETE /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:36.307554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:36.312281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3eb99ecb-0fa5-4d25-958a-45a239891e84 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c" status: 200 len: 222 microversion: 2.1 time: 0.213412 Sep 14 09:22:36.316322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:36.319775 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 589/1252] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:22:36 2022] GET /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c => generated 222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:36.331729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b02a10b-f3cb-4e43-98e3-c3a0b7f4bc00 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa58e50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:36.337802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.340434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.342382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.343505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.347432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.348432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.349884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:36.458054 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b02a10b-f3cb-4e43-98e3-c3a0b7f4bc00 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 200 len: 1463 microversion: 2.1 time: 0.135001 Sep 14 09:22:36.458978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 590/1253] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:36 2022] GET /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 1463 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:36.493136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:36.496254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:36.522071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.528644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.529702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.536707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:36.537535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:36.543521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:36.641082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:37.107813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:37.144785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:37.148417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:37.153824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:37.160587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7fea0698-1b4a-40dd-86bd-980756805b2a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.852022 Sep 14 09:22:37.162601 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 664/1254] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:36 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:37.172842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:37.185212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:37.185618 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48894238-e305-43ce-a16e-8678bc04b9de tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1700 microversion: 2.1 time: 0.724667 Sep 14 09:22:37.200407 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 591/1255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:36 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1700 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:37.206041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:37.209274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:37.227943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.228460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.231427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.233698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.234567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.235054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.235488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.236610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.238656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.246136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:37.250983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:37.252346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:37.388785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:22:37.715451 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6e17e488-9164-4b7d-8dc5-f152e209d093 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 204 len: 0 microversion: 2.1 time: 0.550628 Sep 14 09:22:37.716737 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 665/1256] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:22:37 2022] DELETE /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:37.744086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-401393404", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "79d2a7af-2e26-4f41-87d5-4932f43d1965"}, {"uuid": "d1f7c0b3-caf3-4ad5-b49e-15e02b0ac1ea"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:37.895160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] validate_networks() for [('79d2a7af-2e26-4f41-87d5-4932f43d1965', None, None, None, None, None), ('d1f7c0b3-caf3-4ad5-b49e-15e02b0ac1ea', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:22:37.934935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:37.959712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18b5e2a9-08b7-4a91-b48f-4ce8df2b6bbf tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1467 microversion: 2.1 time: 0.766236 Sep 14 09:22:37.976297 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 592/1257] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:37 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1467 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:37.993391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:37.994010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:38.022177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.025339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.027550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:38.029436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:38.032882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:38.033674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:39.022604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:39.044272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c296f94-0f0f-4bad-9aff-f980dfc63ffd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 1.066728 Sep 14 09:22:39.044880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 593/1258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:37 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:39.061052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:39.062341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:39.073373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.077872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.078541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:39.079523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:39.080494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:39.082109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:41.738753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5525a97f4700405e978b1a01c383c193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3b7575ae704d109cf9298ed02a1c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:41.759029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17bcf59f-f3b8-438a-9054-06d9a427b476 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 200 len: 1503 microversion: 2.1 time: 2.712468 Sep 14 09:22:41.780562 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 594/1259] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:39 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 1503 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:41.792292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5e37bf3-6719-4a8a-937f-bc9f9a1d2ec7 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8d6790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:42.080698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5e37bf3-6719-4a8a-937f-bc9f9a1d2ec7 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?changes-since=2022-09-14T09%3A19%3A47Z" status: 200 len: 2801 microversion: 2.1 time: 0.295948 Sep 14 09:22:42.083160 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 595/1260] 10.222.0.90 () {58 vars in 1199 bytes} [Wed Sep 14 09:22:41 2022] GET /compute/v2.1/images?changes-since=2022-09-14T09%3A19%3A47Z => generated 2801 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:42.097797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:42.099713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:42.121078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.122618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.123821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.127587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.130635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.132329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.692370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:42.711833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:42.713412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:42.719771 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb42403e-f874-4d5a-baf1-bad2ca317052 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.634769 Sep 14 09:22:42.721355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 596/1261] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:42 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:42.753370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:42.755063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:42.763485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.764001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.764682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.765622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.766548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.767332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.918988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:22:42.919806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:22:42.924775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:22:42.925261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:22:42.925678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:22:42.933854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea0d4dffcad4fee8c815aad29679973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '825ea15fe0f146febd1f7688696919f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:42.952300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.952803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.953247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.954029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:42.954682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:42.956736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23f7c40a-d2eb-47cc-86d2-316450470847 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 200 len: 1632 microversion: 2.1 time: 0.234045 Sep 14 09:22:42.957631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:42.982275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 597/1262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:42 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 1632 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:43.012367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Getting quotas for project 421a08fa24cf4b89abc73bc3770d6a40. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:43.012367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Getting quotas for user 374349250ea545b8936dff89d329be60 and project 421a08fa24cf4b89abc73bc3770d6a40. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:43.056364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:22:43.059693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:22:43.230808 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-918ce1b9-8daa-4e09-adaa-7dc764b4e12c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.510481 Sep 14 09:22:43.233593 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 666/1263] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:22:43.262484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:43.264628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:43.290628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1842626037", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:43.299283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:43.300244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:43.300903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:43.301862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:43.302525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:43.303172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:43.463853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] validate_networks() for [('d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:22:44.188829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:44.206622 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6feaefa5-d54e-4258-83f5-b191e96a3a13 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.967375 Sep 14 09:22:44.208236 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 667/1264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:43 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:44.223559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba0d719c-da2c-4027-a3f3-8aa3258123ad", "name": "network-vif-deleted", "tag": "6df657d5-8d41-4527-beb0-28ae1b88ce42"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:44.246604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.247570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.248525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.269747 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] Creating event network-vif-deleted:6df657d5-8d41-4527-beb0-28ae1b88ce42 for instance ba0d719c-da2c-4027-a3f3-8aa3258123ad on n-h2-851028-12 Sep 14 09:22:44.287513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ed1de7a1-c413-4803-9536-908bbaa852ed req-cfea6a72-f424-4e20-b112-5174deaa4be1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078122 Sep 14 09:22:44.288659 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 668/1265] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:44.302254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-unplugged", "status": "completed", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:44.319835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.320760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.321428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.340857 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] Creating event network-vif-unplugged:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:22:44.350034 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3839afec-e175-43e7-b39b-4e7f2ae4a8b4 req-022123bd-9491-4d58-910e-58f99a509c84 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055013 Sep 14 09:22:44.351122 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 669/1266] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:44.358183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a978226-2447-4cb5-98e3-0537b4319cde tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f3fd550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:44.485754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a978226-2447-4cb5-98e3-0537b4319cde tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-830612957" status: 200 len: 484 microversion: 2.1 time: 0.133091 Sep 14 09:22:44.487423 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 670/1267] 10.222.0.90 () {58 vars in 1229 bytes} [Wed Sep 14 09:22:44 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-830612957 => generated 484 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:44.506450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:44.509764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:44.531567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.532139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.533307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.537257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.537848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.538281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.583942 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad HTTP/1.1 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ba0d719c-da2c-4027-a3f3-8aa3258123ad'} Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:44.586120 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-265a8dc8-58db-4753-814e-0f5b23d0df73 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 404 len: 111 microversion: 2.1 time: 0.097679 Sep 14 09:22:44.595332 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 671/1268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:44 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:44.613386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:44.619129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:44.630824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.631352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.645955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.647005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.648174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.649820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.791857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:44.814202 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e3fd9068-b896-45b4-b6c0-dd392c712582 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1264 microversion: 2.1 time: 0.210926 Sep 14 09:22:44.831015 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 672/1269] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:44 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1264 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:44.854459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:44.857166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:44.890734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.897528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.898195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:44.899071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:44.900795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:44.901670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.125445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:22:45.126411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:22:45.127033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:22:45.127451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:22:45.128056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:22:45.148908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.150603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.151068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.154992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.156154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.176236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.244303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:22:45.260501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for user acf0e1a651e34682923f8eb74872adb1 and project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:22:45.299404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:22:45.305826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:22:45.433373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1fa5fb87-3460-40c6-880a-4ec0c7e6fed3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.449849 Sep 14 09:22:45.442628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 598/1270] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:22:45.459811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "759f2aaa-607d-4ef4-91f1-b8054be58873", "name": "network-vif-deleted", "tag": "e8b9f92f-2e76-4935-879d-1e9a934aaa31"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:45.497593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.498031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.498567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.529188 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] Creating event network-vif-deleted:e8b9f92f-2e76-4935-879d-1e9a934aaa31 for instance 759f2aaa-607d-4ef4-91f1-b8054be58873 on n-h1-851028-12 Sep 14 09:22:45.545027 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d3d255e1-0c82-4589-9596-add0bb35e472 req-9acdf208-65a0-4cf6-91bb-039391cec364 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099541 Sep 14 09:22:45.546101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 599/1271] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:45.552240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.553087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] [instance: 759f2aaa-607d-4ef4-91f1-b8054be58873] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:45.559764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.560431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.560960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.561948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.562620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.563262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.581680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] HTTP exception thrown: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Request method failure captured: Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 HTTP/1.1 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzzZ9lL2Lhv4auZJzc0WuHr8szophXCL7GAcC8ea2n2ZSqraSXBFKTkbDpXMGNSbSBu8JfeC8P4C7Rw663m6tEibfQcCOoY8d9NqTsBZ5GMqh6KSatrddy-_3gxjJKqIqnYLMK8oO1ZjMjoKsnyi3DzOjpF7eX-cTEQuoV05d5SSDI Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 825ea15fe0f146febd1f7688696919f1 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-813642252 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_825ea15fe0f146febd1f7688696919f1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/825ea15fe0f146febd1f7688696919f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/825ea15fe0f146febd1f7688696919f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/825ea15fe0f146febd1f7688696919f1"}]}] Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-813642252 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 825ea15fe0f146febd1f7688696919f1 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-813642252 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-813642252-project Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1ea0d4dffcad4fee8c815aad29679973 Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-813642252-project Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '759f2aaa-607d-4ef4-91f1-b8054be58873'} Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:45.586311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. Sep 14 09:22:45.591329 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:45.592778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Returning 404 to user: Instance 759f2aaa-607d-4ef4-91f1-b8054be58873 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:45.593866 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-219463c4-8146-463f-8195-7fdb7fd1b484 tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873" status: 404 len: 111 microversion: 2.1 time: 0.046593 Sep 14 09:22:45.594902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 600/1272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/servers/759f2aaa-607d-4ef4-91f1-b8054be58873 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:45.617522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2880b06d-ec52-4a64-83d8-2ee8f1725e8b tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f939040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.806772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:45.822405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:45.824761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:45.826830 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c97641bb-ad8f-4658-ae2a-0fe86d0424cb tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.991123 Sep 14 09:22:45.864411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 673/1273] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:44 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:45.877585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.883788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2880b06d-ec52-4a64-83d8-2ee8f1725e8b tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?server=1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 957 microversion: 2.1 time: 0.286928 Sep 14 09:22:45.884831 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 601/1274] 10.222.0.90 () {58 vars in 1209 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/images?server=1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 957 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:45.890971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:45.894445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:45.944385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.944952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.945395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.946117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.947173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.947612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:45.948235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.compute.server_groups [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Querying cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) for 1 instances {{(pid=122443) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 09:22:45.950170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:45.952092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:45.955042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.015952 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-15fe7efe-2ea6-482a-9baf-972979f86026 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.149959 Sep 14 09:22:46.034739 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 674/1275] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:46.060256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-29378ac0-d12e-4d03-92f0-5124322ebaf0 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:46.066930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-29378ac0-d12e-4d03-92f0-5124322ebaf0 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:46.241851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-29378ac0-d12e-4d03-92f0-5124322ebaf0 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:46.255932 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-29378ac0-d12e-4d03-92f0-5124322ebaf0 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1211 microversion: 2.1 time: 0.216464 Sep 14 09:22:46.258536 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 675/1276] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:46 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1211 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:46.270600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-67a59f5e-8b0c-47c2-b611-b3f45780664e tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] Calling method '.version_select at 0x7f693f3720d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:46.316247 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-67a59f5e-8b0c-47c2-b611-b3f45780664e tempest-ServersTestJSON-813642252 tempest-ServersTestJSON-813642252-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227485078" status: 202 len: 0 microversion: 2.1 time: 0.056583 Sep 14 09:22:46.318707 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 676/1277] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1227485078 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:22:46.346012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1803337049", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4c33cfad-8937-4143-9e26-04ee8e8528f5"}], "security_groups": [{"name": "tempest-securitygroup--1332296004"}], "key_name": "tempest-keypair-650298534", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ea20527c-5fe2-4a2d-b535-2e7a663ebae3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:46.446565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:46.463039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee1ace47-1041-4ad2-b7ba-4b0dc640f534 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.572369 Sep 14 09:22:46.472270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 602/1278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:45 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:46.492059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:46.495684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:46.508353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.508852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.509290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.509994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:46.517074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:46.518134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:46.943522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:46.967675 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb36351d-3a4b-4bd0-b9c3-d305082f619c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1312 microversion: 2.1 time: 0.493719 Sep 14 09:22:46.988109 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 603/1279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:46 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:46.999583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51495214-1b5f-4482-bb7d-a74c01c67e7a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f92fa60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.070071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51495214-1b5f-4482-bb7d-a74c01c67e7a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fv2.1%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 485 microversion: 2.1 time: 0.077828 Sep 14 09:22:47.070971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 604/1280] 10.222.0.90 () {58 vars in 1317 bytes} [Wed Sep 14 09:22:46 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fv2.1%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 485 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:47.091833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.144878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_groups [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Querying cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) for 1 instances {{(pid=122444) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 09:22:47.145674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.146227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.146725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.165201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df498acc-33b7-450e-ba6c-252f2d663e57 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c" status: 200 len: 184 microversion: 2.1 time: 0.093099 Sep 14 09:22:47.166404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 605/1281] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c => generated 184 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:47.175204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.176179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:47.186557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.187412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.188236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.189647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.190718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.191325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.383948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:47.408353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:47.410508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:47.412975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cfc6ba3d-4626-4352-9477-9fb72b4a2f16 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.244138 Sep 14 09:22:47.414619 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 606/1282] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:47.422210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e997a407-23db-4364-b271-5a67ac5eea9c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa2c310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.519723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e997a407-23db-4364-b271-5a67ac5eea9c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 485 microversion: 2.1 time: 0.103707 Sep 14 09:22:47.521255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 607/1283] 10.222.0.90 () {58 vars in 1303 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 485 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:47.538822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.539625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:47.550001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.550732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.551660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.552984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.553744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.554343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.591521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad HTTP/1.1 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ba0d719c-da2c-4027-a3f3-8aa3258123ad'} Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:47.613701 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:47.620041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:47.624739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:47.628651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a658143-4496-45f1-bcc7-b64d70d0598e tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 404 len: 111 microversion: 2.1 time: 0.104266 Sep 14 09:22:47.629795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 608/1284] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:22:47 2022] DELETE /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:47.645972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:47.648809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:47.701616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.706999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.709338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.713476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:47.713979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:47.714397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:47.974093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:47.990839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1539971-e74d-4390-8049-ea61a5a0c525 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1281 microversion: 2.1 time: 0.354878 Sep 14 09:22:47.991433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 609/1285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1281 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:47.999628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:48.005080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:48.027871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.030164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.032431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.033751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:48.034227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:48.034670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:48.852376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:48.867567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9feecd55-cd77-4203-a55a-e148dcc89bbd tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.874583 Sep 14 09:22:48.869100 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 610/1286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:47 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:48.877280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0274fc8-afb3-4360-a377-c0492a0e9aa9 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa27ca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.105792 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d0274fc8-afb3-4360-a377-c0492a0e9aa9 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.233479 Sep 14 09:22:49.137233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 611/1287] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:22:48 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:49.137233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e31a44a-3fd4-4994-8b71-ecce712707ce", "name": "network-vif-unplugged", "status": "completed", "tag": "bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb"}, {"name": "network-changed", "server_uuid": "4e31a44a-3fd4-4994-8b71-ecce712707ce", "tag": "bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:49.146267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.146801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.147309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.181121 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Creating event network-vif-unplugged:bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb for instance 4e31a44a-3fd4-4994-8b71-ecce712707ce on n-h2-851028-12 Sep 14 09:22:49.181653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] Creating event network-changed:bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb for instance 4e31a44a-3fd4-4994-8b71-ecce712707ce on n-h2-851028-12 Sep 14 09:22:49.198741 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-356d985f-eb0a-4185-9e35-1fcf2e1d3582 req-de2a2ae9-0c4f-44d4-b655-115131660554 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.075501 Sep 14 09:22:49.202551 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 612/1288] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:49.211577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.216542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] [instance: ba0d719c-da2c-4027-a3f3-8aa3258123ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.237617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.243874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.244407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.245176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.246575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.246575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.268793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad HTTP/1.1 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ba0d719c-da2c-4027-a3f3-8aa3258123ad'} Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:49.275467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance ba0d719c-da2c-4027-a3f3-8aa3258123ad could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba10597f-c655-4aed-b1da-b841c525ae0d tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad" status: 404 len: 111 microversion: 2.1 time: 0.068794 Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 613/1289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:49 2022] GET /compute/v2.1/servers/ba0d719c-da2c-4027-a3f3-8aa3258123ad => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.281095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.285619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.286113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.286545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.287281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.287732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.288184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.690520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:49.707772 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-855fd9dc-e111-4981-8b67-e060d9acc111 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.433518 Sep 14 09:22:49.722681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 614/1290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:49 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:49.731356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:49.733318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:49.742970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.743753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.744406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:49.745306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:49.745976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:49.747004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.213105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.230965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.240875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.242252 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1fa64891-eb3c-496b-b4de-5560107236e4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.518751 Sep 14 09:22:50.255576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 615/1291] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:49 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:50.255576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:50.255576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:50.272839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.273314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.274785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.275989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.276650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.278251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.311645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:50.675336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:50.692716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3a60669-c0b2-41f9-8caa-e0a47d4a801e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.444664 Sep 14 09:22:50.695708 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 616/1292] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:50 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:50.701827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f29ae59e-6c87-480d-94be-f95f9485e4d2", "name": "network-vif-plugged", "status": "completed", "tag": "98133eb2-b7e0-4a79-9f3d-4170106ca9b1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:50.716839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.717739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.718356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.735776 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] Creating event network-vif-plugged:98133eb2-b7e0-4a79-9f3d-4170106ca9b1 for instance f29ae59e-6c87-480d-94be-f95f9485e4d2 on n-h1-851028-12 Sep 14 09:22:50.744385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4fcb7aa0-e260-4acd-a9af-45bbe71f33d1 req-307a8f97-550d-41ce-a0a9-f4461681a236 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046287 Sep 14 09:22:50.745424 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 617/1293] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:50.751260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d66abe0f-34cb-415a-bc02-1a9fda85a359 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8c28b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:50.886378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d66abe0f-34cb-415a-bc02-1a9fda85a359 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.139543 Sep 14 09:22:50.887791 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 618/1294] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:22:50 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:50.895003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4df20b88-9dc4-420b-9487-7140620b3426 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:50.913462 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4df20b88-9dc4-420b-9487-7140620b3426 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4df20b88-9dc4-420b-9487-7140620b3426 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-server-groups/1113eb88-bafe-42da-8b5a-59150ad40515 HTTP/1.1 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1113eb88-bafe-42da-8b5a-59150ad40515'} Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:50.915488 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:50.924913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4df20b88-9dc4-420b-9487-7140620b3426 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance group 1113eb88-bafe-42da-8b5a-59150ad40515 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:50.927584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4df20b88-9dc4-420b-9487-7140620b3426 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/1113eb88-bafe-42da-8b5a-59150ad40515" status: 404 len: 117 microversion: 2.1 time: 0.036705 Sep 14 09:22:50.927584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 619/1295] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:50 2022] DELETE /compute/v2.1/os-server-groups/1113eb88-bafe-42da-8b5a-59150ad40515 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:50.931167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "tag": "85a319ef-45e9-4ac5-afd0-84b40d92135f"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:50.943674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.944449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.945173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.961772 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] Creating event network-changed:85a319ef-45e9-4ac5-afd0-84b40d92135f for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:22:50.971537 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c08a7c96-e2b4-4ec6-89a0-c98d15b9ab1a req-9d146342-c86d-4242-aed6-bdc85e112308 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043880 Sep 14 09:22:50.973227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 620/1296] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:50.979413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:50.980630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:50.988364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.989199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.989996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:50.991134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:50.991825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:50.992440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.569658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:51.652865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4788bfa6-c4ed-4ed0-ae96-5a75f18aa9ff tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1370 microversion: 2.1 time: 0.678122 Sep 14 09:22:51.658443 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 621/1297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:50 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1370 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:51.679332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:51.686862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:51.709254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.710043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.710656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:51.711613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:51.718007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:51.718796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.112395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:52.125073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-376ca559-93b3-43c6-b1b0-8116cb359fa0 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.465080 Sep 14 09:22:52.125668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 622/1298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:51 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:52.130941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32c7c3e0-d565-4bd0-a94d-998c5b09027f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f9de040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.267440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32c7c3e0-d565-4bd0-a94d-998c5b09027f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.140065 Sep 14 09:22:52.288865 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 623/1299] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:52.294346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-061a00df-ca22-42c9-9384-f1a15cd7a12a tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.304042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-061a00df-ca22-42c9-9384-f1a15cd7a12a tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-061a00df-ca22-42c9-9384-f1a15cd7a12a tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-server-groups/7cb27b6a-efd7-4875-a6a2-13d11f986eff HTTP/1.1 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7cb27b6a-efd7-4875-a6a2-13d11f986eff'} Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:52.306044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-061a00df-ca22-42c9-9384-f1a15cd7a12a tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance group 7cb27b6a-efd7-4875-a6a2-13d11f986eff could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-061a00df-ca22-42c9-9384-f1a15cd7a12a tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/7cb27b6a-efd7-4875-a6a2-13d11f986eff" status: 404 len: 117 microversion: 2.1 time: 0.017858 Sep 14 09:22:52.310496 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 624/1300] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:52 2022] DELETE /compute/v2.1/os-server-groups/7cb27b6a-efd7-4875-a6a2-13d11f986eff => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:52.314730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.315327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:52.324327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.324925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.325432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.326167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.326630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.327066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.882442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:52.895878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:52.897409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:52.898822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e224b25-1430-4afa-a7cd-af1c29a8e6df tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1486 microversion: 2.25 time: 0.589214 Sep 14 09:22:52.899566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 625/1301] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1486 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:52.904545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:52.905386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:52.913129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.913854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.914460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.915472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:52.916139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:52.916734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:52.985175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:53.216647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:53.226424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3afdb52-2ee5-42bd-a16f-8b37a9fc234e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.325535 Sep 14 09:22:53.227353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 626/1302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:52 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:53.231665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-049a26ea-e001-4a9e-97d2-0163a2f1ff53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa27310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.380776 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-049a26ea-e001-4a9e-97d2-0163a2f1ff53 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?changes-since=2022-09-14T09%3A19%3A43Z" status: 200 len: 7021 microversion: 2.1 time: 0.152415 Sep 14 09:22:53.381979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 627/1303] 10.222.0.90 () {58 vars in 1220 bytes} [Wed Sep 14 09:22:53 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-14T09%3A19%3A43Z => generated 7021 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:53.387013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-525ed69f-2b71-4426-aa0f-8e740656aee3 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.399086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-525ed69f-2b71-4426-aa0f-8e740656aee3 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-525ed69f-2b71-4426-aa0f-8e740656aee3 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-server-groups/b4f1b802-0513-4d1d-8911-54870c155b58 HTTP/1.1 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b4f1b802-0513-4d1d-8911-54870c155b58'} Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:53.403974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. Sep 14 09:22:53.408482 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:53.410953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-525ed69f-2b71-4426-aa0f-8e740656aee3 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance group b4f1b802-0513-4d1d-8911-54870c155b58 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:53.421717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-525ed69f-2b71-4426-aa0f-8e740656aee3 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/b4f1b802-0513-4d1d-8911-54870c155b58" status: 404 len: 117 microversion: 2.1 time: 0.029002 Sep 14 09:22:53.423951 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 628/1304] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:53 2022] DELETE /compute/v2.1/os-server-groups/b4f1b802-0513-4d1d-8911-54870c155b58 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:53.438941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.440623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:53.447431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.448234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.448826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.449744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.450363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.450957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.825762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:53.838631 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cca4103c-e904-4e2e-a500-d5c1a4473f0d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1557 microversion: 2.1 time: 0.411432 Sep 14 09:22:53.840359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 629/1305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:53 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1557 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:53.848006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "tag": "d026998f-abd6-4429-be45-d32f85852fd2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:53.860043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.860795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.862379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.876131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] Creating event network-changed:d026998f-abd6-4429-be45-d32f85852fd2 for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:22:53.894144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-880d96cd-4802-4a6a-8ba2-ec95f61e1df7 req-4aa1eddb-6710-41a3-a8b7-b265934df667 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049049 Sep 14 09:22:53.898879 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 630/1306] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:53.910032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:53.910980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:53.921564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.922327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.922940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:53.925164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:53.925712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:53.926209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.303074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:54.311738 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f3cd56a-4361-42af-899c-bd7739cb003d tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.410361 Sep 14 09:22:54.312704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 631/1307] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:53 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:54.334910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9", "tag": "224a52f7-20e7-4342-be9f-f5cfa2c2f723"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:54.345594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.346378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.346805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.358897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] Creating event network-changed:224a52f7-20e7-4342-be9f-f5cfa2c2f723 for instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 on n-h1-851028-12 Sep 14 09:22:54.365613 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6271ab46-9625-41d5-a02e-49e25a86ce1c req-6284d035-885b-4d64-adec-5ff3e6f25d81 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035840 Sep 14 09:22:54.366389 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 632/1308] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:54.372213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48a29334-9791-49ab-98ab-76b00c12a60f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8c28b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:54.463077 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48a29334-9791-49ab-98ab-76b00c12a60f tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-830612957" status: 200 len: 664 microversion: 2.1 time: 0.095524 Sep 14 09:22:54.463883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 633/1309] 10.222.0.90 () {58 vars in 1250 bytes} [Wed Sep 14 09:22:54 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-830612957 => generated 664 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:54.469684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d1e0e31-4df3-4cee-8bca-d2acf302c5cf tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:54.482448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2d1e0e31-4df3-4cee-8bca-d2acf302c5cf tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] HTTP exception thrown: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d1e0e31-4df3-4cee-8bca-d2acf302c5cf tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Request method failure captured: Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-server-groups/352f9cb9-afb9-4087-b1e9-1b52e691629d HTTP/1.1 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ0zLm-UT7KegUvjDcyjSnaoJEQ6IIQ-E-g_Vjns5mr520YKfE7Y4ZfhOeOyNgW-RVhoUSePHfvm19Kbs7YgMnBe8iKZUNzA7aKHAkOjS_giG9EBgF-X5oSDzJiDWh5E0zV-vkMIFCmHz3ZtvROfI0UjswIneJUjqPko0sj-5UvlHnc Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ac3b7575ae704d109cf9298ed02a1c65", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ac3b7575ae704d109cf9298ed02a1c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ac3b7575ae704d109cf9298ed02a1c65"}]}] Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ac3b7575ae704d109cf9298ed02a1c65 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerGroupTestJSON-1630179577 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5525a97f4700405e978b1a01c383c193 Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerGroupTestJSON-1630179577-project Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '352f9cb9-afb9-4087-b1e9-1b52e691629d'} Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:54.487119 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d1e0e31-4df3-4cee-8bca-d2acf302c5cf tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Returning 404 to user: Instance group 352f9cb9-afb9-4087-b1e9-1b52e691629d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d1e0e31-4df3-4cee-8bca-d2acf302c5cf tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/352f9cb9-afb9-4087-b1e9-1b52e691629d" status: 404 len: 117 microversion: 2.1 time: 0.023073 Sep 14 09:22:54.495310 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 634/1310] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:54 2022] DELETE /compute/v2.1/os-server-groups/352f9cb9-afb9-4087-b1e9-1b52e691629d => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:22:54.499667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:54.500511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:54.508206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.510279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.511011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.511993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.512658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.513314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.668071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3bfef4b-42cb-447d-820b-7f502c37229d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176562 Sep 14 09:22:54.669299 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 635/1311] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:22:54 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:54.687602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:54.688558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:54.700242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.700908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.701680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:54.703885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:54.705876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:54.706710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.022847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.036533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.038016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.039922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee35b10e-be1f-4777-b5a8-4a42bfd05aed tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1476 microversion: 2.25 time: 0.369529 Sep 14 09:22:55.058763 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 636/1312] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:54 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:55.070794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.071587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:55.078703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.079486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.081506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.082437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.083072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.083671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.202029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:55.278715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:55.318497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.333620 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-366ac13d-221d-4541-aba7-eed7400d7d17 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.273466 Sep 14 09:22:55.349936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 637/1313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:55.361206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-471f0b5e-71f9-42d7-b28c-aab2d93086b6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8d6af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.515279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-471f0b5e-71f9-42d7-b28c-aab2d93086b6 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fv2.1%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1467 microversion: 2.1 time: 0.163872 Sep 14 09:22:55.515913 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 638/1314] 10.222.0.90 () {58 vars in 1338 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fv2.1%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1467 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:55.523116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b350be50-2aaf-4a1c-8f68-7cccdac0d004 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.545330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:55.562979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b350be50-2aaf-4a1c-8f68-7cccdac0d004 tempest-ServerGroupTestJSON-1630179577 tempest-ServerGroupTestJSON-1630179577-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c" status: 204 len: 0 microversion: 2.1 time: 0.043572 Sep 14 09:22:55.563690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 639/1315] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:22:55 2022] DELETE /compute/v2.1/os-server-groups/dc9dc657-1ad2-4bbb-b690-4a096003dc6c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:22:55.572488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-250987a1-58e5-42d7-a956-df1f96b8c090 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '.version_select at 0x7f693f8c2430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.577401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-250987a1-58e5-42d7-a956-df1f96b8c090 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.577897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-250987a1-58e5-42d7-a956-df1f96b8c090 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.581284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-250987a1-58e5-42d7-a956-df1f96b8c090 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.607840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-250987a1-58e5-42d7-a956-df1f96b8c090 tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.041392 Sep 14 09:22:55.610168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 640/1316] 10.222.0.90 () {60 vars in 1184 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:55.621255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.623056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:55.631431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.632641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.633201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.634065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:55.634931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:55.636459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:55.960407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:55.968994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f47ff8f-8a00-480b-a3dd-ee314527a358 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.356018 Sep 14 09:22:55.980393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 641/1317] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:55.991385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21579d67-ccfe-44b2-a954-8a8ee179bf26 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8d6310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:55.997649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:56.073412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21579d67-ccfe-44b2-a954-8a8ee179bf26 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1467 microversion: 2.1 time: 0.091824 Sep 14 09:22:56.075019 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 642/1318] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Sep 14 09:22:55 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.90%2Fcompute%2Fservers%2Fec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1467 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:56.080935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:56.081889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:56.099833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.100389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.100833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.101562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:56.102022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:56.102454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:56.249471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:56.379725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:56.712676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] Lazy-loading 'services' on Instance uuid 4e31a44a-3fd4-4994-8b71-ecce712707ce {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:22:56.735431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73fdaa16-13f9-4e84-9c41-6dd889b6589b tempest-LiveAutoBlockMigrationV225Test-16826354 tempest-LiveAutoBlockMigrationV225Test-16826354-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1970 microversion: 2.25 time: 0.658835 Sep 14 09:22:56.737256 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 643/1319] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:56 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1970 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:56.758353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b25fc872-b965-44c7-a64f-e7e485726585 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f93eaf0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:57.009270 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b25fc872-b965-44c7-a64f-e7e485726585 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.270170 Sep 14 09:22:57.011226 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 644/1320] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 09:22:56 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:57.018582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:57.019317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:57.033086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.034135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.034691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.035921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.036772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.037465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.327002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:57.340194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a337a8c-0ac4-4fd1-98b1-560e2ef18ec7 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.327564 Sep 14 09:22:57.352155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 645/1321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:57 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:57.358166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:57.364361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:57.384607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.386308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.388659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.389613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.391793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.394617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.451153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:22:57.588775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:22:57.682529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3f7e65d-96bc-4cdf-96f9-c0b799b169ec tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 204 len: 0 microversion: 2.25 time: 0.335657 Sep 14 09:22:57.683573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 646/1322] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:22:57 2022] DELETE /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:22:57.692603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:57.706862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:57.714100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.714698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.715214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:57.717068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:57.717633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:57.718142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.061034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:58.075272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21f46687-6b4a-4979-b6a8-64717560c5cd tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.387128 Sep 14 09:22:58.076734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 647/1323] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:57 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:58.083041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f469f413-0ea6-4d0e-b3a2-150c57fdc55e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa758b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:58.170955 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f469f413-0ea6-4d0e-b3a2-150c57fdc55e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.092642 Sep 14 09:22:58.171973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 648/1324] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 09:22:58 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:58.176813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f29ae59e-6c87-480d-94be-f95f9485e4d2", "tag": "98133eb2-b7e0-4a79-9f3d-4170106ca9b1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:22:58.201289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.202389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.202904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.216680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] Creating event network-changed:98133eb2-b7e0-4a79-9f3d-4170106ca9b1 for instance f29ae59e-6c87-480d-94be-f95f9485e4d2 on n-h1-851028-12 Sep 14 09:22:58.227627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3bdece74-8682-480d-890c-69e48b528a2c req-4959072e-11f9-46f5-99b5-ac61e56852e4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053992 Sep 14 09:22:58.228361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 649/1325] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:58.237886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:58.238705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:58.247846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.248713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.249415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.250377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.251224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.253855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.596067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:58.604498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:58.605959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:58.607510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41d7ec5b-c8e3-4186-8a2c-443decd31b7d tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1482 microversion: 2.25 time: 0.377984 Sep 14 09:22:58.625321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 650/1326] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:22:58 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1482 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:22:58.630733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce7329fc-9c29-4d3f-b9a3-cdf2840f8b5c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8904c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:58.720511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce7329fc-9c29-4d3f-b9a3-cdf2840f8b5c tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55" status: 200 len: 784 microversion: 2.1 time: 0.093384 Sep 14 09:22:58.721497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 651/1327] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:22:58 2022] GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55 => generated 784 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:22:58.728130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:58.730898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:58.738126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.738904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.739502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:58.740415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:58.741137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:58.741784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:59.191199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:59.199682 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3422afde-284b-42bf-aa59-2817bf5629f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.475281 Sep 14 09:22:59.200309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 652/1328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:58 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:59.216001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23214657-c3c9-42cb-8993-da4d047e9858 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8d6e50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:59.301478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23214657-c3c9-42cb-8993-da4d047e9858 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.085155 Sep 14 09:22:59.303654 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 653/1329] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:22:59 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:59.309897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:22:59.310855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:22:59.321852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:59.322718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:59.323351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:59.324302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:22:59.324943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:22:59.325559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:22:59.760516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:22:59.773813 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3f64677-55cc-4db8-81dc-800db076e101 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.468418 Sep 14 09:22:59.774422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 654/1330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:59 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:22:59.787842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c39a991e-3e2d-4cdc-9948-8aa0317bb16a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f9d44c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:00.934734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c39a991e-3e2d-4cdc-9948-8aa0317bb16a tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511" status: 204 len: 0 microversion: 2.1 time: 1.158546 Sep 14 09:23:00.936899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 655/1331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:22:59 2022] DELETE /compute/v2.1/images/e359f8ac-fc81-4940-b9e3-12aa61606511 => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:00.946056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9", "name": "network-vif-plugged", "status": "completed", "tag": "224a52f7-20e7-4342-be9f-f5cfa2c2f723"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:00.983607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:00.983607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:00.984240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.017550 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] Creating event network-vif-plugged:224a52f7-20e7-4342-be9f-f5cfa2c2f723 for instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 on n-h1-851028-12 Sep 14 09:23:01.030678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9097b651-eb9f-4702-836f-7d7407356d89 req-aeff46a7-ef8e-4b2f-8a91-a8ec06f8c1b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091990 Sep 14 09:23:01.031307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 656/1332] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:01.052865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:01.053593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:01.086052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.089862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.090417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.091181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.091659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.092120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.295861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:01.310779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:01.312676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:01.318047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8760f523-b7f7-40b3-9032-adbb0d3b4273 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1265 microversion: 2.25 time: 0.285475 Sep 14 09:23:01.334324 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 657/1333] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:01 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:01.347073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e31a44a-3fd4-4994-8b71-ecce712707ce", "name": "network-vif-deleted", "tag": "bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:01.381059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.381565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.382015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.418665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] Creating event network-vif-deleted:bd2ef6f9-9ba4-4b65-a5c4-803b793a0feb for instance 4e31a44a-3fd4-4994-8b71-ecce712707ce on n-h1-851028-12 Sep 14 09:23:01.435921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c4afdb2b-bff7-40dd-9a56-1206995bc5e2 req-6c5311c3-8917-4d82-bb93-20e07ef9d231 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097018 Sep 14 09:23:01.442286 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 658/1334] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:01.452510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:01.453462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:01.463910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.464422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.464867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.465613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.470934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.472038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.873685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:01.889070 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b37f602d-91e0-489a-a8a7-a3b27e6151a9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1311 microversion: 2.1 time: 0.445347 Sep 14 09:23:01.893034 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 659/1335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:01 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1311 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:01.906889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:01.908781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:01.925437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.926179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.928860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:01.929984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:01.931592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:01.940313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:02.576455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:02.590625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b14e59bd-1798-417b-a471-0666d0f5824c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.694078 Sep 14 09:23:02.593465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 660/1336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:01 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:02.634754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c97c3e20-ab72-4d32-8787-1da19f0dc1c1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8b4af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:03.401959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c97c3e20-ab72-4d32-8787-1da19f0dc1c1 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b" status: 204 len: 0 microversion: 2.1 time: 0.807158 Sep 14 09:23:03.403712 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 661/1337] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:02 2022] DELETE /compute/v2.1/images/0a0403f0-47cc-42ac-9783-0e05db477d1b => generated 0 bytes in 810 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:03.410666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:03.411570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:03.436262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:03.438566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:03.440052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:03.442325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:03.443062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:03.443661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:03.557717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:03.574332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:03.577001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:03.583915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc50795b-aec7-4abc-893a-890e7d4286f4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1265 microversion: 2.25 time: 0.178362 Sep 14 09:23:03.586514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 662/1338] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:03 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:03.598828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:03.600299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:03.620595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:03.621577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:03.622308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:03.630827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:03.632511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:03.636464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:03.958105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:03.972313 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-357b29a6-cc8b-4317-abd0-4b8264264485 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1493 microversion: 2.1 time: 0.383917 Sep 14 09:23:03.977399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 663/1339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:03 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1493 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:03.992862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "name": "network-vif-plugged", "status": "completed", "tag": "85a319ef-45e9-4ac5-afd0-84b40d92135f"}, {"server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "name": "network-vif-plugged", "status": "completed", "tag": "d026998f-abd6-4429-be45-d32f85852fd2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:04.009526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:04.010863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:04.011780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:04.050105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Creating event network-vif-plugged:85a319ef-45e9-4ac5-afd0-84b40d92135f for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:23:04.051882 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] Creating event network-vif-plugged:d026998f-abd6-4429-be45-d32f85852fd2 for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:23:04.061932 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2e5a65f0-26f6-4926-a467-208487067eea req-ae8de962-e561-41a1-a9dc-69d62abe26bf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082346 Sep 14 09:23:04.063066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 664/1340] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:04.070808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-541e688a-119b-4f68-a7da-d5a67c222ef5 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f8b4280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:05.097338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-541e688a-119b-4f68-a7da-d5a67c222ef5 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a" status: 204 len: 0 microversion: 2.1 time: 1.030192 Sep 14 09:23:05.098663 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 665/1341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:04 2022] DELETE /compute/v2.1/images/e141d4af-eef2-4466-a065-598fc61d169a => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:05.107507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:05.110354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:05.128879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.140771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.141342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:05.142927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.143824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.144419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:05.476092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:05.488191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a1a8e49-3afd-49fd-aebf-eaaf52083703 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1333 microversion: 2.1 time: 0.387927 Sep 14 09:23:05.519458 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 666/1342] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:05 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1333 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:05.873312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:05.873930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:05.883425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.891080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.891924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:05.894139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:05.894790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:05.895386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.427077 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84fa3e31-c49b-4d90-b613-284a3622006d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1646 microversion: 2.1 time: 0.898396 Sep 14 09:23:06.431152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 667/1343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:05 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1646 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:06.437639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.442641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.463192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.463706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.465438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.466200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.466676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.467114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.583626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:06.594793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:06.596337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:06.597472 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fb07d79-b5a2-41f8-8b5a-7d01caef7e33 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1265 microversion: 2.25 time: 0.163691 Sep 14 09:23:06.598046 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 668/1344] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:06 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:06.612618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.612618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.629817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.630605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.630743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.631878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.632037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.632524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.680508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:06.844041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1aaa2b0-9259-4202-bf45-8b83cb2088de tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 204 len: 0 microversion: 2.1 time: 0.243264 Sep 14 09:23:06.844682 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 669/1345] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:06 2022] DELETE /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:06.854785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:06.855503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:06.871807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.872839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.873622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.874832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:06.875478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:06.876556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:06.918783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:07.132006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f07c26c6-5dcd-4f86-909c-273eb58a5e95 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1646 microversion: 2.1 time: 0.284162 Sep 14 09:23:07.132864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 670/1346] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:06 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1646 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:07.138238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.139155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:07.146537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.147300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.147946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.149000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.149612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.150192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.330457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:07.339368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-429534e5-1b53-40f7-b47a-7eca06cb492e tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1669 microversion: 2.1 time: 0.205179 Sep 14 09:23:07.339985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 671/1347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1669 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:07.413820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c75a823-7f78-43a5-9abc-05c327bf8c73 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Action: 'create', calling method: .version_select at 0x7f693f8994c0>, body: {"keypair": {"name": "tempest-keypair-631866811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZBT64j+8nzUXsq0n7FwRd/rrWZDWAa/G1HM1+gqi0N7PxGryGWFJreYo2M+8PtDGx0HTUnGa0b5QlRbz8OOMQw/y6rHaz8Ln9nvOQXFi6qiBU56VNvRdyAdmbb98wQZQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:07.434988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0c75a823-7f78-43a5-9abc-05c327bf8c73 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:07.440982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0c75a823-7f78-43a5-9abc-05c327bf8c73 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for user 4ed917284c6a447c804c33599e1ef8fb and project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:07.468720 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c75a823-7f78-43a5-9abc-05c327bf8c73 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127382 Sep 14 09:23:07.471264 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 672/1348] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:23:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:07.499018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.502538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:07.512337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.513019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.513535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.514359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.515066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.515704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.832047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:07.842378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49f40d9d-d0c7-41dd-9d89-2f31a81ffc48 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 200 len: 1473 microversion: 2.1 time: 0.369971 Sep 14 09:23:07.845849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 673/1349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:07.852145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.865474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.866151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.866770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.867513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.868002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.868580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.896752 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-079c9c0b-940c-4253-a9c4-c6982ead6d8a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.049677 Sep 14 09:23:07.897778 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 674/1350] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:07.910102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.911718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:07.921034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.921771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.922395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.923951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:07.924590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:07.925373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:07.971016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e0a16ab-7353-4d34-b653-2eaa1c278694 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b/ips" status: 200 len: 180 microversion: 2.1 time: 0.071249 Sep 14 09:23:07.972356 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 675/1351] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b/ips => generated 180 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:07.977880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:07.983502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:08.000389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.003754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.006766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.018885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.019670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.020382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.146345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:08.156819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:08.159321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:08.160701 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18b55dee-426d-4990-bcb0-2a77d25f27f5 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 200 len: 1265 microversion: 2.25 time: 0.187085 Sep 14 09:23:08.163296 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 676/1352] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:07 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:08.169247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:08.172414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:08.182603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.183580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.184286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.185306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:08.186070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:08.186766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:08.230099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lazy-loading 'flavor' on Instance uuid e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:08.253994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:23:11.739807 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-988ec45a-0ba6-4239-8501-edba7f5a56af tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9/action" status: 202 len: 0 microversion: 2.1 time: 3.574591 Sep 14 09:23:11.740643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 677/1353] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:23:08 2022] POST /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9/action => generated 0 bytes in 3576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:23:11.746059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:11.747377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:11.774168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.775581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.778501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.779495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:11.780172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:11.783765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:11.870943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:12.077965 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43b8ede7-db6d-4667-8d2c-56bb55264e0c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 204 len: 0 microversion: 2.1 time: 0.335472 Sep 14 09:23:12.078781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 678/1354] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:11 2022] DELETE /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:12.085131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:12.087530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: ec89ed0f-1b9f-44b6-9e70-630b05e30828] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:12.101016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.103546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.104160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.106552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.107213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.112608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.151875 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] HTTP exception thrown: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Request method failure captured: Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 HTTP/1.1 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZyulXZz0oN5_kTVwN_zBFs2DSRXAPSp0IPxh0WSSfJOQIs6VNAyJ9RHxwbATLxUK89cWhCHnX1vTsd5IZ19WxeuQ1oQhaesB-81MW_U41NVvnHbrIphn_oSs_K-mZF1NI1vcsFoSXKdpTES7DnHh1rBJeYC8RNBxl1X00B14bwcYN8 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d5ef9cdd87e4431ea8786e438a1a8061 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d5ef9cdd87e4431ea8786e438a1a8061", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d5ef9cdd87e4431ea8786e438a1a8061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d5ef9cdd87e4431ea8786e438a1a8061"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d5ef9cdd87e4431ea8786e438a1a8061"}]}] Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d5ef9cdd87e4431ea8786e438a1a8061 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListImageFiltersTestJSON-2059211739-project Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 8b93052ba3ce4f8cbecef7added9207e Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListImageFiltersTestJSON-2059211739-project Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ec89ed0f-1b9f-44b6-9e70-630b05e30828'} Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:12.170120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Returning 404 to user: Instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8c1687b-87a1-4905-acc8-b10e35417e2d tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828" status: 404 len: 111 microversion: 2.1 time: 0.091923 Sep 14 09:23:12.179418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 679/1355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:12 2022] GET /compute/v2.1/servers/ec89ed0f-1b9f-44b6-9e70-630b05e30828 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:12.185878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:12.187229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 4e31a44a-3fd4-4994-8b71-ecce712707ce] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:12.195528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:12.208741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.209242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.209692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.210439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.210896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.211321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.250365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] HTTP exception thrown: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Request method failure captured: Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce HTTP/1.1 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvjC3xv7R-I56EPA0VbR4Db12DrZdfBbiZsQhGYj7IMbnHhNv-S2mgo8r_Mucnyd91y1i4TqJY5GHmkRf-q9J8ABNxKUkoOHiz0fEsTLpwiKoVUSZqL4wTjopKN8DGMxYsB1i6mcagQnMiw-rpYMCHj_YIvb6djQ0OFXZAx6caJLxA Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_639c54e3be9d48d983b7e6e83436d107", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/639c54e3be9d48d983b7e6e83436d107"}]}] Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c92c2abda1124946b2adcb0b0560fd0c Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4e31a44a-3fd4-4994-8b71-ecce712707ce'} Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. Sep 14 09:23:12.255776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:12.260325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Returning 404 to user: Instance 4e31a44a-3fd4-4994-8b71-ecce712707ce could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:12.262142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a0c383f-b734-44c6-bf79-f0d9c2b32bcd tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce" status: 404 len: 111 microversion: 2.25 time: 0.085913 Sep 14 09:23:12.265065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 680/1356] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:12 2022] GET /compute/v2.1/servers/4e31a44a-3fd4-4994-8b71-ecce712707ce => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:23:12.271170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec89ed0f-1b9f-44b6-9e70-630b05e30828", "name": "network-vif-deleted", "tag": "56ca66b6-112c-45eb-ab64-a99a64dcf8a1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:12.282293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:12.283012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:12.283656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:12.296144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] Creating event network-vif-deleted:56ca66b6-112c-45eb-ab64-a99a64dcf8a1 for instance ec89ed0f-1b9f-44b6-9e70-630b05e30828 on n-h1-851028-12 Sep 14 09:23:12.301677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-70984f2c-100e-4324-a6ae-d865ae7882a3 req-44d4da58-442c-4f6b-88de-10665c1ef223 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036095 Sep 14 09:23:12.309219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 681/1357] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:12.322666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1301578437", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ff40ae04-298b-4591-93b9-d97d7d36639a"}], "security_groups": [{"name": "tempest-securitygroup--2011554265"}], "key_name": "tempest-keypair-631866811", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:12.561042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] validate_networks() for [('ff40ae04-298b-4591-93b9-d97d7d36639a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:13.482241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:13.491241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for user 4ed917284c6a447c804c33599e1ef8fb and project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:13.516167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:13.516843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:13.524077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:13.524820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:13.525429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:13.537931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.538719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.539323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.540886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.541539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.542155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.566300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:13.572268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Getting quotas for user 4ed917284c6a447c804c33599e1ef8fb and project 5d73f36e32be4ad3b60558414ed6d4a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:13.587936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:13.591165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:13.690910 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94a90922-03aa-44b4-ba33-9a87d0ff18b7 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.382517 Sep 14 09:23:13.692880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 682/1358] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:13.706794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:13.707412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:13.714729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.715274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.715710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:13.716440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:13.716891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:13.717309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.000664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:14.010487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-326434be-f04d-400d-a6be-73f8709022ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.308425 Sep 14 09:23:14.011084 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 683/1359] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:13 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:14.029438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:14.030206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:14.044814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.050677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.051340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.052731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.053328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.054061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.368267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:14.403939 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b35269fc-5a28-48fd-816f-eae1d6d31359 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1675 microversion: 2.1 time: 0.371396 Sep 14 09:23:14.419925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 684/1360] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:14 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1675 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:14.419925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:14.419925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:14.430863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.433662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.434112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.434858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.447112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.447697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.567730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:14.822249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f187f46-e4c2-4895-a27e-5acf3f14b0bd tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 204 len: 0 microversion: 2.1 time: 0.415936 Sep 14 09:23:14.832194 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 685/1361] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:14 2022] DELETE /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:14.837792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:14.838503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:14.868364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.869339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.869946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.870846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:14.871467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:14.872299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:14.931551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:15.035831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:15.057242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90e35a51-aadc-455a-880a-4678510b358e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1281 microversion: 2.1 time: 0.223662 Sep 14 09:23:15.071984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 686/1362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:14 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:15.071984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:15.071984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:15.089668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.090273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.090722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.091451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.091933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.092357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.412160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:15.422193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e512341-e8e0-423f-8ef1-cdee5d963e83 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1473 microversion: 2.1 time: 0.360393 Sep 14 09:23:15.425975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 687/1363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:15 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:15.437284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:15.440261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:15.461066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.461620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.464006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.464564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.465025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.468114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.840382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:15.851569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87cc31cb-110e-49d6-abef-3eb7964ea942 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.424166 Sep 14 09:23:15.853283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 688/1364] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:15 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:15.860622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:15.862351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:15.870106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.888929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.889821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:15.900498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:15.901427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:15.902077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.129400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:16.138445 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e3c90ab-0b20-4479-a14f-67bb9a90999a tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1654 microversion: 2.1 time: 0.283901 Sep 14 09:23:16.140303 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 689/1365] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:15 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1654 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:16.147940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "name": "network-vif-deleted", "tag": "85a319ef-45e9-4ac5-afd0-84b40d92135f"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:16.160724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.161566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.162369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.182121 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] Creating event network-vif-deleted:85a319ef-45e9-4ac5-afd0-84b40d92135f for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:23:16.189148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7f5938d2-589e-4ca4-9f31-225766988535 req-c0f4587d-b8ab-4d12-9601-b16f2eb52fda service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047297 Sep 14 09:23:16.190553 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 690/1366] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:16.248839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65b7004b-e5ec-40f3-8655-9779e8bf0a32 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: .version_select at 0x7f693f8bf700>, body: {"keypair": {"name": "tempest-keypair-149686239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrJ6F7sErQy4Pk6RoQMGyKZCeg7fDxI+Y/zchLeL+Cyj4RooTML/dAnTvmxMLbPTW4atJU9XIeCfDGYxIX45rcO8WZ2Rce3aZRS7qEsAfVbwDov/1FVFWeMLh/ASzQZlg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:16.268524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-65b7004b-e5ec-40f3-8655-9779e8bf0a32 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:16.273535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-65b7004b-e5ec-40f3-8655-9779e8bf0a32 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:16.299007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65b7004b-e5ec-40f3-8655-9779e8bf0a32 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106602 Sep 14 09:23:16.300351 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 691/1367] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:23:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:16.305607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:16.317239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:16.324681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.325301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.326281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.327291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.327850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.328564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.448909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:16.460865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a68b33b-d2c0-4f57-b229-ff518692e1a8 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1281 microversion: 2.1 time: 0.158666 Sep 14 09:23:16.478925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 692/1368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:16 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1281 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:16.497172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:16.498701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:16.527505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.532038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.532216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:16.533265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:16.539148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:16.540676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:17.159639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:17.172568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99199cd6-c826-4fd1-aa77-3a715c1004b2 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1473 microversion: 2.1 time: 0.692321 Sep 14 09:23:17.173165 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 693/1369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:16 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1473 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:17.182058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:17.189963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:17.209229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.209710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.210159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:17.210881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.211337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.211760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:17.516937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:17.526789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2baa5c9c-7d97-44f1-9bac-a78cce834d29 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.351537 Sep 14 09:23:17.533757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 694/1370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:17 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:17.538691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:17.539286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:17.553788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.556215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.557799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:17.558806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:17.559464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:17.561257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.203038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:18.218844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01d7da6c-b563-4523-b91e-ed6963c395f3 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1496 microversion: 2.1 time: 0.683820 Sep 14 09:23:18.243358 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 695/1371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:17 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1496 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:18.265593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:18.266879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:18.282898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.285394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.285886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.286638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.288611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.289069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.495278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:18.515746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2d7cc80-6684-41fa-9cb9-9ea8d884cf93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1335 microversion: 2.1 time: 0.264102 Sep 14 09:23:18.521016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 696/1372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:18 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1335 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:18.535605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "name": "network-vif-unplugged", "status": "completed", "tag": "d026998f-abd6-4429-be45-d32f85852fd2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:18.578788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.579490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.580773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.609708 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] Creating event network-vif-unplugged:d026998f-abd6-4429-be45-d32f85852fd2 for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:23:18.620489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7344a831-3dd4-4109-b8e6-d09b195be449 req-6445a7d3-56b1-4d18-9b7a-55ae9ff7e222 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097765 Sep 14 09:23:18.621513 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 697/1373] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:18.628831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:18.631405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:18.645193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.645975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.646621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.647518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.651830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.652594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.739397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.740792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.741238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.743745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lazy-loading 'fault' on Instance uuid 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:18.856438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b93052ba3ce4f8cbecef7added9207e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ef9cdd87e4431ea8786e438a1a8061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:18.864777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f5c1509-5958-4f65-9928-dae3eb94c7b4 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 200 len: 1307 microversion: 2.1 time: 0.241745 Sep 14 09:23:18.868826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 698/1374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:18 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:18.879296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9", "name": "network-vif-unplugged", "status": "completed", "tag": "224a52f7-20e7-4342-be9f-f5cfa2c2f723"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:18.902565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.903022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.905240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.932143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] Creating event network-vif-unplugged:224a52f7-20e7-4342-be9f-f5cfa2c2f723 for instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 on n-h1-851028-12 Sep 14 09:23:18.938148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3901b5c7-91b8-4a53-ad32-3178de8bd50d req-5394fca3-f9b5-4a4f-bb2c-d605270cc1df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067590 Sep 14 09:23:18.940442 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 699/1375] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:18.946887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9", "name": "network-vif-deleted", "tag": "54a08a86-2881-4c06-a61d-4db4c9cd4f1a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:18.961173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:18.965153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:18.965791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:18.988140 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] Creating event network-vif-deleted:54a08a86-2881-4c06-a61d-4db4c9cd4f1a for instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 on n-h2-851028-12 Sep 14 09:23:18.994069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6cd1aee7-bb45-4ef8-b4a5-adf3ca8415a9 req-84a0c316-8941-45ed-976f-6ba37d4a3910 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052038 Sep 14 09:23:18.995319 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 700/1376] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:19.002369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:19.003760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:19.012071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.012957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.014095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.015355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.016130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.016765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.577544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:19.592653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fa05acc-1330-4834-8d30-942d70b81738 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.595884 Sep 14 09:23:19.604086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 701/1377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:18 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:19.604086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:19.604086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:19.656724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.657433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.658666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.659610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.660300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.660933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.709545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.712369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.713121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.713971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lazy-loading 'fault' on Instance uuid 5dda4117-a400-4bb1-b5df-2c567992a38b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:19.862792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '374349250ea545b8936dff89d329be60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '421a08fa24cf4b89abc73bc3770d6a40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:19.873417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-582ada2c-e93f-4f8b-ae7c-05e004313dd7 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 200 len: 1302 microversion: 2.1 time: 0.277584 Sep 14 09:23:19.889859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 702/1378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:19 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 1302 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:19.889859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:19.889859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:19.902042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.902583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.903832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.904872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:19.905292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:19.905756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:19.941916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:20.148393 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44547578-2228-4dad-b34d-6925b0410ff4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 204 len: 0 microversion: 2.25 time: 0.263774 Sep 14 09:23:20.149352 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 703/1379] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:23:19 2022] DELETE /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:23:20.161773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:20.162577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:20.177227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.178630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.179726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.180984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.183303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.184119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.228058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:20.497596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:20.507113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf53ccc3-b7bb-41a1-a1ba-773baddfbf15 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1403 microversion: 2.1 time: 0.356056 Sep 14 09:23:20.511372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 704/1380] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:20 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1403 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:20.528912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:20.529715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] [instance: 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:20.538990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:20.559477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.560232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.560590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.561341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.561828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.562252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.624098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] HTTP exception thrown: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Request method failure captured: Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 HTTP/1.1 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZyulXZz0oN5_kTVwN_zBFs2DSRXAPSp0IPxh0WSSfJOQIs6VNAyJ9RHxwbATLxUK89cWhCHnX1vTsd5IZ19WxeuQ1oQhaesB-81MW_U41NVvnHbrIphn_oSs_K-mZF1NI1vcsFoSXKdpTES7DnHh1rBJeYC8RNBxl1X00B14bwcYN8 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d5ef9cdd87e4431ea8786e438a1a8061 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d5ef9cdd87e4431ea8786e438a1a8061", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d5ef9cdd87e4431ea8786e438a1a8061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d5ef9cdd87e4431ea8786e438a1a8061"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d5ef9cdd87e4431ea8786e438a1a8061"}]}] Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d5ef9cdd87e4431ea8786e438a1a8061 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2059211739 Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListImageFiltersTestJSON-2059211739-project Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 8b93052ba3ce4f8cbecef7added9207e Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListImageFiltersTestJSON-2059211739-project Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9'} Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:20.628292 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:20.633561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Returning 404 to user: Instance 1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:20.634774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88738cd7-3282-4a37-916a-00a4b0220079 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9" status: 404 len: 111 microversion: 2.1 time: 0.121124 Sep 14 09:23:20.636446 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 705/1381] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:20 2022] GET /compute/v2.1/servers/1f4a19e8-1202-4d2b-bac3-fe2e0e35e5d9 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:20.647941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:20.647941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:20.660805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.662075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.662669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.663338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.667788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.668275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.957071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:20.966849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:20.968330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:20.969506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0306b8ed-f00c-46b1-af13-6acfeab4a1de tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1731 microversion: 2.25 time: 0.329486 Sep 14 09:23:20.971003 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 706/1382] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:20 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:20.976146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:20.977380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:20.984597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.985605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.986832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:20.987503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:20.987976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:20.988397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.264111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:21.275869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd331531-12f1-41e8-a76e-2a61acc3ea07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.303588 Sep 14 09:23:21.287718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 707/1383] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:20 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:21.287718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-666a75ad-cde2-4ea3-86eb-9469bf83702e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f80cd30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:21.709990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-666a75ad-cde2-4ea3-86eb-9469bf83702e tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677" status: 204 len: 0 microversion: 2.1 time: 0.431826 Sep 14 09:23:21.711925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 708/1384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:21 2022] DELETE /compute/v2.1/images/59b7f843-581f-4cdf-9b85-8922bec8c677 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:21.717926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:21.718541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:21.726385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.726898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.727426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.730333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.731060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.731809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.752349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b HTTP/1.1 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5dda4117-a400-4bb1-b5df-2c567992a38b'} Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:21.754969 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:21.759597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:21.762272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:21.764617 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdd5fb88-74ae-45d2-ab3f-5d76af69080c tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 404 len: 111 microversion: 2.1 time: 0.052651 Sep 14 09:23:21.769269 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 709/1385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:21 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:21.777718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dda4117-a400-4bb1-b5df-2c567992a38b", "name": "network-vif-deleted", "tag": "d026998f-abd6-4429-be45-d32f85852fd2"}, {"name": "network-changed", "server_uuid": "e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9", "tag": "224a52f7-20e7-4342-be9f-f5cfa2c2f723"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:21.788895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.795504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.796180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.811516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Creating event network-vif-deleted:d026998f-abd6-4429-be45-d32f85852fd2 for instance 5dda4117-a400-4bb1-b5df-2c567992a38b on n-h2-851028-12 Sep 14 09:23:21.812061 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] Creating event network-changed:224a52f7-20e7-4342-be9f-f5cfa2c2f723 for instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 on n-h1-851028-12 Sep 14 09:23:21.821528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-04ff93ad-5483-499a-9fd7-8c6f568796b8 req-35ff7b70-90e3-48e1-91e1-29e364581675 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050686 Sep 14 09:23:21.823250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 710/1386] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:21.828367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e584a2f-6232-4eba-be41-39a4c8513dbd", "tag": "1653c64c-3b0b-4425-8b00-c402c0e2f26d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:21.839216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.839676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.840142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.852280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] Creating event network-changed:1653c64c-3b0b-4425-8b00-c402c0e2f26d for instance 0e584a2f-6232-4eba-be41-39a4c8513dbd on n-h2-851028-12 Sep 14 09:23:21.857364 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-75a55b81-0dde-4a9d-8070-7834e5357653 req-171c97f6-5c0a-4e7a-9a43-881914d31daa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032958 Sep 14 09:23:21.858035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 711/1387] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:21.863881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:21.864811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:21.872682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.872682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.872682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:21.873117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:21.873285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:21.873711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:22.223548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:22.232868 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c04f2fc8-c64a-4d3f-b5f7-89ca89a10aeb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1403 microversion: 2.1 time: 0.373402 Sep 14 09:23:22.233462 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 712/1388] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:21 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1403 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:22.243478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b81adf95-c4e2-4687-8d43-0d7469ea88d8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693fa75040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:22.609897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b81adf95-c4e2-4687-8d43-0d7469ea88d8 tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0" status: 204 len: 0 microversion: 2.1 time: 0.375000 Sep 14 09:23:22.614461 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 713/1389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:22 2022] DELETE /compute/v2.1/images/b7e56706-6284-4ebe-81f7-6019500c9ae0 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:22.620270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1740705184", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a04cbd6c-4f78-440b-8f5b-69cafd708616"}], "security_groups": [{"name": "tempest-securitygroup--671121179"}], "key_name": "tempest-keypair-149686239", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:22.807460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] validate_networks() for [('a04cbd6c-4f78-440b-8f5b-69cafd708616', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:23.290271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:23.290828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:23.291570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:23.292320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:23.292871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:23.302543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.303360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.303710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.305064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.305696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.306127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.335172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:23.341092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:23.354387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:23.356820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:23.411650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3910e88-9329-46a7-9c7f-d58dc1ec9924 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.795926 Sep 14 09:23:23.412357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 714/1390] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:23.417356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:23.418215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:23.425275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.425999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.426752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.427641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.428413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.428999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.676412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.686622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.690582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:23.700113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-accf7afa-99e9-4ccb-aa11-2f9a785839af tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 200 len: 1664 microversion: 2.25 time: 0.286287 Sep 14 09:23:23.705257 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 715/1391] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:23 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 1664 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:23.712558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:23.713181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:23.720567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.720991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.721584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:23.722388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:23.722743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:23.723348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:24.370437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:24.382454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b83058c-b1bb-4c82-a547-b5544a95123e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.676193 Sep 14 09:23:24.396146 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 716/1392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:23 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:24.396146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be41b6b0-ab55-4c9c-aa52-ed04121be7ef tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] Calling method '.version_select at 0x7f693f80cb80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:24.710356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be41b6b0-ab55-4c9c-aa52-ed04121be7ef tempest-ListImageFiltersTestJSON-2059211739 tempest-ListImageFiltersTestJSON-2059211739-project] 10.222.0.90 "DELETE /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121" status: 204 len: 0 microversion: 2.1 time: 0.321528 Sep 14 09:23:24.711008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 717/1393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:24 2022] DELETE /compute/v2.1/images/03ffd9c3-9999-4636-a6c8-22edbf079121 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:23:24.716341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:24.717186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:24.725265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:24.726273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:24.727147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:24.728206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:24.728910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:24.729532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.091994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.101574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de6aed01-f312-48ad-b3c8-6aefe98fe96c tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1403 microversion: 2.1 time: 0.389348 Sep 14 09:23:25.112670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 718/1394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:24 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1403 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:25.133048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.135630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.144105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.144713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.145208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.146144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.147350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.148034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.276824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.310109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be96297a-4acf-473d-85ce-dcb0d09c8599 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1293 microversion: 2.1 time: 0.195287 Sep 14 09:23:25.310979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 719/1395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:25.324994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5", "name": "network-vif-deleted", "tag": "96d1da6e-5da7-4421-b811-3e6e2387fb93"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:25.344108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.345021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.348100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.365298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] Creating event network-vif-deleted:96d1da6e-5da7-4421-b811-3e6e2387fb93 for instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 on n-h2-851028-12 Sep 14 09:23:25.373357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d45640f3-4cad-4fa9-b8d5-7d4139b17ffd req-e1f2ef97-a1ec-45db-8328-e7ac8ed26a0b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059725 Sep 14 09:23:25.375678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 720/1396] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:25.382227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.383438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.392886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.393808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.394433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.395332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.396132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.396724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.413200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] HTTP exception thrown: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Request method failure captured: Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 HTTP/1.1 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvjC3xv7R-I56EPA0VbR4Db12DrZdfBbiZsQhGYj7IMbnHhNv-S2mgo8r_Mucnyd91y1i4TqJY5GHmkRf-q9J8ABNxKUkoOHiz0fEsTLpwiKoVUSZqL4wTjopKN8DGMxYsB1i6mcagQnMiw-rpYMCHj_YIvb6djQ0OFXZAx6caJLxA Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_639c54e3be9d48d983b7e6e83436d107", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/639c54e3be9d48d983b7e6e83436d107"}]}] Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c92c2abda1124946b2adcb0b0560fd0c Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5'} Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. Sep 14 09:23:25.415170 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. Sep 14 09:23:25.420458 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.422972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Returning 404 to user: Instance f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:25.424229 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23fb3799-da9f-4d8e-81cc-b44ca42a813c tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5" status: 404 len: 111 microversion: 2.25 time: 0.047300 Sep 14 09:23:25.424961 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 721/1397] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/f3c84850-d7bf-4a2d-b5b4-e7a60e63f6b5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:23:25.438331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.441069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.472098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.472614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.473058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.473831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.474361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.474779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.495489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b HTTP/1.1 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5dda4117-a400-4bb1-b5df-2c567992a38b'} Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:25.498157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-188bdd9c-5353-4cd0-a376-ffd70d43f931 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 404 len: 111 microversion: 2.1 time: 0.073524 Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 722/1398] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:25 2022] DELETE /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.505902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.511848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.512373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.512807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.513504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.514138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.514732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.750149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:25.758590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01d722a9-e822-441f-9956-8049f6742764 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.257318 Sep 14 09:23:25.759059 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 723/1399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:25.763910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5ee1f24-508c-4639-af16-a0c2f9e7358f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '.version_select at 0x7f693fa75280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.789006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5ee1f24-508c-4639-af16-a0c2f9e7358f tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-928735375" status: 204 len: 0 microversion: 2.25 time: 0.028606 Sep 14 09:23:25.793605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 724/1400] 10.222.0.90 () {60 vars in 1259 bytes} [Wed Sep 14 09:23:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-928735375 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:23:25.801441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.802563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: 5dda4117-a400-4bb1-b5df-2c567992a38b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.810279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.811110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.811744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.812718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.813941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.816487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.835831 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b HTTP/1.1 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5dda4117-a400-4bb1-b5df-2c567992a38b'} Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.838407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. Sep 14 09:23:25.848199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.850302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance 5dda4117-a400-4bb1-b5df-2c567992a38b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:25.851395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-785fad12-c773-454a-8ac3-4506dd92b863 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b" status: 404 len: 111 microversion: 2.1 time: 0.056511 Sep 14 09:23:25.852214 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 725/1401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/5dda4117-a400-4bb1-b5df-2c567992a38b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:25.860437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.863248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.873025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.873836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.874344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.875779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.876524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.877547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.898824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 HTTP/1.1 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'be720a80-1a22-466a-8619-d16bd58f5ac2'} Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:25.901478 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.905985 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.907679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:25.909632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59525bfd-1e47-4f55-a43e-6d36c9b77648 tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "DELETE /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 404 len: 111 microversion: 2.1 time: 0.053120 Sep 14 09:23:25.911586 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 726/1402] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:23:25 2022] DELETE /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:23:25.921384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:25.922253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] [instance: be720a80-1a22-466a-8619-d16bd58f5ac2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:25.930061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.930863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.931567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.932540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:25.933157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:25.933820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:25.953666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] HTTP exception thrown: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Request method failure captured: Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 HTTP/1.1 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZzdIFwa8GXAIs3pWeKhQaQK3cox_MIFpm0OeN3Gs8rOxGBsFIWnu8hdHcZYJpKBI9IXKzJmvfoYboVlljt-myGuq98uhBvj-FJOQMcqKUx_mwlKyhgHbChEt1RUt4BWkxZQcQVkv9ilpDFk2BSgORFL_o-MbuxazBZbLLN1rBl1i0U Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_421a08fa24cf4b89abc73bc3770d6a40", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/421a08fa24cf4b89abc73bc3770d6a40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/421a08fa24cf4b89abc73bc3770d6a40"}]}] Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 421a08fa24cf4b89abc73bc3770d6a40 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestMultiNic-2137992186 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 374349250ea545b8936dff89d329be60 Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestMultiNic-2137992186-project Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'be720a80-1a22-466a-8619-d16bd58f5ac2'} Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:25.956629 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] Returning 404 to user: Instance be720a80-1a22-466a-8619-d16bd58f5ac2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47af5389-5f11-4230-b9a0-69aa4f77a3bc tempest-ServersTestMultiNic-2137992186 tempest-ServersTestMultiNic-2137992186-project] 10.222.0.90 "GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2" status: 404 len: 111 microversion: 2.1 time: 0.045006 Sep 14 09:23:25.963384 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 727/1403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:25 2022] GET /compute/v2.1/servers/be720a80-1a22-466a-8619-d16bd58f5ac2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:23:26.128315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.129016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.140571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.141062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.144834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.145747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.147252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.149790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.604792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:26.614433 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a0a51c5-c1fe-4a7a-95d7-700e2d8864a5 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1403 microversion: 2.1 time: 0.491341 Sep 14 09:23:26.615107 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 728/1404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1403 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:26.621896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.623390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.633945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.634823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.635488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.637084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.638409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.639331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.811203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:26.822189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16546e70-5811-4bfc-90ae-873bfbd2a6c1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1299 microversion: 2.1 time: 0.205828 Sep 14 09:23:26.822780 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 729/1405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:26.827706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:26.828343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:26.835775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.836534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.838377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:26.839358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:26.840057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:26.840704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.208928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:27.233826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-296e24fc-72ba-4806-ada0-2773a4c7c286 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1503 microversion: 2.1 time: 0.407642 Sep 14 09:23:27.237786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 730/1406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:26 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:27.565602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e584a2f-6232-4eba-be41-39a4c8513dbd", "name": "network-vif-plugged", "status": "completed", "tag": "1653c64c-3b0b-4425-8b00-c402c0e2f26d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:27.591810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.592420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.593066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.609160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] Creating event network-vif-plugged:1653c64c-3b0b-4425-8b00-c402c0e2f26d for instance 0e584a2f-6232-4eba-be41-39a4c8513dbd on n-h2-851028-12 Sep 14 09:23:27.615588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-45192b11-73fc-48c0-9d30-87f3689fe1e1 req-4a299a1b-a394-4257-96b3-8f7fc4785111 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061210 Sep 14 09:23:27.616587 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 731/1407] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:23:27.625909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:27.637255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:27.653520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.655947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.657208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.659087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.659575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.660608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.701289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:27.719285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:27.804352 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8bb14fe-5782-47e5-8746-2a8789401632 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 204 len: 0 microversion: 2.25 time: 0.185299 Sep 14 09:23:27.811739 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 732/1408] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:23:27 2022] DELETE /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:23:27.819701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:27.822136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:27.832652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.833805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.834510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:27.835417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:27.836149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:27.837630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.099560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:28.115851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b18c3308-2cef-4778-be79-e7db5b8bef4b tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1403 microversion: 2.1 time: 0.302510 Sep 14 09:23:28.128775 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 733/1409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:27 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1403 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:28.128775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:28.128775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:28.137782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.138374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.138924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.139889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.140447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.140935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.392321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:28.411214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:28.413831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:28.419250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3b48114-fdb2-463a-a8dc-d86d26a5dee4 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1548 microversion: 2.25 time: 0.297899 Sep 14 09:23:28.423042 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 734/1410] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:28 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1548 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:28.442229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:28.443039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:28.449562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.450120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.450810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.451793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.452375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.452988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.884429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:28.904625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a984d94-affd-46ec-8dc4-4d55bb44a6e9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1366 microversion: 2.1 time: 0.479766 Sep 14 09:23:28.906804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 735/1411] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:28 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:28.928322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:28.933550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:28.980718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.982179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.983240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:28.988528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:28.989261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:28.989968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.643097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:29.651998 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-476299d9-49c1-441a-9238-9aa71bbf6ed2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1493 microversion: 2.1 time: 0.743942 Sep 14 09:23:29.664743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 736/1412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:28 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1493 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:29.679036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:29.679978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:29.686786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.687554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.688197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:29.689151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:29.690521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:29.691199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.472657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.485370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aad9fb76-fbd1-4f38-8941-4946ae27fc81 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1591 microversion: 2.1 time: 0.819157 Sep 14 09:23:30.494138 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 737/1413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:29 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1591 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:30.541244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2949a7-438a-435e-a3f8-154fb1188e15", "tag": "b6f43238-7709-40fe-b032-eba759bab473"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:30.563403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.563935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.567265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.600340 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] Creating event network-changed:b6f43238-7709-40fe-b032-eba759bab473 for instance 6f2949a7-438a-435e-a3f8-154fb1188e15 on n-h2-851028-12 Sep 14 09:23:30.619651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-895766e8-97ad-488f-8bd3-70ad7ab76df9 req-ab3a2804-a790-417c-9a08-f824989cab7a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098825 Sep 14 09:23:30.625549 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 738/1414] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:30.637866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:30.638864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:30.651822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.652607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.653260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.655182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.680708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.681181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.775874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.777089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.777860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.778618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lazy-loading 'fault' on Instance uuid c6fc6b01-f21f-416b-b181-0fbde2328d3c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:30.867923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.896095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.902215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c92c2abda1124946b2adcb0b0560fd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c54e3be9d48d983b7e6e83436d107', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:30.904547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d326c72-272c-40df-a426-38a5cba2fd34 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 200 len: 1351 microversion: 2.25 time: 0.276604 Sep 14 09:23:30.906328 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 739/1415] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:30 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 1351 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:23:30.938174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-917743bc-f1c0-4035-9f94-2fa44f1ff33a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '.version_select at 0x7f693f871040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:30.958716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917743bc-f1c0-4035-9f94-2fa44f1ff33a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:30.959404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917743bc-f1c0-4035-9f94-2fa44f1ff33a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:30.960194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917743bc-f1c0-4035-9f94-2fa44f1ff33a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:30.971032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-917743bc-f1c0-4035-9f94-2fa44f1ff33a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 1180 microversion: 2.1 time: 0.043085 Sep 14 09:23:30.972262 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 740/1416] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:23:30 2022] GET /compute/v2.1/os-migrations => generated 1180 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:30.997337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:30.998706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:31.008828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.009745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.010748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.012029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.014833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.017789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.491673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:31.507986 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e219a580-9761-4f39-9d52-a5d0d785bb37 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1366 microversion: 2.1 time: 0.534205 Sep 14 09:23:31.532758 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 741/1417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:30 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:31.545451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fc6b01-f21f-416b-b181-0fbde2328d3c", "name": "network-vif-deleted", "tag": "e7762d66-8887-45f8-8da3-b517f6778654"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:31.574493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.575163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.575711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.603509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] Creating event network-vif-deleted:e7762d66-8887-45f8-8da3-b517f6778654 for instance c6fc6b01-f21f-416b-b181-0fbde2328d3c on n-h1-851028-12 Sep 14 09:23:31.616788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-318886b1-c0de-44ad-9dec-1abce3ac040a req-17291117-9b6b-4941-804e-c24dc9714ce9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081517 Sep 14 09:23:31.618461 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 742/1418] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:31.627334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:31.628387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:31.636909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.637693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.638505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.639810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.640847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.641785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.918342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3a7a1d2-3dcb-4ba4-8bd7-ebc1bbaa62b9 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.296818 Sep 14 09:23:31.919175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 743/1419] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:23:31 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd/os-interface => generated 285 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:31.929860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:31.933679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:31.950681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.952485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.953663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:31.955453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:31.958511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:31.959163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.332565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c81b901-e9cc-40c9-90c5-61cb7eb44f2d tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1646 microversion: 2.1 time: 0.410935 Sep 14 09:23:32.334393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 744/1420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:31 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1646 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:32.348755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:32.349766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: c6fc6b01-f21f-416b-b181-0fbde2328d3c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:32.383929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.399969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.401322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.403830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.409762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.414908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.513308 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] HTTP exception thrown: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Request method failure captured: Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c HTTP/1.1 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvjC3xv7R-I56EPA0VbR4Db12DrZdfBbiZsQhGYj7IMbnHhNv-S2mgo8r_Mucnyd91y1i4TqJY5GHmkRf-q9J8ABNxKUkoOHiz0fEsTLpwiKoVUSZqL4wTjopKN8DGMxYsB1i6mcagQnMiw-rpYMCHj_YIvb6djQ0OFXZAx6caJLxA Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_639c54e3be9d48d983b7e6e83436d107", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/639c54e3be9d48d983b7e6e83436d107"}]}] Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c92c2abda1124946b2adcb0b0560fd0c Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'c6fc6b01-f21f-416b-b181-0fbde2328d3c'} Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. Sep 14 09:23:32.526305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:32.531412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Returning 404 to user: Instance c6fc6b01-f21f-416b-b181-0fbde2328d3c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:32.535740 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2c5d487-cbfe-4c63-af4a-e49ba9031fb8 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c" status: 404 len: 111 microversion: 2.25 time: 0.199238 Sep 14 09:23:32.537316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 745/1421] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:32 2022] GET /compute/v2.1/servers/c6fc6b01-f21f-416b-b181-0fbde2328d3c => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:23:32.545001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:32.547097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:32.551087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:32.573988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.574813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.575438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.577110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.579415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.581423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.655840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:23:32.875534 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-642a0ba6-b182-45c5-ae56-cef8a5fb3ee0 tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 204 len: 0 microversion: 2.25 time: 0.334034 Sep 14 09:23:32.880173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 746/1422] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:23:32 2022] DELETE /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:23:32.888541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:32.889302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:32.920079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.926367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.927294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:32.928693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:32.929397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:32.930084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:33.320544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:33.350016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=24 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:33.358484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:33.370508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42fb3c7f-cd59-4856-b064-c2a63ae3ef0b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1366 microversion: 2.1 time: 0.488955 Sep 14 09:23:33.374706 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 747/1423] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:32 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1366 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:33.392725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2095968501", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:33.523226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] validate_networks() for [('d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:35.412912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:35.413754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:35.414284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:35.415686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:35.416364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:35.430959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.431942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.432589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.433560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.435746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.436552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.495869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:35.511055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for user acf0e1a651e34682923f8eb74872adb1 and project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:35.534564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:35.538222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:35.618558 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84006692-6167-40a2-91da-d48f0790ce8a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.242541 Sep 14 09:23:35.619559 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 748/1424] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:35.625507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:35.626523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] [instance: 2e511a14-5958-4459-b9ce-fef73682e888] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:35.641235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.641851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.643654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.645062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.646018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.646721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.666760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] HTTP exception thrown: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Request method failure captured: Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 HTTP/1.1 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZvjC3xv7R-I56EPA0VbR4Db12DrZdfBbiZsQhGYj7IMbnHhNv-S2mgo8r_Mucnyd91y1i4TqJY5GHmkRf-q9J8ABNxKUkoOHiz0fEsTLpwiKoVUSZqL4wTjopKN8DGMxYsB1i6mcagQnMiw-rpYMCHj_YIvb6djQ0OFXZAx6caJLxA Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.25 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_639c54e3be9d48d983b7e6e83436d107", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/639c54e3be9d48d983b7e6e83436d107"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/639c54e3be9d48d983b7e6e83436d107"}]}] Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 639c54e3be9d48d983b7e6e83436d107 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-108768742 Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c92c2abda1124946b2adcb0b0560fd0c Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-108768742-project Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2e511a14-5958-4459-b9ce-fef73682e888'} Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. Sep 14 09:23:35.669354 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. Sep 14 09:23:35.675044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:35.678976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] Returning 404 to user: Instance 2e511a14-5958-4459-b9ce-fef73682e888 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:35.681427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-989a7dce-f81a-4781-8488-7c7a9e13e67a tempest-LiveAutoBlockMigrationV225Test-108768742 tempest-LiveAutoBlockMigrationV225Test-108768742-project] 10.222.0.90 "GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888" status: 404 len: 111 microversion: 2.25 time: 0.059282 Sep 14 09:23:35.683003 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 749/1425] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:23:35 2022] GET /compute/v2.1/servers/2e511a14-5958-4459-b9ce-fef73682e888 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:23:35.691377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be9c562f-7353-4397-965d-07df36f0ecc5"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:35.694117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:35.704162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.705634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.707625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.709070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:35.709876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:35.710465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:35.742450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:36.243750 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e095c34-168d-4edd-aded-2052d5340529 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "POST /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.558443 Sep 14 09:23:36.246963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 750/1426] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:23:35 2022] POST /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:36.289214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e511a14-5958-4459-b9ce-fef73682e888", "name": "network-vif-deleted", "tag": "32931be0-7f56-4e3a-bd97-cb563ad853a6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:36.339247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:36.340429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:36.341404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:36.394668 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] Creating event network-vif-deleted:32931be0-7f56-4e3a-bd97-cb563ad853a6 for instance 2e511a14-5958-4459-b9ce-fef73682e888 on n-h2-851028-12 Sep 14 09:23:36.403346 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cae38e78-a142-41e8-b959-2dc229ffc012 req-35c68e5a-609e-463e-a5df-cf5be4ca4a9b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152887 Sep 14 09:23:36.405377 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 751/1427] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:36.418513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:36.431437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:36.452469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:36.453434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:36.454421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:36.456013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:36.457501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:36.458422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:37.324660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:37.344673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1b2c1f2-7eee-47ec-a561-636c1cca851c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1366 microversion: 2.1 time: 0.931340 Sep 14 09:23:37.348312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 752/1428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:36 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1366 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:37.365052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2949a7-438a-435e-a3f8-154fb1188e15", "name": "network-vif-plugged", "status": "completed", "tag": "b6f43238-7709-40fe-b032-eba759bab473"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:37.395567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:37.398324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:37.399842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:37.422285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] Creating event network-vif-plugged:b6f43238-7709-40fe-b032-eba759bab473 for instance 6f2949a7-438a-435e-a3f8-154fb1188e15 on n-h2-851028-12 Sep 14 09:23:37.430844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c385dde1-2c5c-4c1c-b1a3-382c8fa1735a req-16c3c0eb-b5e3-47a4-a646-5061dd9617fb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081065 Sep 14 09:23:37.432135 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 753/1429] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:37.438382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:37.439720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:37.453703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:37.472335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:37.475612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:37.481491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:37.482478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:37.483162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.181651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:38.197155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-167b7029-faec-4f6b-9bf3-da2663a1d601 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1591 microversion: 2.1 time: 0.762921 Sep 14 09:23:38.203776 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 754/1430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:37 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1591 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:38.213940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:38.222163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:38.238145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.238968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.239573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.241593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.242274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.243387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.477222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:38.492066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48f2730f-377d-4bfc-9416-56e39ad1200b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1269 microversion: 2.1 time: 0.286425 Sep 14 09:23:38.495673 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 755/1431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:38 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:38.507378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e584a2f-6232-4eba-be41-39a4c8513dbd", "tag": "1653c64c-3b0b-4425-8b00-c402c0e2f26d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:38.540137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.545966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.548121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.580733 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] Creating event network-changed:1653c64c-3b0b-4425-8b00-c402c0e2f26d for instance 0e584a2f-6232-4eba-be41-39a4c8513dbd on n-h2-851028-12 Sep 14 09:23:38.591268 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-53950aa5-a69d-4591-b92c-a08c06374167 req-48e43013-93d3-431a-a07c-cd81f841f69f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093771 Sep 14 09:23:38.596330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 756/1432] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:38.607578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:38.613874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:38.628290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.634546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.635481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:38.662648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:38.667529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:38.667529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:39.508699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:39.528575 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cac05b1-80fc-4190-9839-83b3d4cae90a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1366 microversion: 2.1 time: 0.930676 Sep 14 09:23:39.529522 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 757/1433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:38 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1366 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:39.535482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:39.537123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:39.555699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:39.556595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:39.557390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:39.557995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:39.558681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:39.559310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:40.024885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:40.044965 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5793ebd1-3610-45f4-9921-f5bb33cb0c56 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.514110 Sep 14 09:23:40.046272 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 758/1434] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:39 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:40.501171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Calling method '.version_select at 0x7f693f744820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:40.568223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:23:40.568932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Neutron security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:23:40.569557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] HTTP exception thrown: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.569557 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Request method failure captured: Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/75d7ef81-917d-4fda-a83d-5a80f5c2178c HTTP/1.1 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2cFrPlGpG2eLUR1xTDoAdPAd_eeHSbAVoKoIZai6NHw_WkSs13-E-910B1CHi4BpViDbX5RIfnRFHae42eUXWazt4699OI17LCI0Yy39ye9mS9Q5Y-ysUbhIOa8k9pM_t_4sSKK-SkzSslEiGAUjNHmSO69nuQZ-8mK60neR3oHhA Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_31c3afdfbc4b4fb597b2a0a37755ba4d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}] Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1e3982d4624d45bab581b97aa4316faa Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '75d7ef81-917d-4fda-a83d-5a80f5c2178c'} Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:23:40.571660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Returning 404 to user: Security group 75d7ef81-917d-4fda-a83d-5a80f5c2178c does not exist Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-8fc759ca-b2eb-4c47-a4fd-bd226e99fdd1'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53e3298b-7a31-4cae-bf44-8aa5ff8d73e8 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/75d7ef81-917d-4fda-a83d-5a80f5c2178c" status: 404 len: 194 microversion: 2.1 time: 0.393631 Sep 14 09:23:40.576880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 759/1435] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:23:40 2022] DELETE /compute/v2.1/os-security-groups/75d7ef81-917d-4fda-a83d-5a80f5c2178c => generated 194 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:40.582224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:40.582344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:40.603382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:40.603879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:40.604344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:40.605065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:40.605521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:40.605957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:41.612906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:41.627747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-669c16cf-30e8-4e8d-beb7-de4c2238055f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1556 microversion: 2.1 time: 1.049628 Sep 14 09:23:41.645460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 760/1436] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:40 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1556 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:41.659543 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cc9be3c-6329-4b0c-a411-a8b44e260e43 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012849 Sep 14 09:23:41.666187 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 761/1437] 10.222.0.90 () {58 vars in 1164 bytes} [Wed Sep 14 09:23:41 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:23:41.678706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:41.684935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:41.704756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:41.705612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:41.706573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:41.707504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:41.708144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:41.708751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:42.003220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:42.020113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6dcca7cd-729f-4628-a556-5352fa381cbd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.352136 Sep 14 09:23:42.022801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 762/1438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:41 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:42.040311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:42.041145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:42.055797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:42.057541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:42.058756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:42.060241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:42.061851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:42.063136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:42.535216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac4b14c4-8009-4adf-b2c9-03060a95e7fb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.511273 Sep 14 09:23:42.536434 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 763/1439] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:23:42 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-interface => generated 284 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:42.541168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-306dc5f6-7949-44b1-9864-d020aee307a4 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Calling method '.version_select at 0x7f693f79ed30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:43.511142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-306dc5f6-7949-44b1-9864-d020aee307a4 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.973297 Sep 14 09:23:43.512677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 764/1440] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:23:42 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:43.517632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:43.518248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:43.533546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:43.534060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:43.534507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:43.535236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:43.535694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:43.541919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:44.328910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:44.342488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3775f02a-ff71-4af4-805a-c00a931eb211 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.826940 Sep 14 09:23:44.344945 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 765/1441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:43 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:44.357768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49a8a67-e1eb-4c51-a859-6c2708bdaf7b", "tag": "4732d1fe-9f69-44d5-a8ec-54ae09320d5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:44.379668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:44.381139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:44.383006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:44.410789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] Creating event network-changed:4732d1fe-9f69-44d5-a8ec-54ae09320d5e for instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b on n-h1-851028-12 Sep 14 09:23:44.421839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-bd49abee-3fdb-4a19-ac4a-9e529a058b4b req-9fa73004-bedc-4dda-a45f-254a134a1058 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075291 Sep 14 09:23:44.428617 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 766/1442] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:44.433937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Calling method '.version_select at 0x7f693f744820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:45.477378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:45.516925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:23:45.517979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 14 09:23:45.517979 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Request method failure captured: Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/d39bae10-450b-4d84-898b-cf4f6933137b HTTP/1.1 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2cFrPlGpG2eLUR1xTDoAdPAd_eeHSbAVoKoIZai6NHw_WkSs13-E-910B1CHi4BpViDbX5RIfnRFHae42eUXWazt4699OI17LCI0Yy39ye9mS9Q5Y-ysUbhIOa8k9pM_t_4sSKK-SkzSslEiGAUjNHmSO69nuQZ-8mK60neR3oHhA Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_31c3afdfbc4b4fb597b2a0a37755ba4d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}] Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1e3982d4624d45bab581b97aa4316faa Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: exception: Insufficient rights for removing default security group. Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd39bae10-450b-4d84-898b-cf4f6933137b'} Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:23:45.519939 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-1c069c62-36df-402e-8009-522e68de76e4'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0daee25-b8fc-41da-9fd4-bdc10c75fe67 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/d39bae10-450b-4d84-898b-cf4f6933137b" status: 400 len: 182 microversion: 2.1 time: 1.091961 Sep 14 09:23:45.530021 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 767/1443] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:23:44 2022] DELETE /compute/v2.1/os-security-groups/d39bae10-450b-4d84-898b-cf4f6933137b => generated 182 bytes in 1100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:23:45.537899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:45.537899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:45.537899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:45.548448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:45.549468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:45.551162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:45.551162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:45.551162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:45.551522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:46.130972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:46.150656 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48ac6eef-cecb-40d2-b95c-809fc38db4f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.620574 Sep 14 09:23:46.170424 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 768/1444] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:45 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:46.189495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Calling method '.version_select at 0x7f693f75e040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:46.241206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:23:46.242226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Neutron security group e905e71c-cecd-4b8e-b28c-1bd890dea631 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:23:46.242909 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] HTTP exception thrown: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.242909 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Request method failure captured: Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-security-groups/e905e71c-cecd-4b8e-b28c-1bd890dea631 HTTP/1.1 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2cFrPlGpG2eLUR1xTDoAdPAd_eeHSbAVoKoIZai6NHw_WkSs13-E-910B1CHi4BpViDbX5RIfnRFHae42eUXWazt4699OI17LCI0Yy39ye9mS9Q5Y-ysUbhIOa8k9pM_t_4sSKK-SkzSslEiGAUjNHmSO69nuQZ-8mK60neR3oHhA Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_31c3afdfbc4b4fb597b2a0a37755ba4d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}] Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1e3982d4624d45bab581b97aa4316faa Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e905e71c-cecd-4b8e-b28c-1bd890dea631'} Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:23:46.245305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] Sep 14 09:23:46.250177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.260392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Returning 404 to user: Security group e905e71c-cecd-4b8e-b28c-1bd890dea631 does not exist Sep 14 09:23:46.260392 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3added6d-13c2-40c5-ae0c-53f2de01143d'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:46.260392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e1769e8-8ab1-411e-82ae-ddd0b8afa529 tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/e905e71c-cecd-4b8e-b28c-1bd890dea631" status: 404 len: 194 microversion: 2.1 time: 0.084628 Sep 14 09:23:46.260392 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 769/1445] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:23:46 2022] GET /compute/v2.1/os-security-groups/e905e71c-cecd-4b8e-b28c-1bd890dea631 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:46.277015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4a1c6da-e62b-41c7-ac19-394bc82f402c tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Calling method '.version_select at 0x7f693f7621f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:46.339779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4a1c6da-e62b-41c7-ac19-394bc82f402c tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-650298534" status: 202 len: 0 microversion: 2.1 time: 0.081680 Sep 14 09:23:46.343697 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 770/1446] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:23:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-650298534 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:23:46.354396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Action: 'update', calling method: .version_select at 0x7f693f762dc0>, body: {"security_group": {"name": "tempest-sg-1160946502", "description": "tempest-description-1297949483"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:46.420026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:23:46.420761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Neutron security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:23:46.421525 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] HTTP exception thrown: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.421525 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Request method failure captured: Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/os-security-groups/15f32a5c-26e5-48ea-91f1-c5227b7ea2fe HTTP/1.1 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 102 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2cFrPlGpG2eLUR1xTDoAdPAd_eeHSbAVoKoIZai6NHw_WkSs13-E-910B1CHi4BpViDbX5RIfnRFHae42eUXWazt4699OI17LCI0Yy39ye9mS9Q5Y-ysUbhIOa8k9pM_t_4sSKK-SkzSslEiGAUjNHmSO69nuQZ-8mK60neR3oHhA Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_31c3afdfbc4b4fb597b2a0a37755ba4d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/31c3afdfbc4b4fb597b2a0a37755ba4d"}]}] Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 31c3afdfbc4b4fb597b2a0a37755ba4d Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386 Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 1e3982d4624d45bab581b97aa4316faa Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1078245386-project Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: {"security_group": {"name": "tempest-sg-1160946502", "description": "tempest-description-1297949483"}} Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '15f32a5c-26e5-48ea-91f1-c5227b7ea2fe', 'body': {'security_group': {'name': 'tempest-sg-1160946502', 'description': 'tempest-description-1297949483'}}} Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:23:46.425080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] Returning 404 to user: Security group 15f32a5c-26e5-48ea-91f1-c5227b7ea2fe does not exist Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-04abe46b-bed0-4813-889e-aab4069f1c5d'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:23:46.429739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a61f6d8-42b1-49aa-98ab-db01510a3d6b tempest-SecurityGroupsNegativeTestJSON-1078245386 tempest-SecurityGroupsNegativeTestJSON-1078245386-project] 10.222.0.90 "PUT /compute/v2.1/os-security-groups/15f32a5c-26e5-48ea-91f1-c5227b7ea2fe" status: 404 len: 194 microversion: 2.1 time: 0.083445 Sep 14 09:23:46.438368 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 771/1447] 10.222.0.90 () {60 vars in 1290 bytes} [Wed Sep 14 09:23:46 2022] PUT /compute/v2.1/os-security-groups/15f32a5c-26e5-48ea-91f1-c5227b7ea2fe => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:23:47.152195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2949a7-438a-435e-a3f8-154fb1188e15", "tag": "b6f43238-7709-40fe-b032-eba759bab473"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:47.183860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:47.185131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:47.188871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:47.218818 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] Creating event network-changed:b6f43238-7709-40fe-b032-eba759bab473 for instance 6f2949a7-438a-435e-a3f8-154fb1188e15 on n-h2-851028-12 Sep 14 09:23:47.225416 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e8ea17df-9bff-4f19-8a91-2fe8d93cfc84 req-18bf397d-817e-42da-8ffc-f66bcba0b4a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077510 Sep 14 09:23:47.226696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 772/1448] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:23:47.232533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:47.233621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:47.240817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:47.241731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:47.242405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:47.243505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:47.244365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:47.245201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:47.728236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:47.738133 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e1e853b-1bd0-47cb-b9e4-95dd110b6c3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.510009 Sep 14 09:23:47.738732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 773/1449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:47 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:48.764573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:48.765161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:48.786753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:48.788574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:48.789146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:48.790835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:48.791367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:48.791862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:49.784276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:49.796039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79aa2425-a272-45cf-b0eb-e79d21bd9cf4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 1.038903 Sep 14 09:23:49.809608 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 774/1450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:48 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:50.834573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:50.835503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:50.849783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.850712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.851376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:50.852366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:50.853047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:50.853716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.558204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:51.571772 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-581ab249-dde8-431a-a596-3897552ee4a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.740253 Sep 14 09:23:51.572927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 775/1451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:50 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:51.581002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:51.586987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:51.597192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.598131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.599075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.600370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.601169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.601838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.680367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:51.749692 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-57004099-b83f-4661-a942-9e9aa0c9d27d tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175193 Sep 14 09:23:51.754540 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 776/1452] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:23:51 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:51.783391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:51.785738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:51.804565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.805453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.806200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:51.807173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:51.808261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:51.810347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:52.239123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lazy-loading 'services' on Instance uuid f29ae59e-6c87-480d-94be-f95f9485e4d2 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:23:52.509906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e21b20f9-1ea9-4097-9bb8-1110f70afbfe tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments/be9c562f-7353-4397-965d-07df36f0ecc5" status: 202 len: 0 microversion: 2.1 time: 0.748231 Sep 14 09:23:52.510551 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 777/1453] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:23:51 2022] DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments/be9c562f-7353-4397-965d-07df36f0ecc5 => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:23:52.541816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49a8a67-e1eb-4c51-a859-6c2708bdaf7b", "name": "network-vif-plugged", "status": "completed", "tag": "4732d1fe-9f69-44d5-a8ec-54ae09320d5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:52.584683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:52.585596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:52.588174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.098283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] Creating event network-vif-plugged:4732d1fe-9f69-44d5-a8ec-54ae09320d5e for instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b on n-h1-851028-12 Sep 14 09:23:53.108324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3e7e4f4f-a191-4f3d-9524-c3d5969265d8 req-1fd3c1fe-ace4-44e9-94a1-31585454b26d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.580344 Sep 14 09:23:53.109647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 778/1454] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:53.117648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:53.118760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:53.129071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.129958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.130570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.131551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:53.132218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:53.132861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:53.507047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:53.519471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87dc2296-681c-4165-9e31-fd881e49c903 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.404916 Sep 14 09:23:53.520963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 779/1455] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:53 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:54.544384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:54.546145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:54.563649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.564199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.565294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:54.573525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:54.574262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:54.583302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:55.353054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:55.370839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5671b553-bf18-4cd3-a6eb-546ac64d8afb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1311 microversion: 2.1 time: 0.830652 Sep 14 09:23:55.376528 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 780/1456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:54 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1311 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:55.612712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1229571623", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "12415fd1-eee7-4f0a-9e3d-a9fb12f3499a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:55.724218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] validate_networks() for [('12415fd1-eee7-4f0a-9e3d-a9fb12f3499a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:23:56.661531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:23:56.663372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:23:56.664314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:23:56.664898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:23:56.665486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:23:56.702788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.704594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.705796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.706618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:56.707198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:56.707625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:56.763405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:23:56.778086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for user e324dca163fb48d1841ee61468a1133b and project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:23:56.834633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:23:56.849037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:23:57.060705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-850865b5-4b15-4b53-a3ce-dc3d8ca693a5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676200 Sep 14 09:23:57.068718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 781/1457] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:23:57.087261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:57.092475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:57.146445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.148569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.152643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.154286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.157090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.162829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.656809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:57.671615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd441285-7ff4-4204-b0a6-3f3f7a2d96e1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1494 microversion: 2.1 time: 0.596412 Sep 14 09:23:57.675701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 782/1458] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:57 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1494 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:57.695323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22551f80-93f6-4466-beec-5675be89d654 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:57.696367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22551f80-93f6-4466-beec-5675be89d654 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:57.716065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:23:57.831325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22551f80-93f6-4466-beec-5675be89d654 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:57.841768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22551f80-93f6-4466-beec-5675be89d654 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1218 microversion: 2.1 time: 0.164084 Sep 14 09:23:57.849403 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 783/1459] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:57 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:57.881167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:57.882594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:57.921000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.928528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.929614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:57.930595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:57.935663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:57.936127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.466979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5db4ae2e-6a0c-46d4-8892-072f1a661222 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1647 microversion: 2.1 time: 0.609093 Sep 14 09:23:58.468613 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 784/1460] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:57 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1647 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:58.492607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:58.493444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:58.505823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.506593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.507254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.508175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.509069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.509726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.824958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-374b6556-46ac-400d-9499-b4563021cc8e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1647 microversion: 2.1 time: 0.337509 Sep 14 09:23:58.837930 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 785/1461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:58 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1647 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:23:58.860268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:58.874376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.878834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.880293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.883795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:58.885662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:58.892345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:58.974438 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91133986-609f-4931-92a2-5039f66b91d5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.123109 Sep 14 09:23:58.977893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 786/1462] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:23:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:23:58.990725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:58.994156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.015953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.019455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.021786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.026100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.026769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.028438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.278393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:23:59.295004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e1f3be1-7939-455b-a167-305d17e5eada tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1214 microversion: 2.1 time: 0.314312 Sep 14 09:23:59.298395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 787/1463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:58 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:23:59.324723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:23:59.326230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.349132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.528439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59decf56-e968-4c01-ba67-e304c0bd58e3 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b/action" status: 202 len: 0 microversion: 2.1 time: 0.223365 Sep 14 09:23:59.540409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 788/1464] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:23:59 2022] POST /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:23:59.565867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:23:59.569733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:23:59.594194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.594699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.615586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:23:59.618047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:23:59.618548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:23:59.619139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.004273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e531322-36d4-4489-9931-869d0c9ddfcf tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1652 microversion: 2.1 time: 1.453199 Sep 14 09:24:01.007247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 789/1465] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:23:59 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1652 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:01.359731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-224028849", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:01.481679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:01.787847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:01.788749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:01.789262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:01.789684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:01.790113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:01.803291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.803787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.804576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.805340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:01.805810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:01.806239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:01.840115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Getting quotas for project 4511fd917e2c4208ba618f490fc75d08. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:01.848929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Getting quotas for user 54e076a4aa074ae0a34b9574cfd4a8ba and project 4511fd917e2c4208ba618f490fc75d08. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:01.889461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:01.895376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:02.071308 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-348aab89-7b5c-4128-80b2-bbe56f45c0d5 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061314 Sep 14 09:24:02.076526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 790/1466] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:02.093160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.098303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.113793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.115200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.116048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.117176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.118120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.118953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.435178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.459760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f44db94c-417a-4652-8d15-3baba79b14eb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.380582 Sep 14 09:24:02.461169 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 791/1467] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:02.468827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.472050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.505978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.508124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.511670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.515099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:02.515865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:02.528701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:02.786454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d6009760-7d72-41e3-b308-becaa5ebbd47 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1632 microversion: 2.1 time: 0.324180 Sep 14 09:24:02.787208 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 792/1468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1632 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:02.805389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39d20a74-3857-4888-859a-738cd315c141 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:02.806250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39d20a74-3857-4888-859a-738cd315c141 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:02.928457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39d20a74-3857-4888-859a-738cd315c141 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:02.984915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39d20a74-3857-4888-859a-738cd315c141 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1218 microversion: 2.1 time: 0.196223 Sep 14 09:24:02.989048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 793/1469] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:02 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:03.015640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:03.025287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:03.055759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.056733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.060256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.061435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:03.062652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:03.067297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:03.152416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lazy-loading 'flavor' on Instance uuid f49a8a67-e1eb-4c51-a859-6c2708bdaf7b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:03.192624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:24:03.265151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:06.149897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29e820ee-fb34-4fed-a91b-8ca3e55b1ec5 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b/action" status: 202 len: 0 microversion: 2.1 time: 3.159316 Sep 14 09:24:06.151148 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 794/1470] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:24:02 2022] POST /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b/action => generated 0 bytes in 3161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:24:06.156040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:06.159260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:06.166891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.167686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.168353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.169247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.169876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.170474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.205898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-612231a4-5327-4721-b77d-729d0c7d04ed tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053150 Sep 14 09:24:06.207152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 795/1471] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:24:06 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:24:06.212211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:06.213183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:06.221384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.222255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.223100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.224418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.225043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.225640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.487417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:06.498572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e2cc184-e849-4af5-bd88-20bc0322d0ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.289237 Sep 14 09:24:06.499805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 796/1472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:06 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:06.679141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1215628953", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:06.772457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:06.773236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:06.773723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:06.774113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:06.774710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:06.794104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.794589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.795025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.795747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.796221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.796642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.823856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Getting quotas for project 2b959f8e2a6348049d005f0f6511d0a6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:06.828133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Getting quotas for user 97cabe6d64214cf1a165a87f4083e13d and project 2b959f8e2a6348049d005f0f6511d0a6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:06.841317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:06.844635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:06.906413 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d8f5981-467a-4c49-b589-57121ffefd3b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.404503 Sep 14 09:24:06.908156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 797/1473] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:24:06.914451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:06.915632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:06.926964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.927763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.928699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:06.929686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:06.930508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:06.931105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.332154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.342041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-246233d1-7bd8-404a-ab48-a090a145dd25 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1318 microversion: 2.1 time: 0.431314 Sep 14 09:24:07.359923 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 798/1474] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:06 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:07.359923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3edef393-edfa-4999-b821-eb052e9c0693", "tag": "91ff77ed-babd-46a1-ab8d-98f8153dc386"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:07.368388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.368928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.369356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.385113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] Creating event network-changed:91ff77ed-babd-46a1-ab8d-98f8153dc386 for instance 3edef393-edfa-4999-b821-eb052e9c0693 on n-h2-851028-12 Sep 14 09:24:07.392128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-764e2e3f-6823-4b65-838b-9d9dd54fb6aa req-8f682954-de7a-4503-a659-a6bd080cc03f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043334 Sep 14 09:24:07.393991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 799/1475] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:07.400544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.401809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.412097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.412755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.413352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.414294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.414735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.415234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.651554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:07.662941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ce6a256-d652-4a77-87ae-0d0e7b2ce5b8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.267448 Sep 14 09:24:07.681308 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 800/1476] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:07.695625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.698579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.707421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.708212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.708916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.709799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.710471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.711914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.756933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f17e7f5-6c03-4d42-9f14-77f461663151 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073872 Sep 14 09:24:07.757877 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 801/1477] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:24:07.771873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947b1eb7-6bc7-4d76-bbd7-0694af424a40", "tag": "87dfbd24-ee4e-4592-a872-f2beff052ca1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:07.786978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.787965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.788609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.804349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] Creating event network-changed:87dfbd24-ee4e-4592-a872-f2beff052ca1 for instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 on n-h1-851028-12 Sep 14 09:24:07.826145 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9cccf4f1-7099-4f77-a796-c6085c4d32cf req-51316714-4e9b-4e20-a5d6-0c1ded92fcf6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051496 Sep 14 09:24:07.828845 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 802/1478] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:07.844668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:07.846183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:07.860204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.861993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.862634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:07.865731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:07.866345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:07.866903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.013640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.028021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.029879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.031257 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be4e41ad-d104-45a7-903c-960878e03e95 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870" status: 200 len: 1274 microversion: 2.47 time: 0.199456 Sep 14 09:24:08.031966 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 803/1479] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:07 2022] GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:08.038740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.039728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.047187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.048109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.049345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.050297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.050993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.051869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.266796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:08.278058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a650d92-6a6b-4f22-a60c-b3d306aa3e38 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.244134 Sep 14 09:24:08.279343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 804/1480] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:08.289089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.289893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.298164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.303679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.304236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.304977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.305449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.305847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.357886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:08.512706 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a26e8ad-35dc-4988-a09b-f14a2b3a50be tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 204 len: 0 microversion: 2.1 time: 0.229774 Sep 14 09:24:08.513893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 805/1481] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:08 2022] DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:24:08.525476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1841018193", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:08.605727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:08.606200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:08.606680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:08.607091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:08.607501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:08.618003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.618495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.618937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.619673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.620150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.620817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.642058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Getting quotas for project 2b959f8e2a6348049d005f0f6511d0a6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:08.647263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Getting quotas for user 97cabe6d64214cf1a165a87f4083e13d and project 2b959f8e2a6348049d005f0f6511d0a6. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:08.659588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:08.662036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:08.698861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:08.745874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b259671-056e-4dec-b8f8-8935d6d6f13c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.229747 Sep 14 09:24:08.747221 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 806/1482] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:24:08.757481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:08.758388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:08.773762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.774629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.775728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:08.776721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:08.778176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:08.779068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.030987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.066480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2556e69f-fb77-4a8b-af9e-3a74f0b8803d tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1318 microversion: 2.1 time: 0.317881 Sep 14 09:24:09.071112 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 807/1483] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:08 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:09.076223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.077055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.090990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.091877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.092488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.093391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.095354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.097425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.410526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.419687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccb0089a-0ce6-438d-8fc8-97c8b7391b29 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1682 microversion: 2.1 time: 0.347198 Sep 14 09:24:09.441837 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 808/1484] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1682 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:09.454089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.464033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.494286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.495276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.495594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.496409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.496914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.497295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.672014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:09.681658 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bed3ad9-8ca7-4ed7-a597-a079b4342f40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.236868 Sep 14 09:24:09.682992 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 809/1485] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:09.687927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:09.691824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.722539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.723056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.731447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.732416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.732891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.733517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.802419 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24d75195-3c4b-44f1-89a3-990194ae5c45 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "PUT /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 992 microversion: 2.47 time: 0.117820 Sep 14 09:24:09.803555 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 810/1486] 10.222.0.90 () {62 vars in 1297 bytes} [Wed Sep 14 09:24:09 2022] PUT /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 992 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:24:09.818153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:09.821114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:09.840432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.841056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.841515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:09.843069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:09.843069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:09.843342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.162094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.173171 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af2a39ae-7bea-4d70-853f-6f7563eeced3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.368252 Sep 14 09:24:10.191937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 811/1487] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:09 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:10.191937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.191937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.215294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.216282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.218061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.219526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.221266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.224985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.241184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:10.354840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.367498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.369839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.371021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dfcba18-d21d-487e-93bc-7315ad33eb2e tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1330 microversion: 2.47 time: 0.192902 Sep 14 09:24:10.372908 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 812/1488] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:10.385403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.386111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.402932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.403851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.404467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.405571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.406212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.406979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.866751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:10.892667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23ae9000-53b2-49da-82ef-d0f193948ec3 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1318 microversion: 2.1 time: 0.518075 Sep 14 09:24:10.902825 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 813/1489] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:10.902825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49a8a67-e1eb-4c51-a859-6c2708bdaf7b", "name": "network-vif-unplugged", "status": "completed", "tag": "4732d1fe-9f69-44d5-a8ec-54ae09320d5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:10.923598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.924874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.925546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.939487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] Creating event network-vif-unplugged:4732d1fe-9f69-44d5-a8ec-54ae09320d5e for instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b on n-h1-851028-12 Sep 14 09:24:10.945921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-12ca18c1-9ea4-44f8-8dad-16a1c4519793 req-77584868-abc9-4e7e-af36-deb63269d96e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050718 Sep 14 09:24:10.946846 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 814/1490] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:10.952430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:10.953132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:10.960691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.961224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.961745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:10.962504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:10.963176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:10.963804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.136697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.146383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f329af60-4a6a-41ff-9f41-29c049381de2 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1682 microversion: 2.1 time: 0.198154 Sep 14 09:24:11.146991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 815/1491] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:10 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:11.151984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.152822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.165499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.166362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.166804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.167569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.168061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.168491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.354553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.364855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66ab7cac-2517-442e-969e-f67a17177858 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.216551 Sep 14 09:24:11.366862 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 816/1492] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:11.372342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.372740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.387281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.387788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.388474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.389372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.389991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.390600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.607690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.630786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd830d03-f6f9-4aa1-b624-dfee73c08592 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.262308 Sep 14 09:24:11.631095 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 817/1493] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:11.645846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.646783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.654347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.655118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.656144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.657109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.659535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.660222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.749544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.758918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.769316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:11.772687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3dd3293b-a896-4667-ba01-ae460518564c tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1336 microversion: 2.47 time: 0.129900 Sep 14 09:24:11.773503 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 818/1494] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1336 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:11.778328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947b1eb7-6bc7-4d76-bbd7-0694af424a40", "name": "network-vif-plugged", "status": "completed", "tag": "87dfbd24-ee4e-4592-a872-f2beff052ca1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:11.804935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.805752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.806348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.822420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] Creating event network-vif-plugged:87dfbd24-ee4e-4592-a872-f2beff052ca1 for instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 on n-h1-851028-12 Sep 14 09:24:11.831192 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-63cc1c86-a727-482b-b792-cd6f9ae8aea7 req-a272bac1-a329-445f-bd46-93be20f468ff service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056187 Sep 14 09:24:11.832649 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 819/1495] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:11.920903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:11.922367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:11.929258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.929748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.930187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:11.930899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:11.931363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:11.931788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.106423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.119337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-402eec59-cace-48dc-8fc2-10d7194229db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1318 microversion: 2.1 time: 0.204216 Sep 14 09:24:12.153980 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 820/1496] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:11 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:24:12.153980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:12.164754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.165892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Searching by: {'deleted': False, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:24:12.181070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.181951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.182609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.183563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.184221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.184817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.315945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:24:12.462661 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0ff8b5b-79b0-4b95-b347-2abe9aa4e18e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.320270 Sep 14 09:24:12.463728 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 821/1497] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:24:12 2022] GET /compute/v2.1/servers => generated 340 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:12.477117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:12.477809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:12.485580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.487356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.488339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.489490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.490534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.491134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.575466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.589023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0985546-04d4-4baa-8b39-fbd544a7abf5 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1615 microversion: 2.1 time: 0.124042 Sep 14 09:24:12.590169 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 822/1498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:12 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1615 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:12.603685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:12.604366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:12.618431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.619099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.619673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.623139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:12.623738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:12.624465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:12.929833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.944411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30158bbb-4c82-4ad7-97e8-2e0d295f9772 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.348963 Sep 14 09:24:12.945509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 823/1499] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:12 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:12.951599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:12.977570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:12.983752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Searching by: {'deleted': False, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:24:12.994800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.002767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.002767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.002767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.002767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.002767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.148771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:24:13.244670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.256083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.256725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.257266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.435984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-764cb807-470c-428a-980e-1452ac1639eb tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.487723 Sep 14 09:24:13.456292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 824/1500] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:24:12 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:13.461238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:13.463012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:13.471756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.471756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.472564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.473183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.473630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.474052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.635546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.645363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a7c8ced-1fa3-4b24-a2e1-056ae7b1218d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.187396 Sep 14 09:24:13.646277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 825/1501] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:13 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:13.667233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:13.668237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:13.677257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.678504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.679080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.679878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.680367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.681024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.770674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.785690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.791035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:13.795989 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c69d871c-dd20-4514-931f-f2902ebcce91 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1357 microversion: 2.47 time: 0.145360 Sep 14 09:24:13.808985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 826/1502] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:13 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:13.824868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f49a8a67-e1eb-4c51-a859-6c2708bdaf7b", "tag": "4732d1fe-9f69-44d5-a8ec-54ae09320d5e"}, {"server_uuid": "f29ae59e-6c87-480d-94be-f95f9485e4d2", "name": "network-vif-deleted", "tag": "98133eb2-b7e0-4a79-9f3d-4170106ca9b1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:13.838851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.839441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.840031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.856953 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Creating event network-changed:4732d1fe-9f69-44d5-a8ec-54ae09320d5e for instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b on n-h1-851028-12 Sep 14 09:24:13.857459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] Creating event network-vif-deleted:98133eb2-b7e0-4a79-9f3d-4170106ca9b1 for instance f29ae59e-6c87-480d-94be-f95f9485e4d2 on n-h1-851028-12 Sep 14 09:24:13.865276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-056dc5ff-7770-4c9c-9b99-48932bb7f08d req-de58e1cc-b1e3-4f40-864c-b97194304f59 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054915 Sep 14 09:24:13.866232 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 827/1503] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:13.871435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:13.872296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:13.880036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.880036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.880497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:13.881218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:13.881682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:13.882106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.165195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:14.174219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dafb861e-1b87-419f-905b-7a120639da76 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1467 microversion: 2.1 time: 0.306062 Sep 14 09:24:14.184333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 828/1504] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:13 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1467 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:14.192198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bd50fb9-1768-4af1-8676-d507f3ed092d tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:14.201376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bd50fb9-1768-4af1-8676-d507f3ed092d tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016044 Sep 14 09:24:14.217174 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 829/1505] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:24:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:14.222826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:14.223448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:14.229921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.230961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.231409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.232177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.232872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.233058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.279697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.280308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.280808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.282338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lazy-loading 'fault' on Instance uuid f29ae59e-6c87-480d-94be-f95f9485e4d2 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:14.284824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:14.346092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ada7bba23b4508851f61fb101cdd12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c1bfe90d9954ab5a92d43f1c4511b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:14.363074 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a80dc37e-476a-4695-8c16-6a4d3c47b916 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 200 len: 1331 microversion: 2.1 time: 0.144428 Sep 14 09:24:14.364508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 830/1506] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:14 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:14.384320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:14.387537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:14.414901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.415426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.416050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.417473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.418207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.418836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.562646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:14.563166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:14.567237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:14.568008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:14.569302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:14.694384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:14.700745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.701359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.701924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.702725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.703277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.703793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.748471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4fdc415b-3077-4243-a149-43c21a167d90 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "POST /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611/action" status: 202 len: 1079 microversion: 2.47 time: 0.378281 Sep 14 09:24:14.749789 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 831/1507] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:24:14 2022] POST /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611/action => generated 1079 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:24:14.762043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edef393-edfa-4999-b821-eb052e9c0693", "name": "network-vif-plugged", "status": "completed", "tag": "91ff77ed-babd-46a1-ab8d-98f8153dc386"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:14.784697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.789908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.790876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.806856 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] Creating event network-vif-plugged:91ff77ed-babd-46a1-ab8d-98f8153dc386 for instance 3edef393-edfa-4999-b821-eb052e9c0693 on n-h2-851028-12 Sep 14 09:24:14.813735 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-360a719a-1d1f-42a0-871e-755ee942d718 req-74648e86-52ff-40c7-8756-4d63669517a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061205 Sep 14 09:24:14.815767 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 832/1508] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:14.844260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:14.852520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:14.885446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.886185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.886878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:14.887873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:14.888966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:14.889618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:15.499946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:15.515125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc114138-6312-4853-8272-2ec0dc13b96f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.689588 Sep 14 09:24:15.516521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 833/1509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:14 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:15.979629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-715508268", "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:15.982990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:15.997504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.000596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.001578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.004450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.005155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.005797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.073711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lazy-loading 'flavor' on Instance uuid 947b1eb7-6bc7-4d76-bbd7-0694af424a40 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:16.093972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Going to try to live migrate instance to tempest-host-715508268 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:24:16.107426 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] HTTP exception thrown: Compute host tempest-host-715508268 could not be found. Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Request method failure captured: Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40/action HTTP/1.1 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 106 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2vdTjgRMmtD3RKAWGiSUQSOc9V8kvOYlyp-32LBDLpHD_raGCmIMSK6swjltuPw7Nh0dN3g2wb4CNyAIk6p8rjGi8u0EbvdQj6m1DTm_rT5PQZd8doPC2ZB7yQ8ANNuR0i3Y0_Ap-Nvl0a8GGq9lYWIFytXTIy-zL1zs5ql6DZFRw Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2c12e1fe91fb4842afb8d45b96e9205a Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2c12e1fe91fb4842afb8d45b96e9205a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2c12e1fe91fb4842afb8d45b96e9205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2c12e1fe91fb4842afb8d45b96e9205a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2c12e1fe91fb4842afb8d45b96e9205a"}]}] Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2c12e1fe91fb4842afb8d45b96e9205a Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationNegativeTest-1210471494-project-admin Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 80887cc5f2e2414aa11355d2bee8b52d Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationNegativeTest-1210471494-project-admin Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: {"os-migrateLive": {"host": "tempest-host-715508268", "block_migration": true, "disk_over_commit": false}} Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: exception: Compute host tempest-host-715508268 could not be found. Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '947b1eb7-6bc7-4d76-bbd7-0694af424a40', 'body': {'os-migrateLive': {'host': 'tempest-host-715508268', 'block_migration': True, 'disk_over_commit': False}}} Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 14 09:24:16.116999 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-715508268 could not be found. Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-715508268 could not be found. Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-715508268 could not be found. Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Returning 400 to user: Compute host tempest-host-715508268 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:16.122251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e074fad-3c3b-4fd1-ba59-00cde9abc5a3 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40/action" status: 400 len: 99 microversion: 2.1 time: 0.601466 Sep 14 09:24:16.128008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 834/1510] 10.222.0.90 () {60 vars in 1279 bytes} [Wed Sep 14 09:24:15 2022] POST /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40/action => generated 99 bytes in 610 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:24:16.143428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:16.144521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:16.161078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.161577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.162124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.162827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.163163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.163585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.198376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:16.337529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4675a605-211c-4326-a11b-5ddf5952fe6e tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 204 len: 0 microversion: 2.1 time: 0.207124 Sep 14 09:24:16.342677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 835/1511] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:16 2022] DELETE /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:24:16.351786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:16.353422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:16.362350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.363431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.364196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.365924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:16.366508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:16.367216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:16.988056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.000155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8414cc3-e376-4990-b976-a16c990682bc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1318 microversion: 2.1 time: 0.654599 Sep 14 09:24:17.001083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 836/1512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:16 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:17.006509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:17.007134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:17.013628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.014335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.014550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.015276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.016048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.016217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.126183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.134671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.136170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.137459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4663ea61-42b1-401d-aee3-5d0c93a09d22 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.135677 Sep 14 09:24:17.138228 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 837/1513] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:17 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:17.152221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:17.152846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:17.159831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.160376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.160815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.161593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.162232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.162661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.176974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] HTTP exception thrown: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Request method failure captured: Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 HTTP/1.1 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZz0ioTjV-dd8SHqMY5iKo6QWm5hLfvxdx6rC_EHUGhSWMh2Yl6z2fwFFSkelFGOo1yYByClD8crQrSPUFjBQMq8hpN6LQ9uauKs-rup2KXwFxLiFU0Zl3_ZEtg-y-TcR3gTg2TVNNx0fQe-QGn_ffDR2rw-ds5h9wdJgQxThw-up2w Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7c1bfe90d9954ab5a92d43f1c4511b52", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7c1bfe90d9954ab5a92d43f1c4511b52"}]}] Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 70ada7bba23b4508851f61fb101cdd12 Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f29ae59e-6c87-480d-94be-f95f9485e4d2'} Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:17.178672 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Returning 404 to user: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:17.184131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ba2bf67-1c3b-4d6b-8889-5164ece29102 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 404 len: 111 microversion: 2.1 time: 0.040334 Sep 14 09:24:17.184864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 838/1514] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:17 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:17.188862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:17.189472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:17.195925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.196415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.196847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.197552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.198002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.198426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.375346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.393577 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c757303-c113-4332-bc0e-e9ea23bf0473 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1467 microversion: 2.1 time: 0.206912 Sep 14 09:24:17.399558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 839/1515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:17 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1467 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:17.406945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:17.409127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:17.418081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.418918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.419693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.420815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.421534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.422098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.727615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.738994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e7b9a9d-2b15-4b1b-a2a0-a0dbd4297d50 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1716 microversion: 2.1 time: 0.338191 Sep 14 09:24:17.752799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 840/1516] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:17 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1716 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:17.765996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:17.766894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:17.775579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.776419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.777075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.777993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:17.778623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:17.779228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:17.969512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:17.979484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95730ae1-9712-43af-a603-02e0c0ac9a07 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.225055 Sep 14 09:24:17.980697 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 841/1517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:17 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:17.986371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ad7b0d52-478d-400e-982b-f27024054c1b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '.version_select at 0x7f693fa22b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:18.019052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ad7b0d52-478d-400e-982b-f27024054c1b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753148466" status: 202 len: 0 microversion: 2.1 time: 0.036005 Sep 14 09:24:18.019876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 842/1518] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753148466 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:24:18.032406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1123482944", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:18.103992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:18.423037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:18.423669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:18.425139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:18.426070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:18.427471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:18.445379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.446309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.447150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.448715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.449539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.450321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.474991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Getting quotas for project 4511fd917e2c4208ba618f490fc75d08. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:18.481378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Getting quotas for user 54e076a4aa074ae0a34b9574cfd4a8ba and project 4511fd917e2c4208ba618f490fc75d08. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:18.500010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:18.504669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:18.507888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:18.583128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf5fb526-8653-4fcf-89c6-70ccb77093ea tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555448 Sep 14 09:24:18.590146 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 843/1519] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:18.608896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:18.612031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:18.639457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.645623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.646132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:18.646873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:18.647340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:18.647775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.536537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.545287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-285081b5-1560-4dd8-a5ec-6b093aadc1cc tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1508 microversion: 2.1 time: 0.959971 Sep 14 09:24:19.578329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 844/1520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:18 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1508 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:19.594223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:19.597926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:19.610175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.614688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.616309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.618107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.620001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.624215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.745265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.757582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.759823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.761873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b62cbbb7-cd5e-45e6-a2eb-612cfe865408 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.182256 Sep 14 09:24:19.781507 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 845/1521] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:19 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:19.788395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:19.789432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:19.797316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.798193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.798909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.801963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.803041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.804039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.810300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:19.918975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:19.929408 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fdf5944-e2f7-4c60-9d5e-7fa95aeb6b8a tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1271 microversion: 2.1 time: 0.146459 Sep 14 09:24:19.930859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 846/1522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:19 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:19.936587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:19.937539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:19.947024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.947875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.948723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:19.949689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:19.950523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:19.951178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.145062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ed917284c6a447c804c33599e1ef8fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d73f36e32be4ad3b60558414ed6d4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:20.155359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5918fb4-38f3-495e-845f-a9ee069a6733 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 200 len: 1716 microversion: 2.1 time: 0.223130 Sep 14 09:24:20.156321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 847/1523] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:19 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 1716 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:20.162348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:20.162962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:20.177863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.178242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.178727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.179333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.179782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.180235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.390880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:20.410917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b206673-0d6f-4033-807c-65ec2de2626a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1504 microversion: 2.1 time: 0.253258 Sep 14 09:24:20.428483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 848/1524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:20 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:20.438465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:20.440370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:20.460728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.461223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.461659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:20.465318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:20.465810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:20.466249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:21.045207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:21.059336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88add159-7632-4e68-9229-516d55614f1f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1508 microversion: 2.1 time: 0.629173 Sep 14 09:24:21.060292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 849/1525] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:20 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:21.072608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:21.077467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:21.110220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:21.111099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:21.115757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:21.117660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:21.118449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:21.120301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:21.911090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:21.922932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:21.928775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:21.940362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c5c015c-43fc-4f98-b173-fca02193661f tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.875178 Sep 14 09:24:21.951975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 850/1526] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:21 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:21.951975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:21.951975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:21.972246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:21.972750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:21.973193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:21.991286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:21.993246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:21.993718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:22.702621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:22.717936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e17a1e1e-fa4e-4287-8616-3032367cce27 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.775558 Sep 14 09:24:22.733123 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 851/1527] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:21 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:22.759698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:22.762894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:22.781423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:22.787138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:22.788010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:22.790037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:22.790872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:22.792726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:22.905910 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-50703d4e-9af7-45c1-b2d4-46f3324c80f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/ips" status: 200 len: 149 microversion: 2.1 time: 0.170672 Sep 14 09:24:22.909622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 852/1528] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:24:22 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/ips => generated 149 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:22.918415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:22.930278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:22.944880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:22.947667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:22.949815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:22.964151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:22.972563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:22.973427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.188632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:23.192694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:23.193343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:23.193884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:23.194407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:23.405167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:23.438121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.440516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.442338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.445428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.446157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.447069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.560774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25c37889-1788-4963-9788-fe217b3b1ce0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "POST /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693/action" status: 202 len: 1110 microversion: 2.1 time: 0.649389 Sep 14 09:24:23.566065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 853/1529] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:24:22 2022] POST /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693/action => generated 1110 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:24:23.598129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e584a2f-6232-4eba-be41-39a4c8513dbd", "name": "network-vif-deleted", "tag": "1653c64c-3b0b-4425-8b00-c402c0e2f26d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:23.617800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.618689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.619292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.634831 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] Creating event network-vif-deleted:1653c64c-3b0b-4425-8b00-c402c0e2f26d for instance 0e584a2f-6232-4eba-be41-39a4c8513dbd on n-h2-851028-12 Sep 14 09:24:23.640993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-eed3826d-f8ad-486b-872d-725a27483ad1 req-f192becf-c8c5-4dd8-afbd-532a3d58ea6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055446 Sep 14 09:24:23.642504 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 854/1530] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:23.649922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:23.650968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] [instance: 0e584a2f-6232-4eba-be41-39a4c8513dbd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:23.659476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.660397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.660989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.661888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.662748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.663732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.681079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] HTTP exception thrown: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Request method failure captured: Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd HTTP/1.1 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ16Iyo6LicD1WMuOR_ej4CpYxJRLkJffakptcOsMRDSn3cA5AYuDFCFjXnI3i3WbPL_nKqCQYedMrYb6SjugkhgZ10Ly-xBMlFE5K6qeA5RuqvcbUPLXbx5ebpJHbQMeT4SoBkSWm71T4heCXQkhIkfCGrbh1xruWqzWB0_XXKHSeI Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 5d73f36e32be4ad3b60558414ed6d4a7 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestManualDisk-754214494 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5d73f36e32be4ad3b60558414ed6d4a7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5d73f36e32be4ad3b60558414ed6d4a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5d73f36e32be4ad3b60558414ed6d4a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5d73f36e32be4ad3b60558414ed6d4a7"}]}] Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestManualDisk-754214494 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 5d73f36e32be4ad3b60558414ed6d4a7 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestManualDisk-754214494 Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestManualDisk-754214494-project Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4ed917284c6a447c804c33599e1ef8fb Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestManualDisk-754214494-project Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '0e584a2f-6232-4eba-be41-39a4c8513dbd'} Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:23.683225 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. Sep 14 09:24:23.688736 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:23.691104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Returning 404 to user: Instance 0e584a2f-6232-4eba-be41-39a4c8513dbd could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:23.692501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-323e52ec-0e36-4419-9dfe-4c57b97dc82a tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd" status: 404 len: 111 microversion: 2.1 time: 0.047823 Sep 14 09:24:23.693493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 855/1531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:23 2022] GET /compute/v2.1/servers/0e584a2f-6232-4eba-be41-39a4c8513dbd => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:23.698939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:23.700783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:23.709651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.711644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.713504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:23.714473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:23.716450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:23.719052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:24.249918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:24.262560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25ebe871-cc75-46ab-a884-81d77d70d252 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1479 microversion: 2.1 time: 0.565534 Sep 14 09:24:24.263932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 856/1532] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:23 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1479 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:24.272582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:24.274113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:24.285164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:24.286271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:24.287018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:24.287941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:24.288865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:24.289716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:24.417124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:24.452827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:24.455359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:24.464594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52d14a63-9d5a-4374-bf53-d8fe6c17e87b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.198172 Sep 14 09:24:24.465793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 857/1533] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:24 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:24.490672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:24.492245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:24.508517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:24.509345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:24.509872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:24.511853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:24.517958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:24.518735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:25.013405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:25.027871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afcd98df-c6e5-4d37-a274-2fb8605382b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.559952 Sep 14 09:24:25.030839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 858/1534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:24 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:25.042386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1971028-f691-436a-bcaa-954a20b6fa93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] Calling method '.version_select at 0x7f693fa22040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:25.102356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1971028-f691-436a-bcaa-954a20b6fa93 tempest-ServersTestManualDisk-754214494 tempest-ServersTestManualDisk-754214494-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631866811" status: 202 len: 0 microversion: 2.1 time: 0.065686 Sep 14 09:24:25.121525 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 859/1535] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:24:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631866811 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:24:25.133504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:25.149140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:25.157190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:25.168059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:25.171134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:25.174104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:25.175604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:25.181297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:25.904664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:25.929731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-526aeb1b-3210-4633-b112-3b71904ed68e tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.804550 Sep 14 09:24:25.934378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 860/1536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:25 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:25.941240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e5c3dd9-9afe-40ff-b90b-3f57fc8b1c6e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '.version_select at 0x7f693fa03550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:25.946319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e5c3dd9-9afe-40ff-b90b-3f57fc8b1c6e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:25.947370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e5c3dd9-9afe-40ff-b90b-3f57fc8b1c6e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:25.948272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e5c3dd9-9afe-40ff-b90b-3f57fc8b1c6e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:25.964774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e5c3dd9-9afe-40ff-b90b-3f57fc8b1c6e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 792 microversion: 2.1 time: 0.029055 Sep 14 09:24:25.969771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 861/1537] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:24:25 2022] GET /compute/v2.1/os-migrations => generated 792 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:25.986005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fdce51e-4525-4474-8a93-d94757ecc840", "tag": "e4ccb618-de82-48f7-8f9c-bc72a5d8e714"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:26.018849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.019552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.019552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.038320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] Creating event network-changed:e4ccb618-de82-48f7-8f9c-bc72a5d8e714 for instance 8fdce51e-4525-4474-8a93-d94757ecc840 on n-h2-851028-12 Sep 14 09:24:26.067049 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-05944d17-9dfd-4be9-bb7b-da1f98d2e93a req-1ceb6ee8-43c5-47cd-8d54-6c49551b7aa0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089525 Sep 14 09:24:26.068577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 862/1538] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:26.081527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:26.082836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:26.096544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.098486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.099104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.100290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.100933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.101778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.220049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:26.232346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:26.235504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:26.237372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-907a40d5-30ba-4df7-baeb-12a5e411e9a5 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.164369 Sep 14 09:24:26.255438 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 863/1539] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:26 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:26.263667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:26.264497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:26.273661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.274508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.275197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.276741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.277437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.277971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.578904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:26.592554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9ad0b3d-1e7d-4462-8e50-fc0ada1f6f5e tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1632 microversion: 2.1 time: 0.337895 Sep 14 09:24:26.592554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 864/1540] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:26 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1632 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:26.618085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:26.618085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:26.642297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.642889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.643347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.644305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:26.644772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:26.645224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:26.953727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:26.982057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2858ef76-bcf7-45a9-a17b-e656e6db1d19 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.383136 Sep 14 09:24:26.983491 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 865/1541] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:26 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:27.003761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74370038-a655-404e-a1de-f9e5826ebec8"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:27.006537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:27.014282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:27.015382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:27.017079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:27.018192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:27.018818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:27.020847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:27.590029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d125cafa-4d17-4550-a2c0-d795237cfc6f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591338 Sep 14 09:24:27.591695 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 866/1542] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:24:26 2022] POST /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:27.652595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-897018cb-3e3d-4b4f-89db-ad68c70d2d4f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: .version_select at 0x7f693ff00040>, body: {"keypair": {"name": "tempest-keypair-2000038869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuPB9MN92dc3PpbkzrJd09GdCia0YjJLv7PpdV/c6aTXAa80Sz4YcHzZzzmoUhXQljxuDynsr2bZ6gIx6oMudsqqP58MKAqI5Rh3S76u5YDi0JpcTiZw0BbQ6B6JNTGxQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:27.729425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=37 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:27.740972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-897018cb-3e3d-4b4f-89db-ad68c70d2d4f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:27.761060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-897018cb-3e3d-4b4f-89db-ad68c70d2d4f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for user acf0e1a651e34682923f8eb74872adb1 and project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:27.822625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-897018cb-3e3d-4b4f-89db-ad68c70d2d4f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229094 Sep 14 09:24:27.827813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 867/1543] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:24:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:27.832901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:27.833639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:27.888932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:27.893446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:27.894602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:27.898171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:27.900040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:27.902316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:28.396231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:28.416484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65e9ab8e-4304-49bf-aa9f-38db99c5cd08 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.577496 Sep 14 09:24:28.418105 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 868/1544] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:27 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:28.423446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:28.426907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:28.463384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:28.467324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:28.469276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:28.471272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:28.474261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:28.477750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:28.478557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:28.748470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:28.800654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:28.803909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:28.813776 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-547469e4-7f61-49fd-b247-e8ecef1c6612 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.394026 Sep 14 09:24:28.829087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 869/1545] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:28 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:28.856789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:28.860625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:28.906434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:28.907539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:28.908150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:28.909097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:28.910168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:28.916167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:28.959961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] HTTP exception thrown: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Request method failure captured: Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 HTTP/1.1 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZz0ioTjV-dd8SHqMY5iKo6QWm5hLfvxdx6rC_EHUGhSWMh2Yl6z2fwFFSkelFGOo1yYByClD8crQrSPUFjBQMq8hpN6LQ9uauKs-rup2KXwFxLiFU0Zl3_ZEtg-y-TcR3gTg2TVNNx0fQe-QGn_ffDR2rw-ds5h9wdJgQxThw-up2w Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7c1bfe90d9954ab5a92d43f1c4511b52", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7c1bfe90d9954ab5a92d43f1c4511b52"}]}] Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 70ada7bba23b4508851f61fb101cdd12 Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f29ae59e-6c87-480d-94be-f95f9485e4d2'} Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:28.962273 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:28.967694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:28.972935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Returning 404 to user: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:28.980168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09703346-d0d0-4bbe-a512-c25d2a2113d9 tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 404 len: 111 microversion: 2.1 time: 0.148649 Sep 14 09:24:28.981455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 870/1546] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:28 2022] DELETE /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:28.992901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:28.998140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:29.036161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.036888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.037551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:29.038479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.039357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.040049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:29.450199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:29.472022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5129b46a-225a-455b-8078-6370f018c7b3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.488209 Sep 14 09:24:29.472856 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 871/1547] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:28 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:29.489662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:29.490047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] [instance: f29ae59e-6c87-480d-94be-f95f9485e4d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:29.508921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.509518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.510058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:29.511372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.511843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.512305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:29.538340 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] HTTP exception thrown: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Request method failure captured: Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 HTTP/1.1 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZz0ioTjV-dd8SHqMY5iKo6QWm5hLfvxdx6rC_EHUGhSWMh2Yl6z2fwFFSkelFGOo1yYByClD8crQrSPUFjBQMq8hpN6LQ9uauKs-rup2KXwFxLiFU0Zl3_ZEtg-y-TcR3gTg2TVNNx0fQe-QGn_ffDR2rw-ds5h9wdJgQxThw-up2w Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7c1bfe90d9954ab5a92d43f1c4511b52", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7c1bfe90d9954ab5a92d43f1c4511b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7c1bfe90d9954ab5a92d43f1c4511b52"}]}] Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7c1bfe90d9954ab5a92d43f1c4511b52 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1450456434 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 70ada7bba23b4508851f61fb101cdd12 Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1450456434-project Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f29ae59e-6c87-480d-94be-f95f9485e4d2'} Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:29.540694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] Returning 404 to user: Instance f29ae59e-6c87-480d-94be-f95f9485e4d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f403ae42-49ab-4537-8780-96fc67134e8b tempest-AttachSCSIVolumeTestJSON-1450456434 tempest-AttachSCSIVolumeTestJSON-1450456434-project] 10.222.0.90 "GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2" status: 404 len: 111 microversion: 2.1 time: 0.069324 Sep 14 09:24:29.549893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 872/1548] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:29 2022] GET /compute/v2.1/servers/f29ae59e-6c87-480d-94be-f95f9485e4d2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:29.552207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:29.554168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:29.570380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.570380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.570380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:29.570380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:29.570978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:29.571188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:30.008594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:30.032261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b16dd1ac-546d-42cf-a93c-c99a77245671 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.486527 Sep 14 09:24:30.034942 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 873/1549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:29 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:30.047534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:30.052731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:30.069385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:30.074360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:30.077538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:30.080034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:30.081691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:30.083876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:30.275370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:30.295706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:30.306143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:30.308619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a89ff84d-54c7-4957-9edb-159285cc0815 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.270406 Sep 14 09:24:30.309838 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 874/1550] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:30 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:30.495639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:30.498068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:30.511974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:30.513707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:30.514922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:30.517129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:30.518381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:30.519534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:31.072940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:31.085431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35219523-7c6c-4aa8-a1a3-a56c8d9f7232 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.593905 Sep 14 09:24:31.087294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 875/1551] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:30 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:31.105343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:31.106554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:31.116670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:31.117262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:31.117721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:31.118463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:31.118932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:31.119367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:31.612759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:31.637210 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be74dc48-4ede-46e3-8206-53282b6f0231 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.547607 Sep 14 09:24:31.641016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 876/1552] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:31 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:31.655714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:31.662134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:31.688866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:31.692767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:31.694689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:31.702328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:31.703352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:31.707468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:31.923205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:31.943715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:31.948240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:31.951850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c11c8398-3a17-4730-a712-6f97ec5231e1 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.309169 Sep 14 09:24:31.973745 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 877/1553] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:31 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:32.102782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdce51e-4525-4474-8a93-d94757ecc840", "name": "network-vif-plugged", "status": "completed", "tag": "e4ccb618-de82-48f7-8f9c-bc72a5d8e714"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:32.136124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:32.139433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:32.142547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:32.200977 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] Creating event network-vif-plugged:e4ccb618-de82-48f7-8f9c-bc72a5d8e714 for instance 8fdce51e-4525-4474-8a93-d94757ecc840 on n-h2-851028-12 Sep 14 09:24:32.216273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d03edbc7-56b4-4bd9-a6e1-08b0fca39e36 req-8f63cc9c-8e7c-4c92-a326-a1e45bc78812 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115237 Sep 14 09:24:32.217365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 878/1554] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:32.234643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:32.239261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:32.259435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:32.260660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:32.264647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:32.266058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:32.266861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:32.267492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:33.171271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:33.184926 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-292bb47c-b484-42f0-8a16-d694e82aa406 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.966237 Sep 14 09:24:33.186083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 879/1555] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:32 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:33.193505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:33.202610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:33.215359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:33.215852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:33.238436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:33.241595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:33.243425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:33.244155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:33.932272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:33.944622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65f2de8f-0851-4d47-b97a-1f39b2e8d7db tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1319 microversion: 2.1 time: 0.756903 Sep 14 09:24:33.961182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 880/1556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:33 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1319 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:33.961182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:33.961182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:33.961182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:33.961182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:33.962394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:33.962508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:33.962882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:33.963317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:34.126514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:34.146551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:34.148437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:34.149929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f27ece8-c23e-47ae-88eb-2c0bc3fdf7db tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.203116 Sep 14 09:24:34.150880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 881/1557] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:33 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:34.160027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-224337786", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8"}], "security_groups": [{"name": "tempest-securitygroup--470711166"}], "key_name": "tempest-keypair-2000038869", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:34.479492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] validate_networks() for [('d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:36.055744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:36.063453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:36.067040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:36.071209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:36.074890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:36.093002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:36.104711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.105523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.106747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:36.107830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.108548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.109173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:36.141712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:36.148122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for user acf0e1a651e34682923f8eb74872adb1 and project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:36.179706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:36.182381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:36.269744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8fc2ea30-7858-451b-b525-647fa697ef0b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.117642 Sep 14 09:24:36.270681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 882/1558] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:36.279397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:36.282333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:36.303580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.304429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.305063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:36.305986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.308504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.309148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:36.847956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:36.852224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:36.862697 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd1b4b37-8185-437e-9e2a-4e1751a9eb20 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.587538 Sep 14 09:24:36.871387 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 883/1559] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:36 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:36.876294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:36.877037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:36.899335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.899835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.901877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:36.902626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:36.903055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:36.903487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.453700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:37.474850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7dc5f084-09d5-428e-a96e-42762b87cdba tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1469 microversion: 2.1 time: 0.597676 Sep 14 09:24:37.479572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 884/1560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:36 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:37.492579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:37.493209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:37.507923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.508775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.509594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.510660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.511104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.511704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.637513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:37.651625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:37.661385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:37.664745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ac61685-2ad6-45f8-b55e-487547595149 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.184400 Sep 14 09:24:37.668069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 885/1561] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:37 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:37.676097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:37.678285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:37.683375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.683858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.697361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.698129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.698615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.699164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.854571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:37.871086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c753226-ca9c-4a20-848a-d4b24d8ccfaf tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1230 microversion: 2.1 time: 0.195556 Sep 14 09:24:37.883925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 886/1562] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:37 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1230 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:37.885767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:37.886248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:37.903266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.904802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.905320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.906125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:37.906657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:37.907160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:37.948707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lazy-loading 'flavor' on Instance uuid 8fdce51e-4525-4474-8a93-d94757ecc840 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:38.080695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d4f5476-1dbe-4b5d-812b-9353c802777c tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840/action" status: 202 len: 0 microversion: 2.1 time: 0.205791 Sep 14 09:24:38.081415 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 887/1563] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:24:37 2022] POST /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:24:38.089302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:38.090251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:38.104447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.105628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.106313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.107448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.108031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.108637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.399686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:38.411759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7125c020-3511-4ed0-a534-1627a9e873ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.328358 Sep 14 09:24:38.412810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 888/1564] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:38 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:38.418279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:38.419175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:38.427775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.428376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.429241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.430257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.431116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.431716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.795227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:38.812360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2c82f7c-5f7c-4a8f-ba06-315a2466ee55 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1477 microversion: 2.1 time: 0.398090 Sep 14 09:24:38.839580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 889/1565] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:38 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:38.849534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:38.851620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:38.862233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.863426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.864489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.865487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:38.866534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:38.867240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:38.989134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:39.001321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:39.005407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:39.006851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-50e036d2-ca78-489a-a339-1424bd2b49aa tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.164659 Sep 14 09:24:39.019875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 890/1566] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:38 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:39.019875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:39.019875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:39.039332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.040620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.041475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:39.042252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.042846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.043509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:39.123854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:39.133334 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36ccd25c-5cfc-4898-964c-b8d04d1aff3d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1292 microversion: 2.1 time: 0.122674 Sep 14 09:24:39.134663 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 891/1567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:39 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1292 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:39.452574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:39.456114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:39.478531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.484187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.484644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:39.485387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.485843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.486355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:39.793609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:39.805604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b44e8cb-934d-4365-a792-1e80da26935a tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.369618 Sep 14 09:24:39.808129 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 892/1568] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:39 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:39.843785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:39.844432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:39.852660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.853186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.853651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:39.854371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:39.854869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:39.855244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.159039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:40.168756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d75a5a18-45d4-4ed2-bc91-425426d45beb tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1460 microversion: 2.1 time: 0.328837 Sep 14 09:24:40.185721 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 893/1569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:39 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1460 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:40.198070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:40.199402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:40.219941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.220210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.221967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.222750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.224258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.225493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.364303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:40.382847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:40.385015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:40.386861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3019cff7-c16d-487f-b4e2-81acc63e1b72 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.198878 Sep 14 09:24:40.388807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 894/1570] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:40 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:40.397794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:40.398921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:40.417438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.418420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.420189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.421181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.423148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.426346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.567263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:40.585983 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-925571ab-d6b7-4b10-ae65-409579919dcd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1292 microversion: 2.1 time: 0.195463 Sep 14 09:24:40.587753 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 895/1571] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:40 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1292 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:40.600222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:40.601271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:40.611553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.612228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.612673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:40.614130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:40.614634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:40.615339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:41.039667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-075734bb-42da-4d14-a0fc-ed8f8d1bcf68 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1613 microversion: 2.1 time: 0.449481 Sep 14 09:24:41.051922 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 896/1572] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:40 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1613 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:41.059315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:41.060382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:41.069908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:41.070457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:41.070942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:41.071702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:41.072351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:41.072773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:41.304902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:41.321047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c863ce50-8b4c-4924-bf09-8ee8de585083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.276267 Sep 14 09:24:41.321845 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 897/1573] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:41 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:41.590542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-389072569", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:41.677287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] validate_networks() for [('b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:42.398734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:42.399334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:42.399610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:42.400054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:42.400808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:42.422087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.422582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.423053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.423793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.424870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.425305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.452980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:42.462298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for user c9110ece398944bd9f4434b7e32b98cf and project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:42.475719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:42.478401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:42.576486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a648fd1c-a83c-4a6f-bb49-eac7ef4e2bc9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247085 Sep 14 09:24:42.577230 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 898/1574] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:42.584341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:42.602173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.602659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.603095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.603821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.616923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.617536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.714874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0aa3e79-58c9-401d-becd-7640b45bec26 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.134829 Sep 14 09:24:42.715504 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 899/1575] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:24:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:42.730118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:42.731379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:42.738068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.738843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.739529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.740459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.741363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.742211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.749506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:42.850953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:42.868212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:42.870044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:42.871372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91953bd1-9167-4dd9-8321-4b90534b9d97 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.150290 Sep 14 09:24:42.872167 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 900/1576] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:42 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:42.876686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:42.877377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:42.883737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.884242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.884680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:42.885380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:42.885875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:42.886251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:43.089350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:43.111378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96c704a5-1367-4deb-95cb-18152d645f26 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1359 microversion: 2.1 time: 0.238112 Sep 14 09:24:43.123920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 901/1577] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:42 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:43.142645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:43.173409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:43.182408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:43.183044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:43.183540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:43.184373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:43.185011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:43.185680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:43.775688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:43.793712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9696d6d2-a87b-422c-964f-bb521635348c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.672121 Sep 14 09:24:43.795717 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 902/1578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:43 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:43.810528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-479300300", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:43.940669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] validate_networks() for [('b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:44.849592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:44.850256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:44.850377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:44.850771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:44.851174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:44.866433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:44.867355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:44.867809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:44.868606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:44.869435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:44.870325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:44.898273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:44.909575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for user c9110ece398944bd9f4434b7e32b98cf and project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:44.942013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:44.945595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:44.999283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ddec3a45-587c-4997-9064-6b6eda70c3c9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199793 Sep 14 09:24:45.000258 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 903/1579] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:45.018772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-851028-12", "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:45.021896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:45.029847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.030670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.031337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.032302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.032977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.034116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.076223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Lazy-loading 'flavor' on Instance uuid 8fdce51e-4525-4474-8a93-d94757ecc840 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:45.098269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 8fdce51e-4525-4474-8a93-d94757ecc840 while it is in vm_state suspended Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Request method failure captured: Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840/action HTTP/1.1 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 98 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2vdTjgRMmtD3RKAWGiSUQSOc9V8kvOYlyp-32LBDLpHD_raGCmIMSK6swjltuPw7Nh0dN3g2wb4CNyAIk6p8rjGi8u0EbvdQj6m1DTm_rT5PQZd8doPC2ZB7yQ8ANNuR0i3Y0_Ap-Nvl0a8GGq9lYWIFytXTIy-zL1zs5ql6DZFRw Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2c12e1fe91fb4842afb8d45b96e9205a Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2c12e1fe91fb4842afb8d45b96e9205a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2c12e1fe91fb4842afb8d45b96e9205a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2c12e1fe91fb4842afb8d45b96e9205a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2c12e1fe91fb4842afb8d45b96e9205a"}]}] Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2c12e1fe91fb4842afb8d45b96e9205a Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1210471494 Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationNegativeTest-1210471494-project-admin Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 80887cc5f2e2414aa11355d2bee8b52d Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationNegativeTest-1210471494-project-admin Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: {"os-migrateLive": {"host": "n-h1-851028-12", "block_migration": true, "disk_over_commit": false}} Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'os-migrateLive' instance 8fdce51e-4525-4474-8a93-d94757ecc840 while it is in vm_state suspended Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fdce51e-4525-4474-8a93-d94757ecc840', 'body': {'os-migrateLive': {'host': 'n-h1-851028-12', 'block_migration': True, 'disk_over_commit': False}}} Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:45.100412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 8fdce51e-4525-4474-8a93-d94757ecc840 while it is in vm_state suspended Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 8fdce51e-4525-4474-8a93-d94757ecc840 while it is in vm_state suspended Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 8fdce51e-4525-4474-8a93-d94757ecc840 while it is in vm_state suspended {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:45.105712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33e7239a-5c8d-4051-abb4-39e0a17ad754 tempest-LiveMigrationNegativeTest-1210471494 tempest-LiveMigrationNegativeTest-1210471494-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840/action" status: 409 len: 155 microversion: 2.1 time: 0.091794 Sep 14 09:24:45.109512 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 904/1580] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:24:45 2022] POST /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:24:45.125713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:45.138536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.139578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.140307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.164394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] Creating event network-changed:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h1-851028-12 Sep 14 09:24:45.175337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9c8b63b8-58df-46bb-b3b0-95286fad21c7 req-32a2da7b-f08a-462e-9fae-89348f467bcf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051976 Sep 14 09:24:45.179141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 905/1581] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:45.187732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5ffacfc-191b-4211-81f8-0309a3fab328 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: .version_select at 0x7f69442a8310>, body: {"keypair": {"name": "tempest-keypair-1158249575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIZZ922Bgg1o7r7JHGQ6x+wuL586mwLyDA96gUGDk/7QHdgu3GQLBu01x/qJftl5O7E1MqWTmXjE4EtveDUcWOOMMyvYQVwVNCQNRrJ+HQ84PU7ogaHJQmpa8in8L0aSmw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:45.208187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b5ffacfc-191b-4211-81f8-0309a3fab328 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:45.213341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b5ffacfc-191b-4211-81f8-0309a3fab328 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:45.236656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:45.247570 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5ffacfc-191b-4211-81f8-0309a3fab328 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065412 Sep 14 09:24:45.253570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 906/1582] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:24:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:45.267564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:45.269271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:45.280077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.281056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.282063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.283304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.285185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.286408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.399388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:45.415712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:45.419214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:45.422604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8868a7a4-7f36-4181-8e3c-04083e7f9e86 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1366 microversion: 2.47 time: 0.165849 Sep 14 09:24:45.423162 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 907/1583] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:45 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:45.432939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:45.440172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:45.453523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.454042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.454488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.458345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.460846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.461555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.875350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:45.895467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01ee2297-a11c-4054-ad40-06a782a8da5d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1359 microversion: 2.1 time: 0.470871 Sep 14 09:24:45.896127 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 908/1584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:45 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:45.936929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:45.938326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:45.950158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.950158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.951393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:45.952168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:45.952622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:45.953056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:46.234027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:46.246888 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f503cee5-26de-41a2-bd80-0c0ac4bcbec1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.325911 Sep 14 09:24:46.248745 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 909/1585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:45 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:46.269058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:46.270140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:46.288393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:46.292852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:46.295497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:46.296444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:46.296916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:46.297366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:46.361042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:46.506649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-704873e2-30fc-4df1-b63f-242f99b3ecde tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 204 len: 0 microversion: 2.1 time: 0.255598 Sep 14 09:24:46.509334 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 910/1586] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:46 2022] DELETE /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:24:46.522696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-273692961", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "451", "networks": [{"uuid": "b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:46.602068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] validate_networks() for [('b79ec3f0-af6c-4f1c-9b03-20eddbfa6ae0', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:47.463299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:47.465337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:47.466304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:47.466924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:47.467555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:47.495012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:47.495975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:47.496657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:47.500581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:47.501969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:47.504864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:47.550323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:47.572941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Getting quotas for user c9110ece398944bd9f4434b7e32b98cf and project 113d4425ab5a4bd69e2a6d38d3528869. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:47.635616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:47.643147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:47.729193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a68fcc6-d2a5-4590-b70f-353ad24b5886 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.218112 Sep 14 09:24:47.738218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 911/1587] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:47.745022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:47.746374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:47.757984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:47.759148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:47.760781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:47.761992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:47.762851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:47.764792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:47.928847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:47.943816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:47.948471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:47.950638 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a35e4c8-55a8-4d43-a99e-11e145371001 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1372 microversion: 2.47 time: 0.210839 Sep 14 09:24:47.952387 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 912/1588] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:47 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:47.989073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:47.992721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:48.006012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:48.013951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:48.014635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:48.015454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:48.015934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:48.016394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:49.113955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:49.128968 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b973cc27-fa30-4b60-bd6e-0c9df873ffff tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1466 microversion: 2.1 time: 1.171658 Sep 14 09:24:49.129591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 913/1589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:47 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1466 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:49.155813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:49.177063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:49.192042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:49.194597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:49.196330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:49.201774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:49.202597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:49.203300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:49.604966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:49.614422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-faae4080-19e0-4819-963e-77caa81b5f91 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1359 microversion: 2.1 time: 0.466248 Sep 14 09:24:49.628031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 914/1590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:49 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1359 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:49.628031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:49.629508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:49.646332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:49.648927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:49.650241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:49.653814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:49.654725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:49.655363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:50.466328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:50.477722 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2eb61446-854f-4d11-a920-96ba0ec30e5b tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1515 microversion: 2.1 time: 0.859330 Sep 14 09:24:50.483216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 915/1591] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:49 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1515 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:50.493457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:50.494092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:50.513994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:50.514787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:50.515398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:50.516526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:50.517151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:50.517796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:51.125100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:51.141377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3874be75-99cc-456c-a96f-dd57f5571477 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1272 microversion: 2.1 time: 0.656277 Sep 14 09:24:51.142801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 916/1592] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:50 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1272 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:51.155391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-809191462", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a04cbd6c-4f78-440b-8f5b-69cafd708616"}], "security_groups": [{"name": "tempest-securitygroup--968714165"}], "key_name": "tempest-keypair-1158249575", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:51.354003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] validate_networks() for [('a04cbd6c-4f78-440b-8f5b-69cafd708616', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:24:52.395611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:24:52.406985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:24:52.407731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:24:52.409362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:24:52.412885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:24:52.444852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:52.449005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:52.450644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:52.455018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:52.456570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:52.459168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:52.557952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:24:52.569850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:24:52.609846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:24:52.614742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:24:52.775712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-535ee29e-c930-4e6b-8594-db3ce96c5267 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.630138 Sep 14 09:24:52.782024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 917/1593] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:24:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:24:52.808319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:52.809311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:52.825405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:52.830635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:52.831623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:52.836223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:52.837068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:52.839264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.047145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:53.054180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:53.069260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:53.072918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:53.075834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a919bef9-c233-451e-ad03-db1ac18cd94d tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1357 microversion: 2.47 time: 0.292287 Sep 14 09:24:53.079515 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 918/1594] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:24:52 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:53.092655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "name": "network-vif-plugged", "status": "completed", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:53.131524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.133008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.134161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.172990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] Creating event network-vif-plugged:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h1-851028-12 Sep 14 09:24:53.183394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-87fd0c01-716d-4563-b760-d34c7803907a req-03c1cba1-dc27-44f2-814c-3a23dddd37aa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102498 Sep 14 09:24:53.187014 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 919/1595] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:53.202066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:53.204886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:53.223181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.224448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.225187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.227395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.228281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.231849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.292531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.293778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.294648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.295343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lazy-loading 'fault' on Instance uuid 8fdce51e-4525-4474-8a93-d94757ecc840 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:24:53.750668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:53.766273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66314a64-b530-44bc-bd45-edd323cd6a42 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 200 len: 1309 microversion: 2.1 time: 0.576320 Sep 14 09:24:53.767329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 920/1596] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:53 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 1309 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:53.774720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:53.775702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:53.803433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.804291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.805724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:53.808802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:53.809494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:53.810142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:54.847103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:54.862225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5137a287-f89c-422c-8700-d9b9218c53fb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1359 microversion: 2.1 time: 1.092143 Sep 14 09:24:54.869885 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 921/1597] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:53 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1359 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:54.878461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fdce51e-4525-4474-8a93-d94757ecc840", "name": "network-vif-deleted", "tag": "e4ccb618-de82-48f7-8f9c-bc72a5d8e714"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:54.922141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:54.923202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:54.924137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:54.947815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] Creating event network-vif-deleted:e4ccb618-de82-48f7-8f9c-bc72a5d8e714 for instance 8fdce51e-4525-4474-8a93-d94757ecc840 on n-h2-851028-12 Sep 14 09:24:54.961160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5ea4546d-aa94-4cf1-bf4f-e7329813e40f req-fa62c572-544f-49ac-8d46-7756e0906dc1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089286 Sep 14 09:24:54.964331 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 922/1598] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:54.973936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:54.977613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:54.995427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:54.998696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:54.999403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:55.000441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:55.002569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:55.005078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:55.515554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:55.542696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba8b49b1-794c-4576-a4f3-267dcc6016ca tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1521 microversion: 2.1 time: 0.571301 Sep 14 09:24:55.544905 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 923/1599] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:54 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:55.557042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00e7b84-acbf-48cb-91d1-3b4278875b71", "tag": "4eecdbb4-04f3-4db6-95be-7515c7eab0b2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:55.606590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:55.608885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:55.609553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:55.638437 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] Creating event network-changed:4eecdbb4-04f3-4db6-95be-7515c7eab0b2 for instance e00e7b84-acbf-48cb-91d1-3b4278875b71 on n-h1-851028-12 Sep 14 09:24:55.646093 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-23b4d8dc-3d00-49be-acca-6fff7110d206 req-5a4536df-2846-471a-99b0-3120e6ff05d1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098303 Sep 14 09:24:55.647385 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 924/1600] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:55.682474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:55.683588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:55.698719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:55.702134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:55.704651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:55.705986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:55.712442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:55.713302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:56.789057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:56.798665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10f07952-2ae3-4017-a0d5-037373c4cf87 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 1.149698 Sep 14 09:24:56.817507 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 925/1601] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:55 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:56.827219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:56.828503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:56.836967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:56.838837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:56.839635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:56.844321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:56.848490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:56.849707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:56.993999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.013243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61ec3b62-04bc-47ba-ae58-0be9c4c0bf09 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1299 microversion: 2.1 time: 0.191770 Sep 14 09:24:57.026296 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 926/1602] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:56 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:57.038567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:57.045183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.047071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Searching by: {'deleted': False, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:24:57.054074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.054909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.055576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.057044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.057721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.060042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.215789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:24:57.323418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.332881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.338057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.338621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.355884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.357129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.475444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f2a079f-96ff-4174-89c0-39caac8b6205 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.445569 Sep 14 09:24:57.477624 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 927/1603] 10.222.0.90 () {60 vars in 1187 bytes} [Wed Sep 14 09:24:57 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:24:57.484630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:57.485433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 8fdce51e-4525-4474-8a93-d94757ecc840] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:57.497193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.498180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.498963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.499956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.500842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.501735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.537650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] HTTP exception thrown: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Request method failure captured: Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 HTTP/1.1 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2t-IIaFS2BL1CElvyJmchfpYgoz9-GSxxIkk7mMv0sxDFe3KDTCnV-DGi8SDzMUBPiBi8y1CVBGkPRcVMWNNuai68GEbi4jGEXFbuVy2I8s6Tm22djIbfz6vPo-VEUAr78sVp8kS4ux6qeduPsAjQ63OQ5H7CIVke8-C4HQr7kTrI Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4511fd917e2c4208ba618f490fc75d08 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4511fd917e2c4208ba618f490fc75d08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4511fd917e2c4208ba618f490fc75d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4511fd917e2c4208ba618f490fc75d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4511fd917e2c4208ba618f490fc75d08"}]}] Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4511fd917e2c4208ba618f490fc75d08 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationNegativeTest-421065891-project Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 54e076a4aa074ae0a34b9574cfd4a8ba Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationNegativeTest-421065891-project Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fdce51e-4525-4474-8a93-d94757ecc840'} Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:24:57.550462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Returning 404 to user: Instance 8fdce51e-4525-4474-8a93-d94757ecc840 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:24:57.556041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b28e91c-4925-4d88-bc58-84063466672b tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840" status: 404 len: 111 microversion: 2.1 time: 0.072965 Sep 14 09:24:57.564505 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 928/1604] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:57 2022] GET /compute/v2.1/servers/8fdce51e-4525-4474-8a93-d94757ecc840 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:24:57.572953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edef393-edfa-4999-b821-eb052e9c0693", "name": "network-vif-unplugged", "status": "completed", "tag": "91ff77ed-babd-46a1-ab8d-98f8153dc386"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:57.586095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.586636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.587066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.624719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] Creating event network-vif-unplugged:91ff77ed-babd-46a1-ab8d-98f8153dc386 for instance 3edef393-edfa-4999-b821-eb052e9c0693 on n-h2-851028-12 Sep 14 09:24:57.646154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-129f4037-a15a-46b1-8647-53820f9773f3 req-f115a13b-8e8c-4685-9b04-6c7bd01d8b14 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079211 Sep 14 09:24:57.646772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 929/1605] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:57.657423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:57.661649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:57.684639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.687569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.688875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.690699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:57.695855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:57.696619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:57.950964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:57.988358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9980babb-4230-44fb-beb3-60c44a860472 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1541 microversion: 2.1 time: 0.335265 Sep 14 09:24:58.007622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 930/1606] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:57 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1541 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:58.016307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:58.017348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:58.029300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.029974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.030583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.033124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.034741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.035155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.390351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:58.402467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9a27d31-88e2-4995-aabb-cb23d9a76f98 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1521 microversion: 2.1 time: 0.395443 Sep 14 09:24:58.402467 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 931/1607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:58 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:58.416192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad42d30-6426-4382-a73f-d01e686a7a97", "tag": "8fb85bcd-f8e1-45b2-a635-171bf5f950e2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:24:58.434992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.435733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.439740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.472618 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] Creating event network-changed:8fb85bcd-f8e1-45b2-a635-171bf5f950e2 for instance fad42d30-6426-4382-a73f-d01e686a7a97 on n-h1-851028-12 Sep 14 09:24:58.485766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5a62ce70-609f-476a-b2c7-418d60add0e5 req-f374c901-f88c-49e1-916f-6fe76cbc0495 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082352 Sep 14 09:24:58.490467 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 932/1608] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:58.498295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:58.506181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:58.523643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.524350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.526027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.526860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.528204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.529104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.591696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:58.860605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:58.874018 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7fc6bb2-c56e-4c51-a730-8d32c0ef9fcf tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "DELETE /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 204 len: 0 microversion: 2.47 time: 0.381928 Sep 14 09:24:58.874629 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 933/1609] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:24:58 2022] DELETE /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:24:58.886575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:58.891241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:58.913996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.916382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.919720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:58.921897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:58.923961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:58.924720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.025716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:24:59.208446 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ebb5a8e2-9c29-45a5-b302-fa3ea6a534f7 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "DELETE /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 204 len: 0 microversion: 2.1 time: 0.331679 Sep 14 09:24:59.208925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 934/1610] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:24:58 2022] DELETE /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:24:59.214138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:59.214850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:59.222713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.222713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.223273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.227102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.227102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.227404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.236266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:24:59.539618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:24:59.549069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e34b222e-49ea-47b7-ba3e-fea710b06e2d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 0.338914 Sep 14 09:24:59.554524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 935/1611] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:59 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:24:59.560211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:59.565837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:59.582129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.584362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.586429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.588958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.589566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.594109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.795294 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f52d35ae-ec4f-490e-b65e-ab329f1b10ad tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.239327 Sep 14 09:24:59.805121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 936/1612] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:24:59 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:24:59.812609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:24:59.813448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:24:59.829484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.832642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.833439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:24:59.834391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:24:59.835767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:24:59.836262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.283015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:00.293773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8588f764-5918-47fc-bb8c-77f5e1836880 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.487289 Sep 14 09:25:00.295651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 937/1613] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:24:59 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:00.319708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:00.320360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:00.327618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.328301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.328759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.331459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.332006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.332448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.472319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:00.496991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:00.502040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:00.505761 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c71e5e46-242e-409c-8f40-3e70db9b5722 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 200 len: 1363 microversion: 2.47 time: 0.191368 Sep 14 09:25:00.507111 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 938/1614] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:00 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:00.517247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:00.519654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:00.535416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.537039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.538286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.540051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.540676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.541685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.806862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:00.816836 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-570f6435-144b-43ed-a6e2-f29d35f6e672 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1473 microversion: 2.1 time: 0.307027 Sep 14 09:25:00.826115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 939/1615] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:00 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:00.838202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:00.838820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:00.864513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.865996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.866453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:00.867353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:00.867871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:00.868330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:01.113440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:01.125336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0d5ddb9-9e02-48b0-a6b6-818c7e5f5ccf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1521 microversion: 2.1 time: 0.297814 Sep 14 09:25:01.126162 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 940/1616] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:00 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:01.139362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00e7b84-acbf-48cb-91d1-3b4278875b71", "name": "network-vif-plugged", "status": "completed", "tag": "4eecdbb4-04f3-4db6-95be-7515c7eab0b2"}, {"server_uuid": "3edef393-edfa-4999-b821-eb052e9c0693", "name": "network-vif-plugged", "status": "completed", "tag": "91ff77ed-babd-46a1-ab8d-98f8153dc386"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:01.162209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:01.165113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:01.165688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:01.187100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Creating event network-vif-plugged:4eecdbb4-04f3-4db6-95be-7515c7eab0b2 for instance e00e7b84-acbf-48cb-91d1-3b4278875b71 on n-h1-851028-12 Sep 14 09:25:01.187553 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] Creating event network-vif-plugged:91ff77ed-babd-46a1-ab8d-98f8153dc386 for instance 3edef393-edfa-4999-b821-eb052e9c0693 on n-h2-851028-12 Sep 14 09:25:01.197621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e5b35152-8cc4-4b38-8f6f-03c21407481c req-17c2fb04-09b6-456b-9265-2a2a4fff910e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062220 Sep 14 09:25:01.198719 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 941/1617] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:01.204386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f946211-7fae-4e31-a023-f38a84f0eba0", "tag": "4d303c6b-22b5-4351-bea5-f6279f272c6d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:01.217028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:01.219509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:01.220634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:01.251195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] Creating event network-changed:4d303c6b-22b5-4351-bea5-f6279f272c6d for instance 7f946211-7fae-4e31-a023-f38a84f0eba0 on n-h2-851028-12 Sep 14 09:25:01.258474 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-86923001-9404-4630-9d54-49a68f113364 req-0855b9b8-f5f2-4d15-8e4f-53e363113bca service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057824 Sep 14 09:25:01.259365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 942/1618] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:01.282570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56bfa8ab-cc6c-4295-b478-b32a440a7b49", "tag": "240e3ba3-9852-4b02-b0d7-234acbe03731"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:01.310426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:01.312234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:01.312939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:01.326918 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] Creating event network-changed:240e3ba3-9852-4b02-b0d7-234acbe03731 for instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 on n-h2-851028-12 Sep 14 09:25:01.355504 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4718f874-8c23-47f9-bd8b-8c29fe065225 req-69109518-74a5-4220-887f-ee1fde013723 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094217 Sep 14 09:25:01.356473 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 943/1619] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:01.364455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:01.374553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:01.390495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:01.392505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:01.393426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:01.400157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:01.400916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:01.401995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:02.903009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:02.912655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4429f4a-a7c8-4fbb-a15c-e69f2bee73f2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 1.554563 Sep 14 09:25:02.930920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 944/1620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:01 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:02.936464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:02.937281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:02.948489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:02.949139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:02.949740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:02.951024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:02.951651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:02.953582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:03.522984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:03.533198 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-085ebcb4-f6d1-480b-91ab-8a2ee904ceca tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.599873 Sep 14 09:25:03.534446 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 945/1621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:02 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:03.540904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:03.541657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 63e2f400-529a-4aa2-90c4-868e67745611] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:03.555327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:03.555805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:03.556285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:03.557000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:03.557454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:03.557993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:03.592506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] HTTP exception thrown: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Request method failure captured: Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 HTTP/1.1 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2z_eF44jX-hPrjYaZ-_unIGidwn4V99eKsg_Q3M2nkQdOrRIYCecjQUlytUvGUzcL0pA6P9nctWOeM91BdvSRu_9rqIaXMsj26YiFFUG4gU4HWUK9p7PfhDzmRSK6gcGjKfeoz0pnVBh6yqcxG9xYbmnMGUuMqi00T25JZDobY6C4 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2b959f8e2a6348049d005f0f6511d0a6 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2b959f8e2a6348049d005f0f6511d0a6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2b959f8e2a6348049d005f0f6511d0a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2b959f8e2a6348049d005f0f6511d0a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2b959f8e2a6348049d005f0f6511d0a6"}]}] Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2b959f8e2a6348049d005f0f6511d0a6 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerShowV247Test-1267513340-project Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 97cabe6d64214cf1a165a87f4083e13d Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerShowV247Test-1267513340-project Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '63e2f400-529a-4aa2-90c4-868e67745611'} Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:03.594685 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. Sep 14 09:25:03.599076 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:03.600542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Returning 404 to user: Instance 63e2f400-529a-4aa2-90c4-868e67745611 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:25:03.604204 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcb71f5d-d106-485f-aa0e-c3658eea9ee7 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611" status: 404 len: 111 microversion: 2.47 time: 0.068310 Sep 14 09:25:03.606526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 946/1622] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:03 2022] GET /compute/v2.1/servers/63e2f400-529a-4aa2-90c4-868e67745611 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:25:03.612308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:03.616799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:03.630607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:03.631102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:03.631716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:03.632826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:03.633432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:03.634002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.088746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e076a4aa074ae0a34b9574cfd4a8ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4511fd917e2c4208ba618f490fc75d08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:04.108503 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3862be69-7890-4cd5-a44f-e4bf5a1e22a4 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 200 len: 1431 microversion: 2.1 time: 0.500651 Sep 14 09:25:04.111351 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 947/1623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:03 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 1431 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:04.128314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:04.129167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:04.151120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.155434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.156804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.162137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.162848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.167016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.628067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:04.654173 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30cdbf81-8b19-4f79-83d3-a9dbe0a1f593 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1506 microversion: 2.1 time: 0.537068 Sep 14 09:25:04.655460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 948/1624] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:04 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:04.666080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:04.688620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.689114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.700374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.732956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] Creating event network-changed:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h1-851028-12 Sep 14 09:25:04.739564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-dd410e9b-6ed5-4844-bdda-123a6213ac92 req-e6f8f79f-cdfb-4858-a82b-3c25de60453a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082825 Sep 14 09:25:04.740770 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 949/1625] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:04.745925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad42d30-6426-4382-a73f-d01e686a7a97", "name": "network-vif-plugged", "status": "completed", "tag": "8fb85bcd-f8e1-45b2-a635-171bf5f950e2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:04.758394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.759142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.759579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.776626 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] Creating event network-vif-plugged:8fb85bcd-f8e1-45b2-a635-171bf5f950e2 for instance fad42d30-6426-4382-a73f-d01e686a7a97 on n-h1-851028-12 Sep 14 09:25:04.782843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4f79cf37-2f05-4c5e-be26-cf46bf5739e3 req-9ca31daf-7074-472c-b75f-4cf5cf7fc6be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040551 Sep 14 09:25:04.785601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 950/1626] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:04.794555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:04.795456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:04.802164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.802971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.803708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.804676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:04.805202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:04.805847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:04.835829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:25:05.018511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13451d45-1245-44f6-9755-cb276acab53b tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870" status: 204 len: 0 microversion: 2.47 time: 0.229939 Sep 14 09:25:05.022629 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 951/1627] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:25:04 2022] DELETE /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:25:05.030757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:05.031735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:05.038739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:05.039483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:05.040127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:05.041092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:05.044031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:05.044737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:05.596238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:05.606103 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-830d84e6-012b-414b-8d38-98b66dc8302f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 0.582047 Sep 14 09:25:05.606718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 952/1628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:05 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:05.619267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947b1eb7-6bc7-4d76-bbd7-0694af424a40", "name": "network-vif-deleted", "tag": "87dfbd24-ee4e-4592-a872-f2beff052ca1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:05.649938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:05.650614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:05.651179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:05.670023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] Creating event network-vif-deleted:87dfbd24-ee4e-4592-a872-f2beff052ca1 for instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 on n-h1-851028-12 Sep 14 09:25:05.677658 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-81df3a93-196b-49b3-bfb9-5b53eb1811b0 req-2f9da792-6104-47e6-bccd-963378d85abf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069618 Sep 14 09:25:05.681791 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 953/1629] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:05.688816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:05.689553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:05.723769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:05.724307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:05.724743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:05.725461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:05.725907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:05.726329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:06.110668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:06.119923 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f5822fa-881c-43dc-a6bd-9a24c6e85c98 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.436754 Sep 14 09:25:06.126797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 954/1630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:05 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:06.132775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:06.139527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:06.149600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:06.150316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:06.150932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:06.151848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:06.152365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:06.152944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:06.182497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:06.492042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:06.505295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-973dbf22-899c-404b-ad23-22aa21772126 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 200 len: 1506 microversion: 2.1 time: 0.376143 Sep 14 09:25:06.522480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 955/1631] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:06 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:06.781876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2058062354", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "e89dd5d9-8c7b-47f2-bffb-01e041fc3362"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:06.851822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] validate_networks() for [('e89dd5d9-8c7b-47f2-bffb-01e041fc3362', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:07.136473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=14 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:07.322928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=39 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:07.541532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:07.542829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:07.544961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:07.546081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:07.548625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:07.576660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:07.577562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:07.578398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:07.580283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:07.581932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:07.582673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:07.643918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Getting quotas for project 4b7ae48800f84c6ea246e2888af654e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:07.649457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Getting quotas for user bdebcc0c9dd846dcb6509dfac741d621 and project 4b7ae48800f84c6ea246e2888af654e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:07.664553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:07.668254 n-d-851028-12 devstack@n-api.service[122444]: WARNING nova.utils [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2058062354 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-205806235 Sep 14 09:25:07.669450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:07.780548 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30bb8aca-316b-497f-9c32-8ce8efeca9fc tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272742 Sep 14 09:25:07.782306 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 956/1632] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:07.789474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:07.790340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:07.797638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:07.798720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:07.800468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:07.801796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:07.802651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:07.803470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:07.883689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:07.884439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:07.885037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:07.886437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lazy-loading 'fault' on Instance uuid 6b28546b-ef0b-41d5-90d6-11c55271e870 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:25:07.995675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:08.015138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:08.023230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '97cabe6d64214cf1a165a87f4083e13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b959f8e2a6348049d005f0f6511d0a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:08.024973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a56f7a5-35f1-4ac6-a9fc-780d539edd08 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870" status: 200 len: 1368 microversion: 2.47 time: 0.240955 Sep 14 09:25:08.026127 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 957/1633] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:07 2022] GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:08.034557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:08.040590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] [instance: 947b1eb7-6bc7-4d76-bbd7-0694af424a40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:08.064888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.067291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.068296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.084783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.086655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.087253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.138892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] HTTP exception thrown: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Request method failure captured: Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 HTTP/1.1 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2t-IIaFS2BL1CElvyJmchfpYgoz9-GSxxIkk7mMv0sxDFe3KDTCnV-DGi8SDzMUBPiBi8y1CVBGkPRcVMWNNuai68GEbi4jGEXFbuVy2I8s6Tm22djIbfz6vPo-VEUAr78sVp8kS4ux6qeduPsAjQ63OQ5H7CIVke8-C4HQr7kTrI Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4511fd917e2c4208ba618f490fc75d08 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4511fd917e2c4208ba618f490fc75d08", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4511fd917e2c4208ba618f490fc75d08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4511fd917e2c4208ba618f490fc75d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4511fd917e2c4208ba618f490fc75d08"}]}] Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4511fd917e2c4208ba618f490fc75d08 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-421065891 Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationNegativeTest-421065891-project Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 54e076a4aa074ae0a34b9574cfd4a8ba Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationNegativeTest-421065891-project Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '947b1eb7-6bc7-4d76-bbd7-0694af424a40'} Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:08.140915 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] Returning 404 to user: Instance 947b1eb7-6bc7-4d76-bbd7-0694af424a40 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f99e99d-c9ce-48e3-8dc6-4b4591e2e028 tempest-LiveMigrationNegativeTest-421065891 tempest-LiveMigrationNegativeTest-421065891-project] 10.222.0.90 "GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40" status: 404 len: 111 microversion: 2.1 time: 0.115129 Sep 14 09:25:08.145914 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 958/1634] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:08 2022] GET /compute/v2.1/servers/947b1eb7-6bc7-4d76-bbd7-0694af424a40 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:25:08.155299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:08.155835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:08.178680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.179179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.179759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.194564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.194564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.194564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.243970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:25:08.433298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-12d3283e-c888-42de-b33c-93333765a09e tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 204 len: 0 microversion: 2.1 time: 0.287244 Sep 14 09:25:08.439690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 959/1635] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:25:08 2022] DELETE /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:25:08.455388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:08.457038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:08.477753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.478245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.478673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.479391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.479845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.480282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.742099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:08.766166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efb553d7-2f3b-4187-affd-9c160180d6b3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 0.328225 Sep 14 09:25:08.766766 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 960/1636] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:08 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:08.784421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bfa8ab-cc6c-4295-b478-b32a440a7b49", "name": "network-vif-plugged", "status": "completed", "tag": "240e3ba3-9852-4b02-b0d7-234acbe03731"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:08.799131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.799984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.800425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.820174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] Creating event network-vif-plugged:240e3ba3-9852-4b02-b0d7-234acbe03731 for instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 on n-h2-851028-12 Sep 14 09:25:08.828205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-89beefe7-921b-4784-af4e-f54f927f23c6 req-61c65eae-a5fa-44a8-86a1-7ee33897d008 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060130 Sep 14 09:25:08.829548 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 961/1637] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:08.844203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:08.847873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:08.859545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.860921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.863631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:08.864633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:08.867703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:08.867703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:09.038671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:09.049100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-57c05bd5-9ae2-4ad8-806c-dc45eaee219e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.217335 Sep 14 09:25:09.050463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 962/1638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:08 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:09.069198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:09.069733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:09.080762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:09.081406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:09.082620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:09.082744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:09.083277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:09.083614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:09.179935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:09.189767 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-102c865c-c66c-4460-96ba-2c8eff78a884 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1236 microversion: 2.1 time: 0.138080 Sep 14 09:25:09.190617 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 963/1639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:09 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1236 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:09.195682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1691191152", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "12415fd1-eee7-4f0a-9e3d-a9fb12f3499a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:09.286164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] validate_networks() for [('12415fd1-eee7-4f0a-9e3d-a9fb12f3499a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:10.889609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:10.890871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:10.891878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:10.902837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:10.903586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:10.937643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:10.941813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:10.942504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:10.945692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:10.956272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:10.962451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:11.037489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:11.082117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:11.100358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for user e324dca163fb48d1841ee61468a1133b and project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:11.127514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:11.130964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:11.211848 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9012f2c5-872f-4f85-b5e3-39c50cc69ce5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.019984 Sep 14 09:25:11.213409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 964/1640] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:11.219853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:11.220748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] [instance: 6b28546b-ef0b-41d5-90d6-11c55271e870] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:11.231824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:11.233752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:11.235023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:11.236223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:11.236877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:11.237458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:11.272201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] HTTP exception thrown: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Request method failure captured: Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870 HTTP/1.1 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2z_eF44jX-hPrjYaZ-_unIGidwn4V99eKsg_Q3M2nkQdOrRIYCecjQUlytUvGUzcL0pA6P9nctWOeM91BdvSRu_9rqIaXMsj26YiFFUG4gU4HWUK9p7PfhDzmRSK6gcGjKfeoz0pnVBh6yqcxG9xYbmnMGUuMqi00T25JZDobY6C4 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2b959f8e2a6348049d005f0f6511d0a6 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2b959f8e2a6348049d005f0f6511d0a6", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2b959f8e2a6348049d005f0f6511d0a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2b959f8e2a6348049d005f0f6511d0a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2b959f8e2a6348049d005f0f6511d0a6"}]}] Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2b959f8e2a6348049d005f0f6511d0a6 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerShowV247Test-1267513340 Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerShowV247Test-1267513340-project Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 97cabe6d64214cf1a165a87f4083e13d Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerShowV247Test-1267513340-project Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6b28546b-ef0b-41d5-90d6-11c55271e870'} Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:11.273905 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. Sep 14 09:25:11.277230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:11.278879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] Returning 404 to user: Instance 6b28546b-ef0b-41d5-90d6-11c55271e870 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:25:11.279725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b7c5a7c-408d-44fe-8b47-dfa07601f542 tempest-ServerShowV247Test-1267513340 tempest-ServerShowV247Test-1267513340-project] 10.222.0.90 "GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870" status: 404 len: 111 microversion: 2.47 time: 0.065181 Sep 14 09:25:11.287680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 965/1641] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:11 2022] GET /compute/v2.1/servers/6b28546b-ef0b-41d5-90d6-11c55271e870 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:25:11.293310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:11.304834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:11.319403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:11.321151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:11.322775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:11.323564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:11.325332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:11.326805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:12.150350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:12.166678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7d570f8-9808-480a-96a2-0d4ebaa644e1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1320 microversion: 2.1 time: 0.875042 Sep 14 09:25:12.167836 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 966/1642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:11 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1320 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:12.191345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:12.193720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:12.219911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:12.225159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:12.225894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:12.226839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:12.230243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:12.230851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:12.728730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:12.744477 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87390dfe-b5db-4fb3-9037-73ac4a5ac6a3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.571545 Sep 14 09:25:12.747248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 967/1643] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:12 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:12.763574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:12.765485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:12.787640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:12.789289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:12.790314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:12.792979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:12.793520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:12.797784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.164146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:13.174748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10590b92-68a9-42f9-abbf-9adc8d0f39f7 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1290 microversion: 2.1 time: 0.425605 Sep 14 09:25:13.177738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 968/1644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:12 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1290 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:13.194305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-060c659b-abb4-4ac4-bdee-14f2987b7663 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Action: 'create', calling method: .version_select at 0x7f693fe015e0>, body: {"keypair": {"name": "tempest-keypair-1805745574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkQBO0xweEZb6Yjs5KIaschL3EtPnwD3nL82FcebFGNiJr1z5fQFm5oJ9yLn7eudLgy7GQrcD9KfVVX/fv0cKpqiIMifaehlqIypfIXnzTu49mg1Rc24dZn7/u0CbvvcQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:13.235429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-060c659b-abb4-4ac4-bdee-14f2987b7663 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Getting quotas for project c13dda24ab614859ad25993717e7235d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:13.242429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-060c659b-abb4-4ac4-bdee-14f2987b7663 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Getting quotas for user ebb3a51601cf4b1eb53a185555ee574e and project c13dda24ab614859ad25993717e7235d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:13.291198 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-060c659b-abb4-4ac4-bdee-14f2987b7663 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.110634 Sep 14 09:25:13.293642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 969/1645] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:25:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:25:13.301864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f946211-7fae-4e31-a023-f38a84f0eba0", "name": "network-vif-plugged", "status": "completed", "tag": "4d303c6b-22b5-4351-bea5-f6279f272c6d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:13.315628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.316520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.317315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.348826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] Creating event network-vif-plugged:4d303c6b-22b5-4351-bea5-f6279f272c6d for instance 7f946211-7fae-4e31-a023-f38a84f0eba0 on n-h2-851028-12 Sep 14 09:25:13.366174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-21a8a9e7-3591-4233-8726-7819aeaaee75 req-f56bbc80-00ce-4326-851a-674b9e6d2dc6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064632 Sep 14 09:25:13.382961 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 970/1646] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:13.393771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:13.394848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:13.402896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.403727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.404431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.405482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.406086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.407162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.578175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:13.594651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a720130-8c15-43f0-8aa9-dd1875c30259 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1270 microversion: 2.1 time: 0.207625 Sep 14 09:25:13.613224 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 971/1647] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:13 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:13.620686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3edef393-edfa-4999-b821-eb052e9c0693", "name": "network-vif-deleted", "tag": "91ff77ed-babd-46a1-ab8d-98f8153dc386"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:13.635933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.636526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.636957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.654649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] Creating event network-vif-deleted:91ff77ed-babd-46a1-ab8d-98f8153dc386 for instance 3edef393-edfa-4999-b821-eb052e9c0693 on n-h2-851028-12 Sep 14 09:25:13.661913 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6a5058d3-078c-4ef4-8e78-3bef34e6990e req-dd7da51a-89cf-47bc-a82d-b96557c63452 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046667 Sep 14 09:25:13.662853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 972/1648] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:13.670101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:13.670983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:13.681326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.681512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.682100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:13.683051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:13.684021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:13.685821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:14.220741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:14.233328 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5ba0b9a-e01b-45d7-8abb-c12f4c6b694e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1510 microversion: 2.1 time: 0.568931 Sep 14 09:25:14.254246 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 973/1649] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:13 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:14.254246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:14.254246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:14.275468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:14.275986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:14.279052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:14.280583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:14.284083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:14.284638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:14.732026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:14.748506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-493a012b-04d4-4f37-9491-4432458d9013 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1366 microversion: 2.1 time: 0.502926 Sep 14 09:25:14.748506 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 974/1650] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:14 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1366 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:14.770217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:14.770742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:14.778020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:14.778868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:14.779630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:14.780777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:14.787308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:14.787308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:14.816186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:15.093081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:15.103680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c83dfb3c-2486-4894-9305-16973ae6268f tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1332 microversion: 2.1 time: 0.337950 Sep 14 09:25:15.105484 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 975/1651] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:14 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1332 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:15.110774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:15.111764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:15.119077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:15.119983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:15.120615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:15.121613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:15.122085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:15.122532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:15.506997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:15.518254 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-268ec3db-84f6-4880-b65c-b7643060f6fe tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1510 microversion: 2.1 time: 0.410939 Sep 14 09:25:15.532202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 976/1652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:15 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:15.792489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cde7ac6a-9d3f-494c-a004-797e35355cb9 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] Calling method '.version_select at 0x7f6944131280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:15.809376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cde7ac6a-9d3f-494c-a004-797e35355cb9 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.275143 Sep 14 09:25:15.817967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 977/1653] 10.222.0.90 () {60 vars in 1226 bytes} [Wed Sep 14 09:25:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:25:15.825310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:15.828149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:15.836693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:15.837478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:15.838384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:15.839321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:15.839988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:15.840592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:16.362941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:16.371256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62e79a70-bd79-48b3-972f-79ffcf9741b8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1318 microversion: 2.1 time: 0.551886 Sep 14 09:25:16.371979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 978/1654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:15 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1318 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:16.376852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:16.377760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:16.390983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:16.391553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:16.392191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:16.392948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:16.393908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:16.394398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:16.779736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:16.801305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e0c618e-f934-4c63-90db-ef6cb8ebf620 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 200 len: 1510 microversion: 2.1 time: 0.426166 Sep 14 09:25:16.804060 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 979/1655] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:16 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 1510 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:16.813870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:16.815464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:16.828437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:16.830115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:16.832496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:16.836223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:16.837457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:16.838556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:17.680734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:17.689497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef9ba6e9-4586-4804-82a8-70dd37e67e3a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1556 microversion: 2.1 time: 0.883148 Sep 14 09:25:17.693975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 980/1656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:16 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1556 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:17.711963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef58d8b9-654d-4291-be17-c3fa8d25d615 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] Action: 'update', calling method: .version_select at 0x7f693f762f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:18.040768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef58d8b9-654d-4291-be17-c3fa8d25d615 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.344755 Sep 14 09:25:18.041526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 981/1657] 10.222.0.90 () {62 vars in 1247 bytes} [Wed Sep 14 09:25:17 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:25:18.057439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:18.060569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:18.068984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:18.069836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:18.070347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:18.071958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:18.072520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:18.073297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:18.371120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:18.385993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6a7b7e0-c459-41f2-ade6-7d706f899576 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1332 microversion: 2.1 time: 0.338888 Sep 14 09:25:18.387045 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 982/1658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:18 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1332 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:18.402587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1415692347", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cfaf718e-93b0-4f74-b51b-661ecfb90acd"}, {"port": "6a581793-98cc-4eee-ab3b-e21fbb6ea27b", "tag": "port-1"}, {"port": "231602c2-98b1-46f5-b9ea-3c91cad92811", "tag": "port-2"}, {"uuid": "ce40cc1c-21be-4e89-bbc2-054c9304382a", "tag": "net-1"}, {"uuid": "ce40cc1c-21be-4e89-bbc2-054c9304382a"}, {"uuid": "ded26e94-3a34-4d28-95bc-eb266fa92d9c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "ded26e94-3a34-4d28-95bc-eb266fa92d9c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "09e7e394-c396-42ae-ae61-4c396b335012", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6169d9ca-5e26-4b8f-82e2-c7bc56bff9b9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1dba2776-952c-4d93-afd8-1c7b9ca6f73d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1501412605"}], "key_name": "tempest-keypair-1805745574", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:18.622664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] validate_networks() for [('cfaf718e-93b0-4f74-b51b-661ecfb90acd', None, None, None, None, None), (None, None, '6a581793-98cc-4eee-ab3b-e21fbb6ea27b', None, None, None), (None, None, '231602c2-98b1-46f5-b9ea-3c91cad92811', None, None, None), ('ce40cc1c-21be-4e89-bbc2-054c9304382a', None, None, None, None, None), ('ce40cc1c-21be-4e89-bbc2-054c9304382a', None, None, None, None, None), ('ded26e94-3a34-4d28-95bc-eb266fa92d9c', '10.2.2.100', None, None, None, None), ('ded26e94-3a34-4d28-95bc-eb266fa92d9c', '10.2.2.200', None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:21.015348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:21.368100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:21.368522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:21.368994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:21.369405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:21.369814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:21.385641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:21.386368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:21.386814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:21.387559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:21.388179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:21.388553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:21.413909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Getting quotas for project c13dda24ab614859ad25993717e7235d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:21.416373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=11,nova_api:UPDATE=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:21.419993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Getting quotas for user ebb3a51601cf4b1eb53a185555ee574e and project c13dda24ab614859ad25993717e7235d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:21.618563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:21.621567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='09e7e394-c396-42ae-ae61-4c396b335012',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6169d9ca-5e26-4b8f-82e2-c7bc56bff9b9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1dba2776-952c-4d93-afd8-1c7b9ca6f73d',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:22.066918 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3fc5dcd-5e09-4cb9-a2b0-531f183885ab tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 3.678404 Sep 14 09:25:22.067952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 983/1659] 10.222.0.90 () {62 vars in 1189 bytes} [Wed Sep 14 09:25:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 3680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:25:22.090159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:22.097467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:22.099170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:22.122194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.122917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.123496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.124586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.125251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.125832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.248433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:22.374915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:22.384230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.384996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.385573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.540864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b3bd763-3bb0-46d4-9459-144604069a7e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.464070 Sep 14 09:25:22.552758 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 984/1660] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:25:22 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:22.559026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd", "tag": "0e16186c-a7d5-480d-be85-ba70f269673e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:22.571741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.572980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.573635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.588940 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] Creating event network-changed:0e16186c-a7d5-480d-be85-ba70f269673e for instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd on n-h2-851028-12 Sep 14 09:25:22.596494 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-39011772-38e7-4942-9243-6ec7703cc05b req-b07a23b3-35ca-4138-aec8-c9cc8514e75b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042168 Sep 14 09:25:22.600210 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 985/1661] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:22.605609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:22.606193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:22.614097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.614639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.615022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.615697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.616241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.616599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.929067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:22.940708 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dec5f20a-36d2-48c8-8480-280fc96168bf tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1318 microversion: 2.1 time: 0.338574 Sep 14 09:25:22.943167 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 986/1662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:22 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1318 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:22.960298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:22.960795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:22.976087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.976595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.977342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:22.978297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:22.978781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:22.979217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:23.106678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fe80be4-42b8-436f-a9c2-e5c9667894ff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160939 Sep 14 09:25:23.106678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 987/1663] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:25:22 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:23.114250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7cef6a2-1421-4ee2-b96d-090204e5fc57 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] Calling method '.version_select at 0x7f693fa58430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:23.135305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7cef6a2-1421-4ee2-b96d-090204e5fc57 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.025208 Sep 14 09:25:23.138977 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 988/1664] 10.222.0.90 () {60 vars in 1226 bytes} [Wed Sep 14 09:25:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:25:23.149176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:23.150159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:23.157299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:23.158226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:23.169188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:23.169929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:23.170415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:23.170848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:23.428426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:23.446467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a86e8e6-7786-4899-94e8-540a559fdae8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1332 microversion: 2.1 time: 0.303841 Sep 14 09:25:23.447131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 989/1665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:23 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1332 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:23.540033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1562601501", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:23.616815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:24.366321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:24.367395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:24.368046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:24.368592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:24.369147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:24.380993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.381747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.382178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:24.382952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.383755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.384563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:24.433131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:24.440898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:24.464315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:24.467146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:24.548092 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8cabe09-0120-48c2-8d46-242c42168b8f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098952 Sep 14 09:25:24.559493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 990/1666] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:24.566574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:24.567461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:24.576730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.577626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.578352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:24.579574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.580260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.582816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:24.822877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:24.836797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:24.843738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:24.845144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d41561d-3f87-4dbc-a9bc-568299e35851 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1594 microversion: 2.32 time: 0.284179 Sep 14 09:25:24.845971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 991/1667] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:24 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1594 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:24.874179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:24.879515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:24.891692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-389072569', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:24.920629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.927466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.928098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:24.928910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:24.929524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:24.929978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:25.229350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:25.439528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:25.447531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:25.448184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:25.448697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:25.708414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66324634-0d22-42ec-9220-64533aa166c1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-389072569" status: 200 len: 1513 microversion: 2.1 time: 0.838567 Sep 14 09:25:25.712507 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 992/1668] 10.222.0.90 () {58 vars in 1261 bytes} [Wed Sep 14 09:25:24 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-389072569 => generated 1513 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:25.742512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3638ddd2-e55d-43d4-ae1b-6b633b862911 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] Action: 'update', calling method: .version_select at 0x7f693f9de550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:25.925263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3638ddd2-e55d-43d4-ae1b-6b633b862911 tempest-QuotaClassesAdmin257Test-953647266 tempest-QuotaClassesAdmin257Test-953647266-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.210976 Sep 14 09:25:25.932804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 993/1669] 10.222.0.90 () {62 vars in 1247 bytes} [Wed Sep 14 09:25:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:25:25.978579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca862d-f120-453f-984f-5858f579a581", "name": "network-vif-plugged", "status": "completed", "tag": "ea37a2a1-fb1b-40d5-bb47-eb7a38cac317"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:26.007832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:26.009276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:26.009276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:26.030266 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] Creating event network-vif-plugged:ea37a2a1-fb1b-40d5-bb47-eb7a38cac317 for instance 9fca862d-f120-453f-984f-5858f579a581 on n-h1-851028-12 Sep 14 09:25:26.051138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-86335d75-76cb-43ef-8261-64019cb4ccf5 req-83d3b224-1cae-47cb-89da-f4a08711f01f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089317 Sep 14 09:25:26.052274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 994/1670] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:26.058222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:26.063358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:26.083594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:26.084360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:26.085504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:26.086680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:26.087287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:26.088353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.462859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:27.474643 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7514ad34-5e49-46d7-8c1a-ae9ad520de22 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1318 microversion: 2.1 time: 1.421050 Sep 14 09:25:27.478213 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 995/1671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:26 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1318 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:27.497094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:27.498077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:27.529973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.531000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.531754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.533405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.534240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.537718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.908366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:27.927547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d648dae-380b-4661-8c56-a73307c544b8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1332 microversion: 2.1 time: 0.447150 Sep 14 09:25:27.939929 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 996/1672] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:27 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1332 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:27.939929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:27.939929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:27.950133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.952523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.952997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:27.955214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:27.956287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:27.957145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:28.121332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:28.132992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:28.138381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-50a29432-942c-49e5-9e0a-1d67db8b348d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1251 microversion: 2.1 time: 0.206837 Sep 14 09:25:28.139016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 997/1673] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:27 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1251 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:28.149235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fca862d-f120-453f-984f-5858f579a581", "tag": "ea37a2a1-fb1b-40d5-bb47-eb7a38cac317"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:28.170530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:28.178810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:28.179449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:28.201610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] Creating event network-changed:ea37a2a1-fb1b-40d5-bb47-eb7a38cac317 for instance 9fca862d-f120-453f-984f-5858f579a581 on n-h1-851028-12 Sep 14 09:25:28.208444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3fb40e3d-4a59-4569-83d7-c2def6730467 req-b3207bc1-c79d-492b-825b-5a7155a7f437 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062668 Sep 14 09:25:28.209526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 998/1674] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:28.220073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f946211-7fae-4e31-a023-f38a84f0eba0", "tag": "4d303c6b-22b5-4351-bea5-f6279f272c6d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:28.247331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:28.248097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:28.251270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:28.282470 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] Creating event network-changed:4d303c6b-22b5-4351-bea5-f6279f272c6d for instance 7f946211-7fae-4e31-a023-f38a84f0eba0 on n-h2-851028-12 Sep 14 09:25:28.291046 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0b29567c-3967-4305-aded-9b1d4a15d723 req-4ac49671-ff18-43a2-8efb-02f3e11f8d6d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079950 Sep 14 09:25:28.296305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 999/1675] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:28.313520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:28.331344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:28.338076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:28.344271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:28.344755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:28.345812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:28.353393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:28.354116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:28.354692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:28.614186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:28.725879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:28.738943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:28.739638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:28.740224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:29.356544 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a54ad419-aff3-4fdf-8097-2f146df19b68 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4513 microversion: 2.1 time: 1.057963 Sep 14 09:25:29.357379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1000/1676] 10.222.0.90 () {58 vars in 1173 bytes} [Wed Sep 14 09:25:28 2022] GET /compute/v2.1/servers/detail?status=active => generated 4513 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:29.363042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:29.364619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:29.382400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:29.383177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:29.384451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:29.385432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:29.386160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:29.387051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.260302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:30.270257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:30.271705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:30.272933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc260253-3ab2-4075-b4c4-a40104465bd3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1709 microversion: 2.32 time: 0.914327 Sep 14 09:25:30.291374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1001/1677] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:29 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1709 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:30.296136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd", "name": "network-vif-plugged", "status": "completed", "tag": "0e16186c-a7d5-480d-be85-ba70f269673e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:30.308214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:30.309048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:30.309499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.324427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] Creating event network-vif-plugged:0e16186c-a7d5-480d-be85-ba70f269673e for instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd on n-h2-851028-12 Sep 14 09:25:30.329424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6f2db6cc-0c2a-46e6-b301-3a7c813fd86d req-be75a941-f042-4f06-9712-2ee6d8bec863 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036815 Sep 14 09:25:30.334583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1002/1678] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:30.341095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:30.342064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:30.363746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:30.367455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:30.368468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.369783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:30.370535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:30.371137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.745500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:30.754703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-addd736d-9d75-4dcd-8081-f7256185b19f tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1508 microversion: 2.1 time: 0.418563 Sep 14 09:25:30.755281 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1003/1679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:30 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1508 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:30.776763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:30.777618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:30.795030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:30.795712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:30.796540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:30.797265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:30.797719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:30.798312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:31.130203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:31.140040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4c1c584-8c14-41e8-a28b-4edfc818e1da tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1332 microversion: 2.1 time: 0.374724 Sep 14 09:25:31.140820 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1004/1680] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:30 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1332 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:31.146004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:31.151438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:31.158233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:31.165052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:31.165385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:31.166446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:31.167467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:31.167467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:31.447940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:31.458329 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e107cd3-4274-41fc-93db-405bcd706a6f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1293 microversion: 2.1 time: 0.316308 Sep 14 09:25:31.459254 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1005/1681] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:31 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1293 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:31.464789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:31.470072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:31.470916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Removing options 'limit' from query {{(pid=122444) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:25:31.472554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:31.480872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:31.481749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:31.482485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:31.483500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:31.484150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:31.484769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:31.540279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:31.552819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:31.553335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:31.553782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:32.288801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20cba934-7a0a-45aa-aed4-a0f16dce538e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.826579 Sep 14 09:25:32.290017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1006/1682] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 09:25:31 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:32.297974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:32.299436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:32.308951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:32.309206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:32.311576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:32.311576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:32.311576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:32.311576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:32.709994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:32.724489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37092864-c3e7-40ab-a5ec-04318a5de8ee tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1508 microversion: 2.1 time: 0.433172 Sep 14 09:25:32.726294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1007/1683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:32 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1508 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:32.888856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-384429724", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:32.984233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:33.363460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:33.364124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:33.364879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:33.365506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:33.366168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:33.378025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.378930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.379765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.380967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.381753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.382436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.399546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:33.406711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:33.414121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for user fff8ac76bff9488bbd3718967820c39a and project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:33.431006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:33.434141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:33.494360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1b28d85-865a-48de-89d8-a906ffdae139 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766348 Sep 14 09:25:33.495340 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1008/1684] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:33.507247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:33.508178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:33.529993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.531028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.531637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.532724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.533329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.534285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.858285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:33.873585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:33.875785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:33.877304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6246d1a8-db83-4bf4-8c6a-00048595758c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1803 microversion: 2.32 time: 0.380803 Sep 14 09:25:33.878711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1009/1685] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:33 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1803 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:33.885653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6451f43a-0e55-47d2-95a2-120bac6a767c", "tag": "7a3abbcb-0688-45c8-86c0-d0a92af48961"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:33.900395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.901177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.904785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.931305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] Creating event network-changed:7a3abbcb-0688-45c8-86c0-d0a92af48961 for instance 6451f43a-0e55-47d2-95a2-120bac6a767c on n-h1-851028-12 Sep 14 09:25:33.937879 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-37034632-2240-4d52-a5c2-41d5ca629536 req-089618c4-25a7-4b4c-a887-95c15c5b1297 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057460 Sep 14 09:25:33.939632 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1010/1686] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:33.946874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:33.947705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:33.957011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.957508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.957951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:33.958842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:33.959407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:33.960010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.345517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:34.353886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dd512d7-12b0-4fbc-aad4-10dd49fbb542 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1536 microversion: 2.1 time: 0.412698 Sep 14 09:25:34.364715 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1011/1687] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:33 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1536 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:34.380535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:34.387079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:34.388194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:34.394514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.395231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.395832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.396765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.397362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.397953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.513231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:34.597098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19402153-baa3-4ccc-b09a-0e33dc26f3d4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.230162 Sep 14 09:25:34.598222 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1012/1688] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:25:34 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:34.604315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:34.605075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:34.613533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.616334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.616823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.617591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.618059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.618526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.927923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:34.941699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-097fbfd6-138f-462d-9379-2d72bac5d5c8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1293 microversion: 2.1 time: 0.340666 Sep 14 09:25:34.942591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1013/1689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:34 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1293 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:34.965530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:34.968374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:34.976742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.977351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.978002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:34.979027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:34.979386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:34.980005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:35.085397 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2165a9c5-460c-4135-9017-aa4f7dc578a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "PUT /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1080 microversion: 2.1 time: 0.123848 Sep 14 09:25:35.102596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1014/1690] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:25:34 2022] PUT /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1080 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:35.114045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-444134547", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:35.185515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:35.686214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:35.687961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:35.689038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:35.689739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:35.691171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:35.713410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:35.714371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:35.715800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:35.717103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:35.718155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:35.718939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:35.757155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:35.776694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for user fff8ac76bff9488bbd3718967820c39a and project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:35.797784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:35.810666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:35.914854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d19989b-b14b-4a9c-85a5-94558b794a16 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810084 Sep 14 09:25:35.923119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1015/1691] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:35.932044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a565940-b191-433b-ab7b-a6f0da8a3bef tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'create', calling method: .version_select at 0x7f693f119b80>, body: {"pool": "76214266-b29b-429f-97e6-62240ee2e9e9"} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:39.626719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a565940-b191-433b-ab7b-a6f0da8a3bef tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.702132 Sep 14 09:25:39.628374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1016/1692] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:25:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:39.633581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:39.640264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:39.640722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Removing options 'limit' from query {{(pid=122444) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:25:39.641392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:39.647925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:39.648665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:39.648854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:39.649870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:39.650040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:39.650476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:39.683281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:39.702696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:39.717883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73ea8c34-210c-4528-ba0a-814202875bff tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.088264 Sep 14 09:25:39.718834 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1017/1693] 10.222.0.90 () {58 vars in 1150 bytes} [Wed Sep 14 09:25:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:39.724308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:39.725119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:39.732843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:39.733905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:39.734543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:39.735265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:39.735986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:39.736580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.174302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:40.189197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:40.191795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:40.193272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5968489d-0527-4728-acac-8ee38e36b0bb tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1871 microversion: 2.32 time: 0.473225 Sep 14 09:25:40.193948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1018/1694] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:39 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1871 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:40.199452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:40.200368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:40.208137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.209382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.210048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.210987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.211661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.212324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.537400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:40.548039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-929c85b8-4127-476a-87f9-50d30b5e82da tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1506 microversion: 2.1 time: 0.352742 Sep 14 09:25:40.549451 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1019/1695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:40 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:40.555922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:40.556724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:40.563308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.564164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.564805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.566625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.567421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.568429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.905295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d858b65-09b2-4958-8985-eb5da9d6054b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1812 microversion: 2.1 time: 0.353196 Sep 14 09:25:40.919996 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1020/1696] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:40 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1812 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:40.919996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:40.919996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:40.929341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.929341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.929341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:40.929341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:40.930466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:40.931007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.255926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:41.264665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00014700-c013-43d5-8f1d-7543c9bca3ed tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1313 microversion: 2.1 time: 0.353805 Sep 14 09:25:41.265350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1021/1697] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:40 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1313 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:41.278484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:41.279639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:41.288485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.289645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.290275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.290994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.291857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.292316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.671880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:41.686702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-088afbd3-ca69-429f-8ca0-a943025784f2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1293 microversion: 2.1 time: 0.414137 Sep 14 09:25:41.687304 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1022/1698] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:41 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1293 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:41.706646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "2ce7fcce-4b40-48f5-85a2-e418e5efd248"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:41.718031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.720942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.722003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.755015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] Creating event network-changed:2ce7fcce-4b40-48f5-85a2-e418e5efd248 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:41.764123 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5113a3e1-92c0-4ab6-9a2f-84f40f62cf06 req-555f8a47-214c-4b89-b3ba-defcf9a9b0ef service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072772 Sep 14 09:25:41.768345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1023/1699] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:41.779137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:41.793297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.794154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.795312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.809052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] Creating event network-changed:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:25:41.815723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f4080f3b-6bab-4e24-95f8-f461fb97cb79 req-d40364ba-e70b-44f1-ae69-8251e24c263f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040466 Sep 14 09:25:41.817256 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1024/1700] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:41.823162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6451f43a-0e55-47d2-95a2-120bac6a767c", "name": "network-vif-plugged", "status": "completed", "tag": "7a3abbcb-0688-45c8-86c0-d0a92af48961"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:41.835521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.836490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.837145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.858240 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] Creating event network-vif-plugged:7a3abbcb-0688-45c8-86c0-d0a92af48961 for instance 6451f43a-0e55-47d2-95a2-120bac6a767c on n-h1-851028-12 Sep 14 09:25:41.870190 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-be835ae8-92d5-4270-b469-a7ab434eb81b req-57b02ebd-6b8b-40f1-8e2d-ad96e690ff8b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050352 Sep 14 09:25:41.872472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1025/1701] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:41.885103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.129"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:41.889769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:41.898808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.899296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.899731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.900566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:41.901022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:41.901443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:41.950974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:25:41.951733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquired lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:25:45.044409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:25:45.787564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:46.051671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Updating instance_info_cache with network_info: [{"id": "0e16186c-a7d5-480d-be85-ba70f269673e", "address": "fa:16:3e:66:08:fe", "network": {"id": "e89dd5d9-8c7b-47f2-bffb-01e041fc3362", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-208566298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b7ae48800f84c6ea246e2888af654e2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e16186c-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:25:46.072268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Releasing lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:25:46.074174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c655620-8b75-46fb-bfdb-6f7fe570ff9e tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 202 len: 0 microversion: 2.1 time: 4.200003 Sep 14 09:25:46.075723 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1026/1702] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:25:41 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 0 bytes in 4203 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:25:46.095211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:46.104559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:46.105683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:46.119817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.120540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.120989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.121729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.122406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.122993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.162371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:46.203498 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5faf5208-1ea5-4472-bb10-c7b5b99434e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.122252 Sep 14 09:25:46.204483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1027/1703] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:25:46 2022] GET /compute/v2.1/servers => generated 1009 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:46.210027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:46.210675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:46.217299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.217804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.218283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.219005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.219463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.219921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.497525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:46.510654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-629be4b9-3952-4dee-9fda-f7e6e5216ba5 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1506 microversion: 2.1 time: 0.305321 Sep 14 09:25:46.524796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1028/1704] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:46 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:46.531819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:46.535588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.536121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.536583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.537509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.537971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.538395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.570265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ce37892-8885-4775-808c-dc72c810b1a1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.044081 Sep 14 09:25:46.571158 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1029/1705] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:25:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:46.576226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:46.576782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:46.585067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.585555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.585993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.586690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.587135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.587563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.889735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:46.904330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:46.910052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:46.915537 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56e2c837-20f0-4a9e-8ec6-f9f76a91aea0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.343295 Sep 14 09:25:46.918410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1030/1706] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:46 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:46.948412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:46.948412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:46.953742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.955390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.955390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:46.955690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:46.957557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:46.958059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:47.219638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:47.228293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9012eb7e-9c41-426f-ad44-d7d0b23623f5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1313 microversion: 2.1 time: 0.307582 Sep 14 09:25:47.229132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1031/1707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:46 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:47.234616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:47.235241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:47.244994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:47.245583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:47.246520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:47.247238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:47.247808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:47.248439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:47.710469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:47.721017 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8f9367b-7de2-4595-aa9b-13a9485c5c1a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1474 microversion: 2.1 time: 0.490644 Sep 14 09:25:47.722289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1032/1708] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:47 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1474 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:47.728684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "6a581793-98cc-4eee-ab3b-e21fbb6ea27b"}, {"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "231602c2-98b1-46f5-b9ea-3c91cad92811"}, {"name": "network-changed", "server_uuid": "5688ca53-9b1d-4ac5-8961-ca20b218ea40", "tag": "e6587b73-159e-49e3-94fd-6c5a594d7777"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:47.743640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:47.744575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:47.745414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:47.764789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Creating event network-changed:6a581793-98cc-4eee-ab3b-e21fbb6ea27b for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:47.765476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Creating event network-changed:231602c2-98b1-46f5-b9ea-3c91cad92811 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:47.766120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] Creating event network-changed:e6587b73-159e-49e3-94fd-6c5a594d7777 for instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 on n-h1-851028-12 Sep 14 09:25:47.776592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-50d2c404-c998-4991-b303-fd3c167da812 req-63badfa9-f8ac-4d34-974d-dba678c9b2f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.052810 Sep 14 09:25:47.777929 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1033/1709] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:47.785778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "name": "network-vif-plugged", "status": "completed", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:47.799223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:47.800532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:47.801008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:47.819367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] Creating event network-vif-plugged:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:25:47.826311 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7e50a661-6961-4d77-95b2-47f39d65bfe6 req-1241e7c6-4ad5-4ad1-80a1-8ef779ec3eeb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046705 Sep 14 09:25:47.827363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1034/1710] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:47.836333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ebdee300-7192-42a6-9000-da37a2a4d6e8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'create', calling method: .version_select at 0x7f693f7440d0>, body: {"pool": "76214266-b29b-429f-97e6-62240ee2e9e9"} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:49.927193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ebdee300-7192-42a6-9000-da37a2a4d6e8 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.097974 Sep 14 09:25:49.933237 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1035/1711] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 09:25:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:49.940493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:49.946354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:49.947128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:49.960408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:49.960884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:49.961314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:49.962035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:49.963436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:49.963865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.058785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:50.130271 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5db88ea4-6d05-4749-a29a-fb89397057ec tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.195091 Sep 14 09:25:50.139186 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1036/1712] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:25:49 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:50.143642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:50.146724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:50.153173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.153826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.154442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.154984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.155429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.155846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.239686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:50.256893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:50.257705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:50.258038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:50.258399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:50.258864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:50.337998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:50.345359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.345942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.347200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.348114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.349741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.350019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.387202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd3ee3f2-2327-4490-89f1-4bb12fcca3d2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "POST /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581/action" status: 202 len: 1112 microversion: 2.1 time: 0.255212 Sep 14 09:25:50.388318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1037/1713] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:25:50 2022] POST /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581/action => generated 1112 bytes in 257 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:25:50.393183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:50.394683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:50.401344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.401848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.402285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.402998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:50.403645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:50.404244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:50.630204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:50.647485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:50.650859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:50.652332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bca31c08-061f-4aeb-97c6-024d7bfc383f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.262944 Sep 14 09:25:50.653106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1038/1714] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:50 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:50.658128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1210902059", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:50.718822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:25:51.146278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:25:51.146937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:25:51.147169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:25:51.147583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:25:51.148035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:25:51.157881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.158363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.159857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.160722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.161178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.161608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.167675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=27 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:51.182945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:25:51.189062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:25:51.198525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:51.203722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:25:51.206812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:25:51.265634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-706f0b1f-9f2f-4236-b2a7-4b1b658cec39 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611029 Sep 14 09:25:51.269491 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1039/1715] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:25:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:25:51.279799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53b13bcc-86f8-43d0-8855-a1aef354e0d9", "device": "/dev/xvdb"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:51.283068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:51.292390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.292846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.293517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.293990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.294450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.294933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.623029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-55271d59-cabd-4de6-981f-7984c82280f5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350969 Sep 14 09:25:51.629978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1040/1716] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:25:51 2022] POST /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:51.644390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:51.645425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:51.653015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.653571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.666478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.671067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.672083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.674538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.868144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:51.879976 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59826abc-f2d0-4c49-8d6e-106d3c56920d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1313 microversion: 2.1 time: 0.243193 Sep 14 09:25:51.880936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1041/1717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:51 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:51.886871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5688ca53-9b1d-4ac5-8961-ca20b218ea40", "name": "network-vif-plugged", "status": "completed", "tag": "e6587b73-159e-49e3-94fd-6c5a594d7777"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:51.899556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.900311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.900743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.918250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] Creating event network-vif-plugged:e6587b73-159e-49e3-94fd-6c5a594d7777 for instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 on n-h1-851028-12 Sep 14 09:25:51.924528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a07e5afd-3608-4308-8fe9-660847916823 req-9bd200be-f49d-4f59-b850-cb9d10d8e1d2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041747 Sep 14 09:25:51.925675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1042/1718] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:51.932055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "e5599917-9c4b-499a-9b53-6c5f21cedbd6"}, {"name": "network-changed", "server_uuid": "38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd", "tag": "0e16186c-a7d5-480d-be85-ba70f269673e"}, {"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "9ccf476e-11c5-41cd-86b5-ada944305366"}, {"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "1997a392-ef74-4aa6-a907-5d66aab6e0c3"}, {"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "2cadb215-5e51-45c2-abc9-874896bafee9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:51.943480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.943986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.944419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.961995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Creating event network-changed:e5599917-9c4b-499a-9b53-6c5f21cedbd6 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:51.962511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Creating event network-changed:0e16186c-a7d5-480d-be85-ba70f269673e for instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd on n-h2-851028-12 Sep 14 09:25:51.963164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Creating event network-changed:9ccf476e-11c5-41cd-86b5-ada944305366 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:51.963665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Creating event network-changed:1997a392-ef74-4aa6-a907-5d66aab6e0c3 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:51.964227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] Creating event network-changed:2cadb215-5e51-45c2-abc9-874896bafee9 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:25:51.971135 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fa51ee74-337a-4b19-9c2c-58280b0abf3a req-12b2e148-3e96-4867-b22c-f492856c1023 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 847 microversion: 2.1 time: 0.043847 Sep 14 09:25:51.972400 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1043/1719] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 847 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:51.981567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.198"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:51.984146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:51.991973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.992463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.992898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:51.993604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:51.994059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:51.994488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:52.022489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:25:52.022905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquired lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:25:52.758111 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:25:52.758111 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:25:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:25:52.869781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9.", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:25:52.870382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Releasing lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:25:52.870958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.870958 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Request method failure captured: Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action HTTP/1.1 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 46 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3w8dcv85GZcMgqpdhR8eiJPr0LCqUzq4JPyGv__EEjUeauya9NOvg8qCSg7qIEuhiCwSSfKmxKwZHe8YttIpYy1OPNq3NBkVhhkuQZsLB12-K0Vi8eUHy9x9Gv4qo0GZMhED1deTgcvTIw6GPTMRe_TIUqlDF0T_JP3D1g3ACMBHA Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b7ae48800f84c6ea246e2888af654e2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b7ae48800f84c6ea246e2888af654e2"}]}] Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bdebcc0c9dd846dcb6509dfac741d621 Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: {"addFloatingIp": {"address": "172.25.4.198"}} Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd', 'body': {'addFloatingIp': {'address': '172.25.4.198'}}} Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:25:52.873368 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] Sep 14 09:25:52.882444 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:52.887920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Returning 400 to user: Cannot associate floating IP 172.25.4.198 (871507a2-739b-4617-a6cc-bec29f43d0cb) with port 0e16186c-a7d5-480d-be85-ba70f269673e using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 76214266-b29b-429f-97e6-62240ee2e9e9. Sep 14 09:25:52.887920 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-f4703a66-15f2-4cc6-a6f2-b52582e7b89c'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:25:52.887920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6c7e0c4-993a-46d1-9f9b-fa2896769b67 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 400 len: 382 microversion: 2.1 time: 0.897760 Sep 14 09:25:52.887920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1044/1720] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:25:51 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 382 bytes in 903 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:25:52.887920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:52.895222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:52.895680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Removing options 'limit' from query {{(pid=122444) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:25:52.896533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:52.906415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:52.907017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:52.907774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:52.908795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:52.909898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:52.910330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:52.952969 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56cd089e-0071-43c8-b6b5-11a82a4da5cf tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.074604 Sep 14 09:25:52.954284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1045/1721] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Sep 14 09:25:52 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:52.963009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:52.963661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:52.970651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:52.971146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:52.971596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:52.973379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:52.973379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:52.973940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.020378 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:25:53.020624 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:25:53.157683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:53.182420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bea41744-8551-4af1-b6f4-2e1a35518f35 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1517 microversion: 2.1 time: 0.223332 Sep 14 09:25:53.188783 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1046/1722] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:52 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:53.208699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:53.215216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:53.218116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.218864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.219460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.220985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.221471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.222659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.257998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:25:53.270129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.270683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.271052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.329966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'flavor' on Instance uuid 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:25:53.365964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'system_metadata' on Instance uuid 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:25:53.453618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'metadata' on Instance uuid 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:25:53.625061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.625701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.626230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.813842 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67c5c1d6-d4e4-4a2d-8b5c-c2dd4b1ce1a5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda" status: 204 len: 0 microversion: 2.1 time: 0.623291 Sep 14 09:25:53.814731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1047/1723] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:25:53 2022] DELETE /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:25:53.826435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:53.827410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:53.835044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.835687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.836329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:53.837144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:53.837870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:53.838625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:54.133248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:54.145238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:54.146733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:54.147964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-110f3392-7418-4596-a8d8-eb4b38f71f19 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.331403 Sep 14 09:25:54.159930 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1048/1724] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:53 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:54.159930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c1ddd3d-d222-40f9-b244-5318c382ca23 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '.version_select at 0x7f693fb004c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:55.514358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c1ddd3d-d222-40f9-b244-5318c382ca23 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/871507a2-739b-4617-a6cc-bec29f43d0cb" status: 202 len: 0 microversion: 2.1 time: 1.362773 Sep 14 09:25:55.516465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1049/1725] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:25:54 2022] DELETE /compute/v2.1/os-floating-ips/871507a2-739b-4617-a6cc-bec29f43d0cb => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:25:55.522791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:55.523930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:55.535141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:55.535578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:55.536554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:55.536713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:55.537468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:55.537741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:55.563134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:25:55.765987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:55.775613 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69bdd688-b5f5-459e-bdc6-c4e7d8d7a503 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1463 microversion: 2.1 time: 0.257938 Sep 14 09:25:55.788448 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1050/1726] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:55 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:55.801057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:55.806723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:55.807819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-389072569', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:25:55.813960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:55.814687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:55.815342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:55.817040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:55.817507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:55.818118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:55.934416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:25:56.017444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-776b1d28-898a-4b5d-bc2d-e567dced579c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-389072569" status: 200 len: 345 microversion: 2.1 time: 0.227310 Sep 14 09:25:56.018031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1051/1727] 10.222.0.90 () {58 vars in 1240 bytes} [Wed Sep 14 09:25:55 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-389072569 => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:56.031193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:56.032871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:56.047646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.049808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.050774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.051512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.052019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.052454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.197568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:56.209993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c19dbb28-2492-403a-9dc3-3d2c45757951 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda" status: 200 len: 1213 microversion: 2.1 time: 0.190012 Sep 14 09:25:56.218931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1052/1728] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:56 2022] GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:56.229790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:56.229790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:56.237296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.239581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.241548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.244411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.245078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.245690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.521164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:56.537572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e9e521c-501d-4cfe-a351-2930bc564559 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1517 microversion: 2.1 time: 0.317383 Sep 14 09:25:56.554419 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1053/1729] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:56 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:56.560380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:56.561003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:56.571370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.571914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.572417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.573061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:56.573521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:56.574020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:56.837108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:56.848761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:56.850348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:56.851571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16bc8995-e60a-4794-9f07-49645e560926 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.297208 Sep 14 09:25:56.864035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1054/1730] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:56 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:56.864035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.129"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:57.044608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:57.051588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:57.052248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:57.052778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:57.053582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:57.054265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:57.054785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:57.295217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:25:57.296115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquired lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:25:58.013054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 09:25:58.541491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Updating instance_info_cache with network_info: [{"id": "0e16186c-a7d5-480d-be85-ba70f269673e", "address": "fa:16:3e:66:08:fe", "network": {"id": "e89dd5d9-8c7b-47f2-bffb-01e041fc3362", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-208566298-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "4b7ae48800f84c6ea246e2888af654e2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0e16186c-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:25:58.554231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Releasing lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:25:58.555136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b86614f-5f7e-4e29-97a6-6d2cee11b329 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 202 len: 0 microversion: 2.1 time: 1.701835 Sep 14 09:25:58.555758 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1055/1731] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:25:56 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 0 bytes in 1703 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 14 09:25:58.560481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:58.561123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:58.568241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.568669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.569043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.569745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.570176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.570594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.705082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:58.713698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6826d269-fb2f-41b0-85cf-3d63481e4908 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1463 microversion: 2.1 time: 0.156847 Sep 14 09:25:58.714388 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1056/1732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:58 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:58.718979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:58.725608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.726089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.726515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.789662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:25:58.834621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8f6a29a-2dba-45f4-a5d5-e6f1286c8c4c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "POST /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71/action" status: 202 len: 0 microversion: 2.1 time: 0.118970 Sep 14 09:25:58.835256 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1057/1733] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:25:58 2022] POST /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:25:58.840627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:58.841307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:58.849294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.849786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.850225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.850932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.851382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.851799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.867128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda HTTP/1.1 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '421a8ad3-2bce-4dd4-bdd6-8d98a6760eda'} Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:58.868838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-694b3136-e251-46ce-8285-871f270502e7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda" status: 404 len: 111 microversion: 2.1 time: 0.033875 Sep 14 09:25:58.873669 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1058/1734] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:58 2022] GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:25:58.875828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:58.875828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:58.883449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.884069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.884470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:58.885070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:58.885520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:58.885941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.272613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:59.281047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef1125e0-e276-4d39-9d87-1b5f6933cd32 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1517 microversion: 2.1 time: 0.409231 Sep 14 09:25:59.281626 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1059/1735] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:25:58 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1517 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:25:59.288090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:59.288903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:59.295309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.295945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.296389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.297090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.297542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.299184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.493672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:59.503052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:59.504533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:25:59.505687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0af2bfc4-a6fe-4f02-ba08-b1bf815c9325 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.223134 Sep 14 09:25:59.506247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1060/1736] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:25:59 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:25:59.510686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:25:59.511124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:25:59.516868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.517354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.517789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.519535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.519653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.520161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.544231 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e469a27-a0ed-406e-8a3b-5650e5d847e4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/ips" status: 200 len: 150 microversion: 2.1 time: 0.036951 Sep 14 09:25:59.544805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1061/1737] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:25:59 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:59.549083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd", "tag": "0e16186c-a7d5-480d-be85-ba70f269673e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:25:59.558340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:25:59.558821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:25:59.559252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:25:59.570385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] Creating event network-changed:0e16186c-a7d5-480d-be85-ba70f269673e for instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd on n-h2-851028-12 Sep 14 09:25:59.575418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0878bc1d-42be-4bac-82bb-f1b96fc47d24 req-72723562-1636-472c-ab2c-79e23ddb2e3a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029466 Sep 14 09:25:59.576052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1062/1738] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:25:59.581416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9bc0b566-e44c-4768-b3e2-45be399e45f3 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '.version_select at 0x7f693fa6adc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:00.341044 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9bc0b566-e44c-4768-b3e2-45be399e45f3 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/838831b8-90c0-44d9-a5e2-edb9f40f3183" status: 202 len: 0 microversion: 2.1 time: 0.763751 Sep 14 09:26:00.341741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1063/1739] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:25:59 2022] DELETE /compute/v2.1/os-floating-ips/838831b8-90c0-44d9-a5e2-edb9f40f3183 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:00.349527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2038477641", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:00.556213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:00.773107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:00.773534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:00.774013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:00.774428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:00.774938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:00.783884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:00.784410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:00.784859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:00.785581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:00.786056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:00.786464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:00.804342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:00.809030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Getting quotas for user fff8ac76bff9488bbd3718967820c39a and project 6ba112b4965542eea489647d01a6476f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:00.821877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:00.824334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:00.872099 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e885992f-1ab4-4557-a9b5-81184d29a185 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529213 Sep 14 09:26:00.872678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1064/1740] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:00.877128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:00.877730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:00.885001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:00.885484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:00.885914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:00.886612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:00.887060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:00.887488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.041392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:01.050470 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84f9eff2-7a3d-418d-8f8c-e920142a740d tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.175918 Sep 14 09:26:01.051071 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1065/1741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:00 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:01.055991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1338168772", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:01.114610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:01.539562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:01.540238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:01.540747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:01.541230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:01.541721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:01.552027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.552631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.553138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.553952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.554415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.554977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.575186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:01.580395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:01.594095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:01.596401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:01.642608 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79090b4d-e62a-4e6c-a6d3-927e23c90e3a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590493 Sep 14 09:26:01.643991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1066/1742] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:01.653852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74370038-a655-404e-a1de-f9e5826ebec8"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:01.656772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:01.666767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.667260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.667690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.668422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.669035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.669297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.776949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/os-volume_attachments HTTP/1.1 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 74 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: {"volumeAttachment": {"volumeId": "74370038-a655-404e-a1de-f9e5826ebec8"}} Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '7f946211-7fae-4e31-a023-f38a84f0eba0', 'body': {'volumeAttachment': {'volumeId': '74370038-a655-404e-a1de-f9e5826ebec8'}}} Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:26:01.790568 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 400 to user: Invalid volume: volume 74370038-a655-404e-a1de-f9e5826ebec8 is already attached to instances: 6f2949a7-438a-435e-a3f8-154fb1188e15 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24de5b7a-1036-41b4-b103-d3e02b6c751e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143096 Sep 14 09:26:01.796588 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1067/1743] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:26:01 2022] POST /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:26:01.800548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:01.800811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:01.808427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.809367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.809937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.810714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:01.811375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:01.811888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:01.969659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:01.972975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:01.980513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7338e7ba-981c-4796-9965-a8a571acf083 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1517 microversion: 2.1 time: 0.186631 Sep 14 09:26:01.981052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1068/1744] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:01 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:01.987085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98d5f306-7d61-4a9f-b62d-7fe0a10dd13b tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98d5f306-7d61-4a9f-b62d-7fe0a10dd13b tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Request method failure captured: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action HTTP/1.1 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 34 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3w8dcv85GZcMgqpdhR8eiJPr0LCqUzq4JPyGv__EEjUeauya9NOvg8qCSg7qIEuhiCwSSfKmxKwZHe8YttIpYy1OPNq3NBkVhhkuQZsLB12-K0Vi8eUHy9x9Gv4qo0GZMhED1deTgcvTIw6GPTMRe_TIUqlDF0T_JP3D1g3ACMBHA Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b7ae48800f84c6ea246e2888af654e2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b7ae48800f84c6ea246e2888af654e2"}]}] Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bdebcc0c9dd846dcb6509dfac741d621 Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: {"addFloatingIp": {"address": ""}} Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd', 'body': {'addFloatingIp': {'address': ''}}} Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '' Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:26:01.999729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98d5f306-7d61-4a9f-b62d-7fe0a10dd13b tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-98d5f306-7d61-4a9f-b62d-7fe0a10dd13b tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 400 len: 142 microversion: 2.1 time: 0.019393 Sep 14 09:26:02.004339 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1069/1745] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:01 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 142 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:26:02.008128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.008750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.010826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:02.017800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.018303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.018802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.019514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.020005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.020436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.232696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.243451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.244956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.246112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0776e9c8-15a1-45b0-8a17-457c122c3ba6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.242458 Sep 14 09:26:02.246704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1070/1746] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:02 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:02.251530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.252300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.263179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.263698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.264693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.265408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.265868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.266294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.339492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.348388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fec7a412-3358-4476-99f4-77c038a1474f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1266 microversion: 2.1 time: 0.100437 Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1071/1747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:02 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.365376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.450149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.460263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0bf2d60-f932-45c3-a29a-2942ad6400a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1217 microversion: 2.1 time: 0.110106 Sep 14 09:26:02.465849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1072/1748] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:02 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:02.481244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.481787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.492700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.492700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.493343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.494314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.494897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.495768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.533851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:02.645147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e96e4f09-f32a-4035-af87-802121a1b5d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 204 len: 0 microversion: 2.1 time: 0.181681 Sep 14 09:26:02.645830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1073/1749] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:02 2022] DELETE /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:02.656568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:02.659728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.666014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.666492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.666919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.667612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.668083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.668498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.700622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 09:26:02.701013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquired lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 09:26:02.805240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Releasing lock "refresh_cache-38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 09:26:02.805957 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] HTTP exception thrown: floating IP not found Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Request method failure captured: Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action HTTP/1.1 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 41 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3w8dcv85GZcMgqpdhR8eiJPr0LCqUzq4JPyGv__EEjUeauya9NOvg8qCSg7qIEuhiCwSSfKmxKwZHe8YttIpYy1OPNq3NBkVhhkuQZsLB12-K0Vi8eUHy9x9Gv4qo0GZMhED1deTgcvTIw6GPTMRe_TIUqlDF0T_JP3D1g3ACMBHA Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b7ae48800f84c6ea246e2888af654e2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b7ae48800f84c6ea246e2888af654e2"}]}] Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bdebcc0c9dd846dcb6509dfac741d621 Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: exception: floating IP not found Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 14 09:26:02.808320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Returning 404 to user: floating IP not found {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9d925f6-c3a9-4f0f-b98d-24ac5822ecc0 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 404 len: 67 microversion: 2.1 time: 0.161679 Sep 14 09:26:02.817526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1074/1750] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:02 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 67 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:26:02.819421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.820211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:02.827768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.828690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.829251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.830060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:02.830593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:02.831507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:02.979461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:02.989041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d99d6372-a10e-42d0-9fa4-1048fc2155e8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.175816 Sep 14 09:26:02.995956 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1075/1751] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:02 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:02.995956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:02.995956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.003649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.004172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.004747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.005445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.006197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.006635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.147573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.164797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b50ff03d-a64c-49e5-be84-d564280bfadb tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1681 microversion: 2.1 time: 0.168187 Sep 14 09:26:03.164797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1076/1752] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:02 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:03.168120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1497bc1-b8b2-49cc-beb6-fd9099ac0cce tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:03.223284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e1497bc1-b8b2-49cc-beb6-fd9099ac0cce tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1497bc1-b8b2-49cc-beb6-fd9099ac0cce tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Request method failure captured: Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action HTTP/1.1 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 44 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3w8dcv85GZcMgqpdhR8eiJPr0LCqUzq4JPyGv__EEjUeauya9NOvg8qCSg7qIEuhiCwSSfKmxKwZHe8YttIpYy1OPNq3NBkVhhkuQZsLB12-K0Vi8eUHy9x9Gv4qo0GZMhED1deTgcvTIw6GPTMRe_TIUqlDF0T_JP3D1g3ACMBHA Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b7ae48800f84c6ea246e2888af654e2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b7ae48800f84c6ea246e2888af654e2"}]}] Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bdebcc0c9dd846dcb6509dfac741d621 Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP not found for address 0.0.0.0. Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 14 09:26:03.226401 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 14 09:26:03.230762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:03.234796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1497bc1-b8b2-49cc-beb6-fd9099ac0cce tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:03.236783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1497bc1-b8b2-49cc-beb6-fd9099ac0cce tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action" status: 404 len: 88 microversion: 2.1 time: 0.074118 Sep 14 09:26:03.239667 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1077/1753] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:03 2022] POST /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd/action => generated 88 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:26:03.247739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:03.248805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.259446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.260005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.261124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.263612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.263612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.263612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.442367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.450566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02fc7981-1838-444d-a5de-aa2da9dbf4e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1523 microversion: 2.1 time: 0.209058 Sep 14 09:26:03.468937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1078/1754] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:03 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:03.474467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:03.474990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.481702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.483048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.483548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.484264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.484725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.485532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.512523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:03.596479 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c643fe07-62fa-46e8-9737-dae86554c2a4 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "DELETE /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 204 len: 0 microversion: 2.1 time: 0.126421 Sep 14 09:26:03.598033 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1079/1755] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:03 2022] DELETE /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:03.603129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:03.603837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.610185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.610671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.611099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.611791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.612915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.613349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.808875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.819318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.820805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.822242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97f81f68-c0ec-45c4-a963-8a9b99d42d0d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.223371 Sep 14 09:26:03.822816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1080/1756] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:03 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:03.827629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:03.828274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.835662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.836189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.836631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.837331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.837783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.838205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.976215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:03.984052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0bd8015-6946-4544-b591-4a26e10667a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.160244 Sep 14 09:26:03.985026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1081/1757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:03 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:03.989840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:03.990448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:03.996326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.996811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.997251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:03.997949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:03.998471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:03.998903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.063173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:04.072186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14d17411-176b-4de3-879e-8ca5c640fea5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1273 microversion: 2.1 time: 0.086376 Sep 14 09:26:04.072771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1082/1758] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:03 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:04.077360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:04.077970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:04.084406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.084887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.085317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.086017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.086468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.086894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.110987 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:26:04.111547 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:26:04.253526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:04.263551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5dfc606-4b18-4cb7-9053-ab945a661a14 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1542 microversion: 2.1 time: 0.189364 Sep 14 09:26:04.264295 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1083/1759] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:04 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1542 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:04.269850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:04.270473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:04.296637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.298216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.298877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.300642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.301492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.302132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.329616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:04.500313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:04.509588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b18fd032-89b0-48a3-8288-27072627433f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.244078 Sep 14 09:26:04.510186 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1084/1760] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:04 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:04.514821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:04.515437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:04.523262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.523759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.524225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.524947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.525397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.525823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.729130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:04.757783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efbb1394-bcdb-4921-b878-508d3a4dc30f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1681 microversion: 2.1 time: 0.238731 Sep 14 09:26:04.759927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1085/1761] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:04 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:04.773939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:04.774669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:04.781643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.782112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.782624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:04.783934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:04.785023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:04.785457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.052339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:05.060873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18deb941-f3ef-4d84-9912-26c3be299f36 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1523 microversion: 2.1 time: 0.299956 Sep 14 09:26:05.063947 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1086/1762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:04 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:05.067583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.068236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.074718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.075212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.075648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.076432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.077071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.077580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.352060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:05.362287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:05.364044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:05.365245 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bea62433-c276-4257-be5c-49b4ba819534 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.302846 Sep 14 09:26:05.365829 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1087/1763] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:05 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:05.370328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.370947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.378866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.379461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.379925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.380645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.381143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.381568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.583111 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81da03e4-4c70-4222-8316-e7fe58fe2fd1 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1858 microversion: 2.1 time: 0.216206 Sep 14 09:26:05.583705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1088/1764] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:05 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1858 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:05.588233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.588846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.594812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.595307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.595746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.596547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.597059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.597500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.802463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:05.810599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac5edbb6-57c8-41a5-a775-4061b5052101 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.225831 Sep 14 09:26:05.811200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1089/1765] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:05 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:05.816204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:05.816877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:05.823218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.823810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.824641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:05.825559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:05.826185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:05.826761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:06.101585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:06.117339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8baa79e-38b7-4514-adcb-791e88703036 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1321 microversion: 2.1 time: 0.303173 Sep 14 09:26:06.117339 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1090/1766] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:05 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:06.123993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:06.125140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:06.185906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:06.186428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:06.186873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:06.187793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:06.188288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:06.188859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:06.601475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdebcc0c9dd846dcb6509dfac741d621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7ae48800f84c6ea246e2888af654e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:06.611571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3be1e13a-c020-4c2e-a0aa-4fc1f28a0d9c tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 200 len: 1542 microversion: 2.1 time: 0.494432 Sep 14 09:26:06.620057 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1091/1767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:06 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 1542 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:06.625051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8725cbad-a54d-41e2-ab0f-671beda0e871", "tag": "6c0a47e3-87c9-4272-993c-7c2abf696baa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:06.635513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:06.636037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:06.636473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:06.649602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] Creating event network-changed:6c0a47e3-87c9-4272-993c-7c2abf696baa for instance 8725cbad-a54d-41e2-ab0f-671beda0e871 on n-h2-851028-12 Sep 14 09:26:06.654463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4672ee2d-4b9b-4e8b-beca-99388b8d8ff7 req-d75e6993-1b75-4c1f-a861-c1cd5148b539 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033121 Sep 14 09:26:06.655472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1092/1768] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:06.661575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:06.662287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:06.670133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:06.670872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:06.671541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:06.672573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:06.673246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:06.673865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:07.310032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:07.318310 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc988473-d198-40af-9d75-6c93f1f7a576 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.661465 Sep 14 09:26:07.319007 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1093/1769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:06 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:07.325913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:07.329755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:07.336598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:07.337094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:07.337533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:07.338590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:07.339203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:07.339924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:07.368647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lazy-loading 'flavor' on Instance uuid 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:07.382548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:26:09.325610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0f53500-7a68-411d-b7a1-ee32eef8b20a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/action" status: 202 len: 0 microversion: 2.1 time: 2.005102 Sep 14 09:26:09.326438 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1094/1770] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:07 2022] POST /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/action => generated 0 bytes in 2007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:09.332373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:09.332962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:09.341088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.341576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.342010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.342713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.343167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.343590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.378701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.379205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.379634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.380121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'fault' on Instance uuid 7f946211-7fae-4e31-a023-f38a84f0eba0 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:09.425939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:09.433950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-277366a9-5acd-46ff-99ca-e5301ce82ac4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 200 len: 1331 microversion: 2.1 time: 0.106547 Sep 14 09:26:09.434716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1095/1771] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:09 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:09.439369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:09.439994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:09.446069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.446984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.447645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.448571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.449209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.449632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.600452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:09.609756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f65d06f9-e368-4c03-a737-13d17a129b99 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1508 microversion: 2.1 time: 0.174052 Sep 14 09:26:09.610349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1096/1772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:09 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:09.616144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca862d-f120-453f-984f-5858f579a581", "name": "network-vif-unplugged", "status": "completed", "tag": "ea37a2a1-fb1b-40d5-bb47-eb7a38cac317"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:09.626628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.627745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.628501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.640782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] Creating event network-vif-unplugged:ea37a2a1-fb1b-40d5-bb47-eb7a38cac317 for instance 9fca862d-f120-453f-984f-5858f579a581 on n-h1-851028-12 Sep 14 09:26:09.645707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8e1968f6-0951-4d3d-a744-0dd865260958 req-77a2e619-8a72-439a-8719-91ddec7f3db9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033599 Sep 14 09:26:09.646396 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1097/1773] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:09.652149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:09.652853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:09.659002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.660037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.660485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.661295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.661756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.662184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.857051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:09.869728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:09.871203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:09.872552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-610b2413-f151-48c9-8155-466ac31c5f7f tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.225176 Sep 14 09:26:09.873558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1098/1774] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:09 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:09.880352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:09.880928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:09.891917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.895629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.896353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:09.897129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:09.897601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:09.898019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.051050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:10.061457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc115484-e50c-4adc-9360-8d167f971d5b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.186616 Sep 14 09:26:10.062195 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1099/1775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:09 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:10.067666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:10.068481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:10.075813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.076660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.077329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.078246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.078918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.079578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.085318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:10.236618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:10.245637 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26820848-df04-486b-b243-c254eccf533e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1321 microversion: 2.1 time: 0.182272 Sep 14 09:26:10.260288 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1100/1776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:10 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:10.267228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:10.267853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] [instance: 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:10.274901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.275337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.275776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.276682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.277840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.278424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.293423 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] HTTP exception thrown: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Request method failure captured: Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd HTTP/1.1 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3w8dcv85GZcMgqpdhR8eiJPr0LCqUzq4JPyGv__EEjUeauya9NOvg8qCSg7qIEuhiCwSSfKmxKwZHe8YttIpYy1OPNq3NBkVhhkuQZsLB12-K0Vi8eUHy9x9Gv4qo0GZMhED1deTgcvTIw6GPTMRe_TIUqlDF0T_JP3D1g3ACMBHA Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b7ae48800f84c6ea246e2888af654e2", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b7ae48800f84c6ea246e2888af654e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b7ae48800f84c6ea246e2888af654e2"}]}] Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b7ae48800f84c6ea246e2888af654e2 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bdebcc0c9dd846dcb6509dfac741d621 Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd'} Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. Sep 14 09:26:10.295325 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. Sep 14 09:26:10.299550 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:10.301603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] Returning 404 to user: Instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:10.302693 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-946548e5-5d1b-408d-a115-72ab4631d805 tempest-FloatingIPsAssociationNegativeTestJSON-769505598 tempest-FloatingIPsAssociationNegativeTestJSON-769505598-project] 10.222.0.90 "GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd" status: 404 len: 111 microversion: 2.1 time: 0.041256 Sep 14 09:26:10.303795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1101/1777] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:10 2022] GET /compute/v2.1/servers/38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:10.308733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa678f2-8587-42b3-bf92-f25b7d248eb1", "tag": "a6ffbcfa-6700-4ebb-842c-9f81f69d770d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:10.320232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.320702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.321543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.336492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] Creating event network-changed:a6ffbcfa-6700-4ebb-842c-9f81f69d770d for instance daa678f2-8587-42b3-bf92-f25b7d248eb1 on n-h1-851028-12 Sep 14 09:26:10.343878 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2ed8b5c6-3030-4f8d-b9c5-4a2e4d8d019e req-6075c434-5a93-4bce-b815-86233784b087 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038389 Sep 14 09:26:10.344883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1102/1778] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:10.351292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:10.352263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:10.361838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.362631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.363068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.364020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.364786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.365359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.717783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:10.728574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-861507fd-d4c4-4f0a-a75b-de2f66ac8590 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.381923 Sep 14 09:26:10.729177 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1103/1779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:10 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:10.734194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd", "name": "network-vif-deleted", "tag": "0e16186c-a7d5-480d-be85-ba70f269673e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:10.745438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.745925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.746360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.759373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] Creating event network-vif-deleted:0e16186c-a7d5-480d-be85-ba70f269673e for instance 38d8cccf-e4ab-4d16-a57d-6bbe05cffdcd on n-h2-851028-12 Sep 14 09:26:10.766042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9a798004-0b9c-4deb-a60b-bf482e8cba23 req-adb2f215-3a40-4026-9c1d-7eb78784704b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035212 Sep 14 09:26:10.766897 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1104/1780] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:10.773468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:10.774342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:10.782002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.782547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.782979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:10.784310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:10.784817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:10.785425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.449784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:11.460689 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ceebf4b-3500-4903-b22f-142cd47745ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.692104 Sep 14 09:26:11.469910 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1105/1781] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:10 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:11.487791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.488467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.494792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.495449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.496028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.496845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.497401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.497943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.563228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=9 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:11.589337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:11.806862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:11.816423 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae80beb0-ef08-4fe1-8526-074c821c2b50 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 200 len: 1508 microversion: 2.1 time: 0.345861 Sep 14 09:26:11.816987 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1106/1782] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:11.822176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.822997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.829300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.830034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.830603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.831663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.832294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.832866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.848477 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 HTTP/1.1 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7f946211-7fae-4e31-a023-f38a84f0eba0'} Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:11.850136 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:11.854425 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e17bdb85-aade-4b72-8e7b-27fdc70b78f3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 404 len: 111 microversion: 2.1 time: 0.033463 Sep 14 09:26:11.860869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1107/1783] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:11.872457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:11.873065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:11.884545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.885718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.887103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:11.890113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:11.890846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:11.892170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.237661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:12.251961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:12.253889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:12.255481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5643948-e386-4040-820c-0f5bcaef2948 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.386931 Sep 14 09:26:12.256971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1108/1784] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:11 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:12.262563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:12.263514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:12.271830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.272680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.273317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.274990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.275665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.276865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.515558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:12.526417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f479df63-2b6c-4a64-8caa-50e7ea0549cc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.267714 Sep 14 09:26:12.528095 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1109/1785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:12 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:12.550507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:12.551681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:12.560717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.561308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.561825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.562615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.563145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.563648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.788771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:12.804755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b26a0b95-a5cf-462e-9d3d-9d02ac3b6f29 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1321 microversion: 2.1 time: 0.275389 Sep 14 09:26:12.805707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1110/1786] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:12 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:12.810681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca862d-f120-453f-984f-5858f579a581", "name": "network-vif-plugged", "status": "completed", "tag": "ea37a2a1-fb1b-40d5-bb47-eb7a38cac317"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:12.821761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.822268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.822701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.836217 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] Creating event network-vif-plugged:ea37a2a1-fb1b-40d5-bb47-eb7a38cac317 for instance 9fca862d-f120-453f-984f-5858f579a581 on n-h1-851028-12 Sep 14 09:26:12.841900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-dfe90273-055e-4815-a533-155a8506b815 req-e6332900-f152-425e-8dcc-095743b33033 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Sep 14 09:26:12.842804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1111/1787] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:12.848733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:12.848946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:12.856449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.856947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.857988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:12.858715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:12.859170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:12.859646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.099843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:13.108237 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c02c6f59-22cb-4e1f-a5a0-9921b2dade29 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1520 microversion: 2.1 time: 0.264468 Sep 14 09:26:13.119919 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1112/1788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:12 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:13.119919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:13.119919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:13.119919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:13.121741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.128736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.128736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.128736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.128736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.128736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.153768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:13.250775 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60335fd0-755e-4d78-bf04-14071ab6a8d0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 204 len: 0 microversion: 2.1 time: 0.139784 Sep 14 09:26:13.251704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1113/1789] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:13 2022] DELETE /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:13.262499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-994d39dd-cbd1-443f-9f00-107b92e11594 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '.version_select at 0x7f693fa3d790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:13.293029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-994d39dd-cbd1-443f-9f00-107b92e11594 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158249575" status: 202 len: 0 microversion: 2.1 time: 0.038173 Sep 14 09:26:13.297532 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1114/1790] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:26:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158249575 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:13.309223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f946211-7fae-4e31-a023-f38a84f0eba0", "name": "network-vif-deleted", "tag": "4d303c6b-22b5-4351-bea5-f6279f272c6d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:13.320834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.321690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.322201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.344833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] Creating event network-vif-deleted:4d303c6b-22b5-4351-bea5-f6279f272c6d for instance 7f946211-7fae-4e31-a023-f38a84f0eba0 on n-h2-851028-12 Sep 14 09:26:13.351264 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f7e3680a-f18d-4399-8095-932bb3cbfedc req-ec65b41a-7c60-43ab-b083-7c3079e18bcd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055388 Sep 14 09:26:13.352486 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1115/1791] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:13.364606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:13.365755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:13.375682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.376766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.377365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.378625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.379336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.380138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.705297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:13.721138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d6130eb-8ba0-47df-8247-3642b5091490 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.367288 Sep 14 09:26:13.722024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1116/1792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:13 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:13.738642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:13.739250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:13.748034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.748258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.748720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:13.749440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:13.749900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:13.750338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:14.316126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:14.327363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:14.329329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:14.330730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15b7cfca-8863-412b-a6f1-55eaa44dd2f5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.607881 Sep 14 09:26:14.340526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1117/1793] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:13 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:14.358335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2073618676", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "12415fd1-eee7-4f0a-9e3d-a9fb12f3499a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:14.451411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] validate_networks() for [('12415fd1-eee7-4f0a-9e3d-a9fb12f3499a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:15.821076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:15.821921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:15.822224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:15.822829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:15.823238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:15.835830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.836382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.837234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.837975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:15.838433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:15.838852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:15.886887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:15.904684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Getting quotas for user e324dca163fb48d1841ee61468a1133b and project 065eedc8ca0d41be8926e1fbb75540d9. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:15.946307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:15.953132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:16.083941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b488d0c-ec04-43fa-af45-a89182867b03 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742118 Sep 14 09:26:16.084618 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1118/1794] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:16.095467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:16.096122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:16.118729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.119235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.119670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.122658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.123341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.126366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.542671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:16.552131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc768fdb-a875-4004-8333-a5029d223ac2 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.465863 Sep 14 09:26:16.552727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1119/1795] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:16 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:16.568035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:16.568035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:16.577054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.577586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.578027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.578753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.579211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.579634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.931401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:16.934064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:16.943523 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-561b72d1-b672-489c-962e-30b4dc1e1942 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1321 microversion: 2.1 time: 0.389719 Sep 14 09:26:16.960372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1120/1796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:16 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:16.977511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:16.978137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:16.991579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.995389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.996137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:16.996875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:16.997354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:16.997784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.255007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:17.277804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2b2507d-a44d-4acc-9fe4-1b6fce4004b1 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1497 microversion: 2.1 time: 0.316214 Sep 14 09:26:17.282412 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1121/1797] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:16 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:17.296917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:17.297853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:17.310524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.311294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.311739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.312588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.313050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.313475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.439471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'services' on Instance uuid 6f2949a7-438a-435e-a3f8-154fb1188e15 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:17.547542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51b50e05-ee6c-4156-af5f-06a93aa6f53c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments/74370038-a655-404e-a1de-f9e5826ebec8" status: 202 len: 0 microversion: 2.1 time: 0.261434 Sep 14 09:26:17.548524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1122/1798] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:26:17 2022] DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments/74370038-a655-404e-a1de-f9e5826ebec8 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:17.555788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:17.556790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:17.563837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.564764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.565545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.567067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.567812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.568682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.774665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:17.785021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19bdc00b-eb28-41a8-adfb-2f1345643fb9 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.234472 Sep 14 09:26:17.785869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1123/1799] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:17 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:17.790856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8725cbad-a54d-41e2-ab0f-671beda0e871", "name": "network-vif-plugged", "status": "completed", "tag": "6c0a47e3-87c9-4272-993c-7c2abf696baa"}, {"server_uuid": "daa678f2-8587-42b3-bf92-f25b7d248eb1", "name": "network-vif-plugged", "status": "completed", "tag": "a6ffbcfa-6700-4ebb-842c-9f81f69d770d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:17.802858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.803622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.804294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.819775 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Creating event network-vif-plugged:6c0a47e3-87c9-4272-993c-7c2abf696baa for instance 8725cbad-a54d-41e2-ab0f-671beda0e871 on n-h2-851028-12 Sep 14 09:26:17.820341 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] Creating event network-vif-plugged:a6ffbcfa-6700-4ebb-842c-9f81f69d770d for instance daa678f2-8587-42b3-bf92-f25b7d248eb1 on n-h1-851028-12 Sep 14 09:26:17.828636 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-03819004-f8f9-4e4a-8a8e-fc2919070b9b req-4e23216d-c7d5-4238-b679-4d2cde1ec5c3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041265 Sep 14 09:26:17.829596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1124/1800] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:17.834914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:17.835614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:17.842122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.842824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.843261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:17.843999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:17.844457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:17.844883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.113911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.123977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.125435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.126593 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf2ed113-c498-4d5d-9365-d4e6ae71638c tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.295864 Sep 14 09:26:18.127163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1125/1801] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:17 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:18.131881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:18.132513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:18.138560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.138994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.139432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.140171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.140792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.141421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.207574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.216621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0723a4ba-d326-4f4d-808e-0ecdf516f7a4 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1270 microversion: 2.1 time: 0.088386 Sep 14 09:26:18.217416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1126/1802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:18 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:18.223937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fca862d-f120-453f-984f-5858f579a581", "name": "network-vif-deleted", "tag": "ea37a2a1-fb1b-40d5-bb47-eb7a38cac317"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:18.242584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.244148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.244598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.258696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] Creating event network-vif-deleted:ea37a2a1-fb1b-40d5-bb47-eb7a38cac317 for instance 9fca862d-f120-453f-984f-5858f579a581 on n-h1-851028-12 Sep 14 09:26:18.263480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8ffd70a4-492e-488b-afe4-b940b7e748ad req-0f4149ac-1e1e-4f82-8414-40c03dd23171 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044738 Sep 14 09:26:18.265539 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1127/1803] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:18.274232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:18.280931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.281736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:18.288159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.288636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.289065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.289788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.290236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.290717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.320386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:18.368666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2fdc024b-7c00-438e-98fd-f6649a062df9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.098739 Sep 14 09:26:18.375952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1128/1804] 10.222.0.90 () {58 vars in 1154 bytes} [Wed Sep 14 09:26:18 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:18.375952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:18.376747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:18.410672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.411332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.411820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.412579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.413069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.413499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.469655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1843661d-4690-4e09-9f1d-ad62f274faef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098918 Sep 14 09:26:18.470384 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1129/1805] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:18 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:18.475921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:18.476648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:18.482721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.483266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.483784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.484573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.485105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.485607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.643245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.652734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-643e3490-c8a1-4a10-be89-ee90fc46af8b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1314 microversion: 2.1 time: 0.180869 Sep 14 09:26:18.655158 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1130/1806] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:18 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:18.658525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:18.659138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:18.667053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.667952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.668114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.668833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.669922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.670537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.817995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:18.826078 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f31a797c-1293-4b5b-9105-13f8c019b21b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1321 microversion: 2.1 time: 0.171479 Sep 14 09:26:18.826739 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1131/1807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:18 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:18.845036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:18.851269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:18.851754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:18.852227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:18.879322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Going to try to start instance {{(pid=122444) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:26:18.927656 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bab3e9f5-5556-4f27-858b-31a9563ff1f5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "POST /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71/action" status: 202 len: 0 microversion: 2.1 time: 0.086331 Sep 14 09:26:18.928456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1132/1808] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:18 2022] POST /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:19.074659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1827077312", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:19.144472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:19.575600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:19.576141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:19.576770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:19.577193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:19.577680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:19.590032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:19.590937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:19.591577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:19.592777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:19.593494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:19.594070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:19.634362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Getting quotas for project 9e85d24fd65549fc9d175f029b6f70da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:19.640673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Getting quotas for user 7057aebe52b64551be533bb5121a70ff and project 9e85d24fd65549fc9d175f029b6f70da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:19.656489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:19.659357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:19.747008 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e04f860f-fc61-40e5-9d43-84e6c823f280 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817276 Sep 14 09:26:19.757028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1133/1809] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:19.763533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:19.770754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:19.799660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:19.800767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:19.801216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:19.801957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:19.802409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:19.802830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.271119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:20.283802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70f94551-bb11-462f-849f-d0f03ef4d308 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.525385 Sep 14 09:26:20.299934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1134/1810] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:19 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:20.326326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:20.330314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:20.355724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.356420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.356872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.360017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.360523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.360965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.599633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:20.610830 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce30fd05-a45b-42a7-8298-1d1b46020423 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1506 microversion: 2.1 time: 0.304759 Sep 14 09:26:20.611535 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1135/1811] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:20 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:20.619972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:20.621018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:20.629707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.630209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.630644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.631361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.631816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.632450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.903670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:20.914932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:20.916666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:20.918326 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb74b2fa-0743-4468-9c31-ecae7a84d2ee tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.303306 Sep 14 09:26:20.919062 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1136/1812] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:20 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:20.924064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:20.925627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:20.933370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.934162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.934752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.935754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:20.936391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:20.936962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:20.961452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:21.199389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:21.217487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8080c5c0-87cc-4308-93f5-3bf75e39943d tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.297111 Sep 14 09:26:21.218778 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1137/1813] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:20 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:21.225140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:21.228262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:21.241643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.242486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.243108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.243921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.244454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.244952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.285660 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2380bf19-4b0c-4599-b7bb-450dd5085339 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064724 Sep 14 09:26:21.287174 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1138/1814] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:21 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:21.297283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:21.298169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:21.308609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.309350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.309937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.310811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.311406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.312054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.540601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:21.550631 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-036a0800-bce7-4fcf-9539-585a9bb26f63 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1463 microversion: 2.1 time: 0.257106 Sep 14 09:26:21.556285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1139/1815] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:21 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1463 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:21.577287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:21.578484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:21.587600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.589151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.590036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.591518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.592703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.593711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.676155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:21.684938 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-873e199e-312c-4d01-a3df-37077ab13e12 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1269 microversion: 2.1 time: 0.127004 Sep 14 09:26:21.686265 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1140/1816] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:21 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1269 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:21.707325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:21.707980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:21.716335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.716828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.717266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.717988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.718437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.718877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.889101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:21.908549 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94c3bdb2-cf6f-41ae-a59a-10764da34fca tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1501 microversion: 2.1 time: 0.206668 Sep 14 09:26:21.910094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1141/1817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:21 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:21.916353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:21.917314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:21.926911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.928096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.928840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:21.929944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:21.930828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:21.931597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.301814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:22.313154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f0fdb62-62f9-4132-a02e-d92174a6fb4c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.401609 Sep 14 09:26:22.329048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1142/1818] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:21 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:22.525539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:22.530897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'deleted': False, 'project_id': '1bbcc70326074f88bee9c49fb0a694c3'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:22.538142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.538879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.541783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.542784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.543439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.544066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.586912 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80ad91c2-2e87-48a1-9a01-12db0ef03a7b tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.256042 Sep 14 09:26:22.605155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1143/1819] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:26:22 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:22.616104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:22.616104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:22.620445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:22.622991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.622991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.623971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.624244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.624708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.625136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.911202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:22.931650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8dde0d41-b6e6-4d47-837a-f8f8df39e772 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1510 microversion: 2.1 time: 0.332396 Sep 14 09:26:22.952857 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1144/1820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:22 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:22.960830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:22.961458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:22.970612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.970612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.970861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:22.971616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:22.972561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:22.973959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.190275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:23.201295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e05f6040-f2cf-4115-b0a8-464d095b3edf tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1501 microversion: 2.1 time: 0.250125 Sep 14 09:26:23.205101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1145/1821] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:22 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:23.215528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:23.217167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:23.239590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.240489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.241929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.241929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.242433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.243001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.510495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:23.521875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:23.523449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:23.524974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29db0d0f-658a-483f-ab41-286bc7876429 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.321180 Sep 14 09:26:23.525943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1146/1822] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:23 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:23.545170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60", "tag": "fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:23.562638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.563226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.563738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.580559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] Creating event network-changed:fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702 for instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 on n-h2-851028-12 Sep 14 09:26:23.587067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-061a57ce-9ca6-4d68-af65-3136f15aaae2 req-b4ec1e26-8d8e-4790-8af4-301c09f22b37 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045557 Sep 14 09:26:23.587787 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1147/1823] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:23.593716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:23.595079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:23.602032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.602526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.602959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.603677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.604167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.604591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.756223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:23.764340 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-931c9b19-988f-407e-99a3-649f9df4cad2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.175207 Sep 14 09:26:23.764933 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1148/1824] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:23 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:23.770036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:23.772279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:23.778269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.778759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.779181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.779873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.780391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.781951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.811280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3e953d1-1b70-4d20-8408-66d907796fec tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045297 Sep 14 09:26:23.811873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1149/1825] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:23 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:23.816884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:23.823015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'deleted': False} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:23.828239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.828716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.829144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.829868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:23.830353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:23.830774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:23.957530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Listed batch of 15 results from cell out of 1000 limit. Returned 15 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:24.042189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.042671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.043109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.434485 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-766b6384-b0fd-427e-bf2e-9c59a79217b2 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24828 microversion: 2.1 time: 0.621406 Sep 14 09:26:24.435433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1150/1826] 10.222.0.90 () {58 vars in 1171 bytes} [Wed Sep 14 09:26:23 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24828 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:26:24.440464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.441368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.447813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.448331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.448763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.449457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.449907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.450327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.591649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:24.600323 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-165e1b81-e96c-43fd-a81a-e59d76742e59 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.163707 Sep 14 09:26:24.600901 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1151/1827] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:24.605246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.611130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:24.611130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Removing options 'limit' from query {{(pid=122444) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:26:24.611381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:24.612144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.613228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.613706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.614436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.614884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.615300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.616681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bfa282ba-222f-410c-8ebd-80ad4ce6b431 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.014865 Sep 14 09:26:24.617249 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1152/1828] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:24.621618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.622109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.629518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.630009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.630447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.631150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.631617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.632032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.659000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:24.737726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9bdd741a-a9fd-4a4f-9059-0235a502537f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 204 len: 0 microversion: 2.1 time: 0.119004 Sep 14 09:26:24.738511 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1153/1829] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:24 2022] DELETE /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:24.745774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.747025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.753680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.754471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.754957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.755653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.756206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.756633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.759751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:24.897232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:24.905615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67f67b37-c757-4a27-b55f-503a7c3fdefa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.165923 Sep 14 09:26:24.906196 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1154/1830] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:24.910764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.915693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'deleted': False, 'project_id': '1bbcc70326074f88bee9c49fb0a694c3'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:24.920818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.921449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.921805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.922525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.922955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.923442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.952719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-436a5025-36b6-4f27-8020-5a606d467752 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail?tenant_id=6ba112b4965542eea489647d01a6476f" status: 200 len: 15 microversion: 2.1 time: 0.045502 Sep 14 09:26:24.953277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1155/1831] 10.222.0.90 () {58 vars in 1231 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers/detail?tenant_id=6ba112b4965542eea489647d01a6476f => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:24.957673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:24.958270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:24.964012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.964501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.964938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:24.965728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:24.966182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:24.966628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:25.209108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:25.219499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:25.221336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:25.223300 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c747808-a470-4c0c-aa51-609e727aa54b tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.268994 Sep 14 09:26:25.224128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1156/1832] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:24 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:25.228945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:25.229810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:25.237752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:25.240069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:25.240755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:25.241704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:25.242373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:25.243037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:25.746457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:25.756552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be2c944b-9328-475b-a73c-90ed4a84ca59 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1510 microversion: 2.1 time: 0.530653 Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1157/1833] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:25 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:25.772211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:25.774057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:25.774469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.036670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:26.045958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d69f5891-3ca1-4c2d-84e8-c11f9f07f633 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 200 len: 1507 microversion: 2.1 time: 0.287100 Sep 14 09:26:26.058653 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1158/1834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:25 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 1507 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:26.069095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:26.069923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:26.076674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.077377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.077812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.078519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.079394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.079394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.302851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:26.313782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-785aaeab-73ca-4b3c-aa4f-a6374d36dae8 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.253039 Sep 14 09:26:26.320824 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1159/1835] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:26 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:26.327817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:26.330740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:26.338908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.339404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.339835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.340730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.341325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.341757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.377669 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd5ae06e-3cbe-4ee2-9c5a-3ce56a35e3ad tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055350 Sep 14 09:26:26.378277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1160/1836] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:26 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:26.406029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:26.432423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'tenant_id': '6ba112b4965542eea489647d01a6476f', 'deleted': False} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:26.439779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.440302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.441062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.443494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.443993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.444422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.499595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:26.572735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.574315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.574440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.906624 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8de6ae30-4bf9-4466-9ff1-0f10f6df3158 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6ba112b4965542eea489647d01a6476f" status: 200 len: 4831 microversion: 2.1 time: 0.526574 Sep 14 09:26:26.907270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1161/1837] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 09:26:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6ba112b4965542eea489647d01a6476f => generated 4831 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:26.913111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:26.914223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:26.921041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.922497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.923339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:26.924713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:26.925663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:26.926228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.226633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.236375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f429da7-3aa2-484e-ad37-6a79c0d88997 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.327206 Sep 14 09:26:27.254276 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1162/1838] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:26 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:27.300719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:27.310812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.311832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.312578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.326820 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] Creating event network-vif-unplugged:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h1-851028-12 Sep 14 09:26:27.334994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-83f4a456-e9d7-4029-aafb-c333fddce7d5 req-1e0df988-afaf-4fc4-8989-d24b8ebcaf24 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095742 Sep 14 09:26:27.337028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1163/1839] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:27.340709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.341648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.348719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.349320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.349830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.350620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.351409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.351930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.568189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.578670 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-491941d5-eb7a-47a0-8525-ee843ca474d3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 200 len: 1510 microversion: 2.1 time: 0.241847 Sep 14 09:26:27.579626 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1164/1840] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:27 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:27.585155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.585899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.593626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.594246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.595055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.596194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.596751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.597856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.743069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.752243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2475d87-13ff-4d1a-b135-09949214edab tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.171443 Sep 14 09:26:27.752823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1165/1841] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:27 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:27.757804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.758403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.764300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.764779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.765210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.765898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.766345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.767005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.965307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.975404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.976871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:27.978065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17871308-9e38-4c6d-b5df-31aa30e5e153 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.223778 Sep 14 09:26:27.978642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1166/1842] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:27 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:27.983483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:27.984007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:27.991030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.991522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.991989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:27.992703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:27.993195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:27.993573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.024131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:28.124232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6726709-06ed-43ca-91eb-5a3d99dd4a2b tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 204 len: 0 microversion: 2.1 time: 0.143268 Sep 14 09:26:28.125106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1167/1843] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:27 2022] DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:28.132879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:28.146454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.146861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.147542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.168037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] Creating event network-changed:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:26:28.184245 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5441c1da-901a-4b32-8350-e3edb1ed168f req-78f36668-3e89-4412-bacf-dd904381b759 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057578 Sep 14 09:26:28.184882 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1168/1844] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:28.194309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.200604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'tenant_id': '1bbcc70326074f88bee9c49fb0a694c3', 'deleted': False} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:28.207043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.207459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.208148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.208874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.209332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.209757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.250994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f86ca23-45ab-4b85-b359-dd0976c60298 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1bbcc70326074f88bee9c49fb0a694c3" status: 200 len: 15 microversion: 2.1 time: 0.061677 Sep 14 09:26:28.252309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1169/1845] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1bbcc70326074f88bee9c49fb0a694c3 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:28.274815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.275681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:28.282495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.282998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.283465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.284205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.286568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.286568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.299354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 HTTP/1.1 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'daa678f2-8587-42b3-bf92-f25b7d248eb1'} Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.301774 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3513a5a0-e698-4fe9-88d1-0fe9e216000d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 404 len: 111 microversion: 2.1 time: 0.041650 Sep 14 09:26:28.314108 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1170/1846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:28.318444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.318444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:28.322631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.323127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.324261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.324261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.324733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.325157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.495364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:28.497913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:28.506264 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60cdddd9-2cef-4519-af54-f02655246869 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.201041 Sep 14 09:26:28.507036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1171/1847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:28.517959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.519273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:28.526359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.526933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.527448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.528399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.528932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.529376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.691930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:28.700331 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66029e10-d871-477e-b573-5487a161e8fa tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1510 microversion: 2.1 time: 0.191361 Sep 14 09:26:28.711920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1172/1848] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:28.711920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.711920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:28.713199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.713689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.714751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.715461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.715996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.716422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.860806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:28.870184 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26f4cb39-7ec4-413c-a2d1-01d20b16b0c8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1680 microversion: 2.1 time: 0.167760 Sep 14 09:26:28.870765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1173/1849] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:28.875281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "9ccf476e-11c5-41cd-86b5-ada944305366"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:28.885970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.886375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.886771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.898731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] Creating event network-vif-plugged:9ccf476e-11c5-41cd-86b5-ada944305366 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:28.903925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-879dd077-2a67-4695-a76d-b8b83fee34b7 req-d57049b2-489a-40ad-a3b6-1882456b0c83 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Sep 14 09:26:28.904799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1174/1850] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:28.910269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:28.911262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:28.917761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.918790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.918790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:28.919356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:28.919804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:28.920251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.063417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.071665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-067033e1-6d36-4c90-8de9-832fc2318523 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.165904 Sep 14 09:26:29.072545 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1175/1851] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:28 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:29.076927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3869e81f-7d75-4e34-9cc3-f5c5f362abc3 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.082017 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3869e81f-7d75-4e34-9cc3-f5c5f362abc3 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008491 Sep 14 09:26:29.095384 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1176/1852] 10.222.0.90 () {58 vars in 1189 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:29.100392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c612085-f87b-4999-a049-5ccbcbd503e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: .version_select at 0x7f693f8fe9d0>, body: {"keypair": {"name": "tempest-key-776320988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmGsfZc6CUhWvd4v9/huJFXqr1iglT3SIzT34rMw5LwJl1sLLKCt625iaR+dyDXg2wfChMm+lWQ3yXmIyhrvrkY/fNMXPAYky9G3LJi04FUJmn0le1lmei/fkoXAj2CLw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:29.117708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-6c612085-f87b-4999-a049-5ccbcbd503e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:29.123879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-6c612085-f87b-4999-a049-5ccbcbd503e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:29.148603 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c612085-f87b-4999-a049-5ccbcbd503e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.054883 Sep 14 09:26:29.149227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1177/1853] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:26:29 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:29.156050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.160548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.161337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:29.286511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.287032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.287464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.288234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.288683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.289103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.375166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:29.434552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d77abfa-7b36-459b-8c3a-bf80be2fb323 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 345 microversion: 2.1 time: 0.284248 Sep 14 09:26:29.435153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1178/1854] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 345 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:29.439577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.440198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:29.449817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.450320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.450747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.451444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.451884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.452320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.605029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.614761 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-beeaf675-f4e1-49a2-ac44-23ff67f9abdd tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.178597 Sep 14 09:26:29.615353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1179/1855] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:29.620414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.621025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:29.626814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.627462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.627914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.630165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.630482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.631066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.825578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.835679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.837291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:29.838543 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc955914-4296-43c4-93f3-1661acbd9013 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.222065 Sep 14 09:26:29.839126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1180/1856] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:29.843533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:29.845810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:29.851696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.852268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.852679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.853395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.853820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.854242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.931499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2d899c7-2935-4434-b139-3c4c5e9f6af9 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.091314 Sep 14 09:26:29.935175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1181/1857] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:29 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:29.936563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58f24299-1ee2-4933-949f-3388075c8fc7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '.version_select at 0x7f693f836ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.940401 n-d-851028-12 devstack@n-api.service[122444]: WARNING oslo_db.sqlalchemy.utils [None req-58f24299-1ee2-4933-949f-3388075c8fc7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:26:29.942437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:29.948959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58f24299-1ee2-4933-949f-3388075c8fc7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.015827 Sep 14 09:26:29.949519 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1182/1858] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:29.954007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:29.965579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:29.966056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:29.966482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:29.977093 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] Creating event network-changed:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h1-851028-12 Sep 14 09:26:29.987522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ed635f9f-81cf-400e-a45f-0622253157ca req-1278832f-1fb4-4ec1-995b-65626c31f06b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036832 Sep 14 09:26:29.988362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1183/1859] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:29.993988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:29.994590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:30.001364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.001852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.002283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.002985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.003981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.004450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.185396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:30.196256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3279429-e955-4999-ac55-8696a8dfb1fd tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1510 microversion: 2.1 time: 0.206218 Sep 14 09:26:30.196855 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1184/1860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:29 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1510 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:30.202633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:30.203614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:30.210729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.211418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.212041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.212902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.213508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.214089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.407466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:30.417148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e505a10-ce61-4021-ad00-682c189d2a74 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.218795 Sep 14 09:26:30.428209 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1185/1861] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:30 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:30.436729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:30.437855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:30.447524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.447524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.447524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.448282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.448752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.449246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.661898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:30.670501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e02222cc-70c2-4952-8d3e-68f289482888 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 200 len: 1680 microversion: 2.1 time: 0.251025 Sep 14 09:26:30.671087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1186/1862] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:30 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 1680 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:30.676525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:30.681462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:30.682277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6ba112b4965542eea489647d01a6476f'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:30.687715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.688238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.688678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.689398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:30.689847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:30.690270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:30.715257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:30.746045 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2236fe8e-1f14-4018-abf0-a87f3c1969bb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.073895 Sep 14 09:26:30.746639 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1187/1863] 10.222.0.90 () {58 vars in 1150 bytes} [Wed Sep 14 09:26:30 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:30.751545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1763931100", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-key-776320988", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:30.809089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:31.540406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:31.542016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:31.542685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:31.543640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:31.544281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:31.555606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:31.556754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:31.557254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:31.558195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:31.558952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:31.559574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:31.588062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:31.593573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:31.607372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:31.610038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:31.668488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6f8b87a-0c7c-4d0c-ad1c-12bf38d42948 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920731 Sep 14 09:26:31.669637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1188/1864] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:31.681862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:31.682592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:31.704239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:31.704771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:31.705279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:31.706080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:31.707190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:31.708031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:32.252281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:32.285455 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ab318bd-2093-4e98-b3b4-42bdc720b7ae tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.613970 Sep 14 09:26:32.308751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1189/1865] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:31 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:32.323081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa678f2-8587-42b3-bf92-f25b7d248eb1", "name": "network-vif-deleted", "tag": "a6ffbcfa-6700-4ebb-842c-9f81f69d770d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:32.352083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:32.352661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:32.353312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:32.371321 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] Creating event network-vif-deleted:a6ffbcfa-6700-4ebb-842c-9f81f69d770d for instance daa678f2-8587-42b3-bf92-f25b7d248eb1 on n-h1-851028-12 Sep 14 09:26:32.391247 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-20906358-2852-4a82-8f95-95581777e701 req-dfc04a45-3241-4f77-8b8c-ef26ac0e572d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073650 Sep 14 09:26:32.407401 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1190/1866] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:32.428240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:32.428240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:32.441812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:32.443349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:32.444143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:32.445104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:32.446323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:32.447696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:32.768401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:32.773663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:32.783832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2d2c8f9-8adc-4c24-990e-23030dfabed4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 200 len: 1510 microversion: 2.1 time: 0.374733 Sep 14 09:26:32.786089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1191/1867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:32 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:32.791749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:32.792892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:32.810766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:32.812069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:32.812757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:32.814250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:32.815060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:32.815842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.024153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:33.038067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7a1316d-9358-44e9-9ded-293a97bf011b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.250280 Sep 14 09:26:33.039395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1192/1868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:32 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:33.044430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:33.048680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:33.057968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.058909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.059586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.060791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.061519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.062165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.274576 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3532622-fd5a-4c5a-a77b-29b4437e83b1 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.232421 Sep 14 09:26:33.275918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1193/1869] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:33 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:33.286066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:33.286778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:33.297558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.298070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.299746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.302426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.303509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.304574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.701545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:33.718009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:33.720442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:33.723166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee41105b-d276-4313-84ca-5d562b7d4f69 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1880 microversion: 2.32 time: 0.445556 Sep 14 09:26:33.724706 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1194/1870] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:33 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1880 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:33.752854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "1997a392-ef74-4aa6-a907-5d66aab6e0c3"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "2ce7fcce-4b40-48f5-85a2-e418e5efd248"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "231602c2-98b1-46f5-b9ea-3c91cad92811"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "2cadb215-5e51-45c2-abc9-874896bafee9"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "e5599917-9c4b-499a-9b53-6c5f21cedbd6"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-plugged", "status": "completed", "tag": "6a581793-98cc-4eee-ab3b-e21fbb6ea27b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:33.768038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.768945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.770479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.787191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:1997a392-ef74-4aa6-a907-5d66aab6e0c3 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.788032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:2ce7fcce-4b40-48f5-85a2-e418e5efd248 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.788742 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:231602c2-98b1-46f5-b9ea-3c91cad92811 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.789480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:2cadb215-5e51-45c2-abc9-874896bafee9 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.790163 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:e5599917-9c4b-499a-9b53-6c5f21cedbd6 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.790851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] Creating event network-vif-plugged:6a581793-98cc-4eee-ab3b-e21fbb6ea27b for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:33.797556 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e3f2eafe-08b8-4d0c-8198-3c0e9352de1f req-4a5473c2-abad-4e76-85e4-ed3bd5b1bd68 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.071202 Sep 14 09:26:33.798800 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1195/1871] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:33.809593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:33.810552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:33.821947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.823038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.825550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:33.827093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:33.827829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:33.828392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.422331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:34.435671 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-420f2ce7-3427-44e2-962a-d2635e62c795 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.635443 Sep 14 09:26:34.443381 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1196/1872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:33 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:34.451045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:34.452214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:34.460728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.461685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.462326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.463241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.463929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.464549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.553922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:34.569428 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6b7fa66-7ab6-4d57-9b35-33e3f60e7c2d tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1286 microversion: 2.1 time: 0.123171 Sep 14 09:26:34.571175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1197/1873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:34 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1286 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:34.579819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:34.580881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:34.590417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.591352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.592359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.593749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.594548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.595278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.615156 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 HTTP/1.1 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6f2949a7-438a-435e-a3f8-154fb1188e15'} Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:34.618082 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:34.622246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:34.623768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67e53683-c180-45f7-bc22-e7a1c4689ef7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 404 len: 111 microversion: 2.1 time: 0.049816 Sep 14 09:26:34.626944 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1198/1874] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:34 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:34.634769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2949a7-438a-435e-a3f8-154fb1188e15", "name": "network-vif-deleted", "tag": "b6f43238-7709-40fe-b032-eba759bab473"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:34.650308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.651091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.651695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.666845 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] Creating event network-vif-deleted:b6f43238-7709-40fe-b032-eba759bab473 for instance 6f2949a7-438a-435e-a3f8-154fb1188e15 on n-h2-851028-12 Sep 14 09:26:34.673615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a562bcc0-f924-486b-82ae-91675aca34e1 req-728fe02f-6228-431c-bad8-53dac65b714e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044528 Sep 14 09:26:34.676640 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1199/1875] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:34.686608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:34.687601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:34.698658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.698658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.699243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.700082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.700645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.701151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.952147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:34.970760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c9ea298-6747-4a72-80e9-afe7754fdf61 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1510 microversion: 2.1 time: 0.292073 Sep 14 09:26:34.981661 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1200/1876] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:34 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:34.981661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:34.981661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:34.993035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.994069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.994813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:34.996712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:34.997591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:34.998843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:35.404129 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04c88797-8e19-49a8-a8e2-60fd6a4ff5dc tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1616 microversion: 2.1 time: 0.426376 Sep 14 09:26:35.405529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1201/1877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:34 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1616 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:35.411474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:35.412368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:35.418988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:35.419819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:35.420527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:35.421582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:35.422275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:35.422916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:35.804743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:35.813515 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03f7c43b-21e7-46cd-888b-ccba424055d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.406626 Sep 14 09:26:35.814097 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1202/1878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:35 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:35.828382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:35.829372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:35.838318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:35.838840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:35.839273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:35.840060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:35.840511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:35.840931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:36.157764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.176573 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d78f185c-2ba4-45a4-8e04-30db81376adb tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1715 microversion: 2.1 time: 0.350472 Sep 14 09:26:36.192925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1203/1879] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:35 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1715 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:36.192925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2a33b3c-7d03-4ff5-b501-ee42dca43142 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '.version_select at 0x7f693e946310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:36.209021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2a33b3c-7d03-4ff5-b501-ee42dca43142 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149686239" status: 202 len: 0 microversion: 2.1 time: 0.029767 Sep 14 09:26:36.209711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1204/1880] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149686239 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:36.221334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:36.222867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:36.229835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:36.230578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:36.231184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:36.232068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:36.232780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:36.234016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:36.758666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.769677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.771340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.772942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68af04a2-59f2-4b6f-ad33-239304d6871d tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2829 microversion: 2.32 time: 0.556321 Sep 14 09:26:36.788714 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1205/1881] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:26:36 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2829 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:36.813271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:36.818152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.819016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:36.824825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:36.825305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:36.825731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:36.826652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:36.827109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:36.827525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:36.864922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:36.928813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:36.939132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:36.939933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:36.940719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:37.207585 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bf748d51-a1bc-4078-9a89-6ecfe1c1d6c2 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 4513 microversion: 2.1 time: 0.414356 Sep 14 09:26:37.208919 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1206/1882] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:26:36 2022] GET /compute/v2.1/servers/detail => generated 4513 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:37.219415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:37.220463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:37.233463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:37.234369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:37.234939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:37.236143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:37.236716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:37.237278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:37.518215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e908ef65-77c9-4ba7-bc2b-8952f34ba7eb tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1616 microversion: 2.1 time: 0.307072 Sep 14 09:26:37.519953 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1207/1883] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:37 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1616 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:37.525030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:37.525643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:37.532622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:37.533584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:37.534325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:37.535960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:37.537322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:37.538254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.043709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:38.052136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99d82b1c-ed91-4227-bab0-929723fa9ec7 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.530859 Sep 14 09:26:38.068085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1208/1884] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:37 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:38.071948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:38.071948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:38.078375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.079232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.079818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.080576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.081024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.081538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.098439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:38.271605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:38.286645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f51517c-321a-4f46-a019-2b0612a9e30b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1328 microversion: 2.1 time: 0.221357 Sep 14 09:26:38.287293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1209/1885] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:38 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:38.291786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60", "name": "network-vif-plugged", "status": "completed", "tag": "fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702"}, {"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-plugged", "status": "completed", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:38.303009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.303493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.303947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.317802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Creating event network-vif-plugged:fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702 for instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 on n-h2-851028-12 Sep 14 09:26:38.318306 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] Creating event network-vif-plugged:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:26:38.325154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-01f3fb74-86aa-4442-ab51-60b4b4c1bedd req-6b87d005-e54f-40f4-9ac3-78c219b8b594 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036711 Sep 14 09:26:38.326016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1210/1886] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:38.331006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:38.332207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:38.338590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.339145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.339569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.340290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.340736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.341160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.521309 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f8ff104-557c-4cc6-8212-3d307e7333e3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.194250 Sep 14 09:26:38.522247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1211/1887] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:26:38 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a/os-interface => generated 1829 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:26:38.528219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:38.528895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:38.538952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.539723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.540402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.541177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.541708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.542544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.716361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:38.724867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1a1d2ab-d3ef-4f5a-8029-baa916dd369c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1317 microversion: 2.1 time: 0.201183 Sep 14 09:26:38.725464 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1212/1888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:38 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:38.730114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa7c1633-cb54-46a7-82d1-b12da8da3b08 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: .version_select at 0x7f693e939dc0>, body: {"keypair": {"name": "tempest-keypair-454044207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC34b+/My3W0hKM+8y2fSfyDlA80m+/9toEB80FMQCOYZRH3nern+gw3NuQaQrx8kyicp4pXiIQ/OiW+dxYVrLi/mc5D9EG3TLYp/2eJ3aLPxH69boOqSb8e7oRpfqExfQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:38.748938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aa7c1633-cb54-46a7-82d1-b12da8da3b08 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:38.753995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aa7c1633-cb54-46a7-82d1-b12da8da3b08 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:38.779815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa7c1633-cb54-46a7-82d1-b12da8da3b08 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053202 Sep 14 09:26:38.780484 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1213/1889] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:26:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:38.786295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:38.786923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:38.795961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.796618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.797230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:38.798109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:38.798766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:38.799704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.018217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:39.029353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31534d33-6fc6-42c5-8214-04fc5f9414f3 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1705 microversion: 2.1 time: 0.247544 Sep 14 09:26:39.044550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1214/1890] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:38 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1705 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:39.064472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:39.074374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:39.075727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:39.174481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.187705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.188525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.189451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.190987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.204545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.247633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:39.296987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a9dac16-6846-447b-a71a-24e33435b938 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.249561 Sep 14 09:26:39.300096 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1215/1891] 10.222.0.90 () {58 vars in 1150 bytes} [Wed Sep 14 09:26:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:39.315526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af26482e-96cd-4f2e-b7ee-54c507a2055c", "tag": "3bf23a78-2a68-4f3f-9cf7-3f3dc34051db"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:39.333259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.334130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.334922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.356156 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] Creating event network-changed:3bf23a78-2a68-4f3f-9cf7-3f3dc34051db for instance af26482e-96cd-4f2e-b7ee-54c507a2055c on n-h1-851028-12 Sep 14 09:26:39.362162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-59d3a99b-3a28-45fc-8a94-17903eae30e8 req-d875ca2d-af0f-41ea-babc-cba573dc3d88 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057147 Sep 14 09:26:39.364015 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1216/1892] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:39.372702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:39.379000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'host': 'n-h2-851028-12', 'deleted': False} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:39.384143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.384703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.385204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.386150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.386667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.387201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.523252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:39.645249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-109b11d4-c696-4ef2-bb80-fc64b629afdf tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers?host=n-h2-851028-12&all_tenants=1" status: 200 len: 2943 microversion: 2.1 time: 0.279564 Sep 14 09:26:39.646771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1217/1893] 10.222.0.90 () {58 vars in 1192 bytes} [Wed Sep 14 09:26:39 2022] GET /compute/v2.1/servers?host=n-h2-851028-12&all_tenants=1 => generated 2943 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:39.657627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1935734d-4ced-49ab-bd81-aec9653f037f tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '.version_select at 0x7f693ea2b790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:39.663212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1935734d-4ced-49ab-bd81-aec9653f037f tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.663715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1935734d-4ced-49ab-bd81-aec9653f037f tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.664939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1935734d-4ced-49ab-bd81-aec9653f037f tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.679566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1935734d-4ced-49ab-bd81-aec9653f037f tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.026451 Sep 14 09:26:39.688485 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1218/1894] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:26:39 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:39.695676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:39.696497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:39.700960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:39.707413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.708160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.708616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:39.710133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:39.710616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:39.711417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:40.091355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:40.110226 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f41dfb92-edcf-4a27-902e-9a29cdf01d81 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1318 microversion: 2.1 time: 0.420306 Sep 14 09:26:40.111369 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1219/1895] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:39 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:40.119872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:40.122389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:40.130018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:40.130771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:40.131372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:40.132284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:40.132882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:40.133460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:40.555108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:40.564342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e329bec-f625-4eee-87f1-8ada2d200fc1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1328 microversion: 2.1 time: 0.450135 Sep 14 09:26:40.565734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1220/1896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:40 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1328 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:40.573073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:40.580943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:40.582502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:40.600498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:40.601216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:40.601676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:40.605212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:40.605712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:40.606155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:40.794578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:41.195954 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52555589-181e-4f1a-96ad-f351c38e41b4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.627966 Sep 14 09:26:41.196829 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1221/1897] 10.222.0.90 () {58 vars in 1212 bytes} [Wed Sep 14 09:26:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:41.201528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:41.208872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:41.213834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.214580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.215089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.216403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.216536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.217003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.241438 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24e4f1da-4166-4f65-a064-ee9935b6ca0c tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043463 Sep 14 09:26:41.242349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1222/1898] 10.222.0.90 () {58 vars in 1196 bytes} [Wed Sep 14 09:26:41 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:41.249189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:41.249189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:41.256515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.256515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.256987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.257835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.258944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.259615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.445969 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b5b74de-480e-46ca-9859-9f52f78e421b tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1858 microversion: 2.1 time: 0.202152 Sep 14 09:26:41.448860 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1223/1899] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:41 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1858 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:41.455128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:41.455960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:41.464251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.464818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.465160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.465878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.466327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.466837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.632942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:41.641046 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-803c8842-deea-47d5-bd06-3bd3c82dfcb7 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1466 microversion: 2.1 time: 0.190833 Sep 14 09:26:41.641645 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1224/1900] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:41 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1466 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:41.646322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "tag": "2ce7fcce-4b40-48f5-85a2-e418e5efd248"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:41.656915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.657921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.658546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.671832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] Creating event network-changed:2ce7fcce-4b40-48f5-85a2-e418e5efd248 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:26:41.679060 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b0a5344d-b88e-4a09-9640-c815f8bb4b48 req-fab8e5ed-d0c9-4921-bad6-e7b075c93635 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036197 Sep 14 09:26:41.680594 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1225/1901] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:41.686833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:41.687550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:41.694899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.695879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.696065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.698062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.698870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.699337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.861892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:41.870619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e590432e-92a0-4aaa-b0ce-924c1add2557 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1507 microversion: 2.1 time: 0.187853 Sep 14 09:26:41.871217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1226/1902] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:41 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:41.875771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:41.881072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:41.882160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:41.888034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.888742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.889368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.890102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:41.890556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:41.890981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:41.894753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=33 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:41.982213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:42.044898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77a2713a-5c09-4626-8aee-239fd8298791 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.172604 Sep 14 09:26:42.045499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1227/1903] 10.222.0.90 () {58 vars in 1196 bytes} [Wed Sep 14 09:26:41 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:42.050055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:42.053224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:42.059235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.059718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.060174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.060857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.061330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.061733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.119452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:42.154372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9271fd6a-f895-419f-87c4-e14fe58fc78a tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.107768 Sep 14 09:26:42.155319 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1228/1904] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:42 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:42.161432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-423954156", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a04cbd6c-4f78-440b-8f5b-69cafd708616"}], "security_groups": [{"name": "tempest-securitygroup--1425907330"}], "key_name": "tempest-keypair-454044207", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:42.282932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] validate_networks() for [('a04cbd6c-4f78-440b-8f5b-69cafd708616', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:26:42.703520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:42.704103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:42.704445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:42.704906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:42.705395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:42.713008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=33 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:42.717286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.721012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.721012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.721012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.721012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.721012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.738647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:42.743472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:42.756479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:26:42.758797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:26:42.814949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c6f7b9c-da41-494e-9dc5-37f401a6e369 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658663 Sep 14 09:26:42.816734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1229/1905] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:26:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:26:42.824217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:42.824217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:42.829398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.829882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.830323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.831357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.831928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.832747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.975631 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1b226f5-7846-4d02-8363-d8ee3bc3d747 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1858 microversion: 2.1 time: 0.157515 Sep 14 09:26:42.976543 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1230/1906] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:42 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1858 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:42.981090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:42.981681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:42.989266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.989646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.990090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:42.991109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:42.993591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:42.995132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.147129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:43.155581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d042669-e9a9-45f1-acde-14a64143a6c2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1328 microversion: 2.1 time: 0.178025 Sep 14 09:26:43.156399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1231/1907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:42 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1328 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:43.166628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-554923187", "metadata": {"image_type": "test"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:43.169967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:43.177437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.178078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.178565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.179267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.179713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.180159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.223190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Getting quotas for project 9e85d24fd65549fc9d175f029b6f70da. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:26:43.229190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Getting quotas for user 7057aebe52b64551be533bb5121a70ff and project 9e85d24fd65549fc9d175f029b6f70da. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:26:43.446663 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-051e1a99-7000-4c85-a680-106a8e3257ef tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "POST /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c/action" status: 202 len: 0 microversion: 2.1 time: 0.289201 Sep 14 09:26:43.448528 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1232/1908] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:43 2022] POST /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:26:43.455623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:43.456610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:43.466273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.467294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.468732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.469709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.470225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.470668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.650004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:43.660488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92c1a447-bb09-4e16-bb84-50127b6107e0 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1507 microversion: 2.1 time: 0.209311 Sep 14 09:26:43.660488 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1233/1909] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:43 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:43.665220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:43.671344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:43.672387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': '-389072569', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:43.679808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.680321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.680750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.681584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.682031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.683545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.775197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:43.839467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f197c193-ceb8-409b-982d-93f56a53042e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=-389072569" status: 200 len: 345 microversion: 2.1 time: 0.177848 Sep 14 09:26:43.840077 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1234/1910] 10.222.0.90 () {58 vars in 1156 bytes} [Wed Sep 14 09:26:43 2022] GET /compute/v2.1/servers?name=-389072569 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:43.844700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:43.848025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:43.855131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.855618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.856089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.856782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:43.857228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:43.857645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:43.943675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:26:43.944169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:26:43.944646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:26:43.945057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:26:43.945470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:26:44.015852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:44.022887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.023301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.023731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.024466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.024924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.025346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.055923 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5371659-0bcd-4702-a07f-335c36e16d13 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 1067 microversion: 2.1 time: 0.214686 Sep 14 09:26:44.056751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1235/1911] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:26:43 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 1067 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:26:44.129615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af26482e-96cd-4f2e-b7ee-54c507a2055c", "name": "network-vif-plugged", "status": "completed", "tag": "3bf23a78-2a68-4f3f-9cf7-3f3dc34051db"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:44.140476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.141286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.141720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.155047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] Creating event network-vif-plugged:3bf23a78-2a68-4f3f-9cf7-3f3dc34051db for instance af26482e-96cd-4f2e-b7ee-54c507a2055c on n-h1-851028-12 Sep 14 09:26:44.162083 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3856866b-44ae-4530-bb70-07ba3e2c97f9 req-ca1c1317-5050-4e69-ac97-bc308bd2b948 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103708 Sep 14 09:26:44.163465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1236/1912] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:44.173261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:44.176198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:44.181426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.181936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.182382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.183338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.184172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.185460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.336301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:44.347592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99b5dd5a-8e36-4260-8eef-0091df3cb9a0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1300 microversion: 2.1 time: 0.181855 Sep 14 09:26:44.348397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1237/1913] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:44 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:44.355634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:44.356202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:44.365817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.367533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.367533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.367533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.368099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.368375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.474025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lazy-loading 'services' on Instance uuid 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:44.570160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27988d80-75be-4f5f-9196-2073c767423d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments/53b13bcc-86f8-43d0-8855-a1aef354e0d9" status: 202 len: 0 microversion: 2.1 time: 0.218453 Sep 14 09:26:44.570771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1238/1914] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:26:44 2022] DELETE /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments/53b13bcc-86f8-43d0-8855-a1aef354e0d9 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:26:44.576328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-324efa31-0abb-4c80-80b3-a8243a9a76e2 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693e9321f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:44.623878 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-324efa31-0abb-4c80-80b3-a8243a9a76e2 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1423 microversion: 2.1 time: 0.051780 Sep 14 09:26:44.624661 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1239/1915] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:44 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1423 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:44.629615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:44.632226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:44.639537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.640060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.640494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.641194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.641644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.642074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.719220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65807c43-b976-4ae5-87ce-c1729e0c8470 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "PUT /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1079 microversion: 2.1 time: 0.093650 Sep 14 09:26:44.719883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1240/1916] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:26:44 2022] PUT /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1079 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:44.725563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:44.730541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:44.731341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:44.741013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.741547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.742003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.742882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.743325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.743743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.823071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:44.854747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:44.928019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37892609-9e72-4c34-b22c-a8262f7ba35f tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.206971 Sep 14 09:26:44.936395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1241/1917] 10.222.0.90 () {58 vars in 1154 bytes} [Wed Sep 14 09:26:44 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:44.944183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:44.945152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:44.954131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.954949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.955675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:44.956493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:44.956963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:44.957410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.156924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:45.166868 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-932c7dca-7623-461f-9190-f4cf89672afe tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1471 microversion: 2.1 time: 0.229071 Sep 14 09:26:45.180463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1242/1918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:44 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:45.186872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:45.187480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:45.196667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.197498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.199191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.199191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.199191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.203020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.414207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:45.422117 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16c68590-1eb5-4b11-a79c-4c6c770df211 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1328 microversion: 2.1 time: 0.240360 Sep 14 09:26:45.422898 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1243/1919] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:45 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1328 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:45.428559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:45.430382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:45.436541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.437033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.437654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.438361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.438808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.439230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.485781 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a86c2114-63eb-4bcf-a600-191d551cb904 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061718 Sep 14 09:26:45.486523 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1244/1920] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:45 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:45.493814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:45.494193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:45.500455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.500949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.501414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.502169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.502605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.503081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.670249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:45.707194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7197350-e92b-4896-b79d-c4fec30df6cd tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1505 microversion: 2.1 time: 0.218936 Sep 14 09:26:45.718937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1245/1921] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:45 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:45.745608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:45.756265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:45.758083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-38907256', 'deleted': False, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:26:45.767850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.769197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.770444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.772025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:45.773026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:45.774001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:45.930255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:26:45.996987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58d8cbb7-ecc4-403b-9161-71035b2f71c4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38907256" status: 200 len: 345 microversion: 2.1 time: 0.276077 Sep 14 09:26:45.997585 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1246/1922] 10.222.0.90 () {58 vars in 1226 bytes} [Wed Sep 14 09:26:45 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-38907256 => generated 345 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:46.002371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:46.002966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:46.010026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.010750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.011199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.011884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.012527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.015489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.246950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:46.256285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20acfe5a-0489-4a24-ada4-a9611e7651f5 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1366 microversion: 2.1 time: 0.257380 Sep 14 09:26:46.257049 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1247/1923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:45 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:46.276465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62ac15d3-25ab-4965-88cb-ad9cc4359676 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693e946ca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:46.331036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62ac15d3-25ab-4965-88cb-ad9cc4359676 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1423 microversion: 2.1 time: 0.072356 Sep 14 09:26:46.344391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1248/1924] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:46 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:46.351536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:46.352597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:46.365153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.365954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.366676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.367869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.368651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.369358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.902378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:46.913801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce63c948-becd-4e62-9b3b-9812f27b5fd6 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1505 microversion: 2.1 time: 0.567993 Sep 14 09:26:46.914524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1249/1925] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:46 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:46.930733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:46.932733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:46.942644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.943151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.943589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.944399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:46.944856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:46.945372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:46.974145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:47.086806 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6446d01a-7230-401f-84f1-f9b4cfad96e5 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "DELETE /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 204 len: 0 microversion: 2.1 time: 0.164042 Sep 14 09:26:47.087864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1250/1926] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:46 2022] DELETE /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:47.095327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:47.096690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:47.108159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.109210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.110299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.111799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.112928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.113696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.381422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:47.389806 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73cb1dcc-ba7c-4fdf-a108-12d45bb24b70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1471 microversion: 2.1 time: 0.300237 Sep 14 09:26:47.390702 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1251/1927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:47 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:47.396135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:47.399484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:47.403330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.403536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.404002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.404887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.405357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.405792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.715890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:47.735875 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c466b08-cadc-4336-b770-09e1ce21e6f0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1509 microversion: 2.1 time: 0.338916 Sep 14 09:26:47.737485 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1252/1928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:47 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:47.746976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:47.749373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:47.763962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.764463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.764928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.765643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.766096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.766521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.808317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1311a70-0853-4a70-9b6c-fb92b15ef579 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067784 Sep 14 09:26:47.813638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1253/1929] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:47 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:47.818015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:47.821978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:47.825408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:47.830849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.831436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.832302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.833088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.833547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.833970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.919086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0c1c675-52e0-4fd7-9fdf-81b89d3bb079 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "PUT /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1081 microversion: 2.1 time: 0.105640 Sep 14 09:26:47.919640 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1254/1930] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:26:47 2022] PUT /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1081 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:47.924359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5a9435-f248-4f27-a4f8-a5b98ebdaf31", "tag": "427da0f5-1cf9-487f-849b-8f231087f747"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:47.934083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.934702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.935030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.948891 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] Creating event network-changed:427da0f5-1cf9-487f-849b-8f231087f747 for instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 on n-h1-851028-12 Sep 14 09:26:47.954011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d9d571e1-fcd3-40f3-91e4-1b9e3e5a231c req-5605d989-d360-4dc2-8ef4-94c3e640a742 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Sep 14 09:26:47.954736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1255/1931] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:47.960265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:47.960976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:47.967539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.968051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.968481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.969179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:47.969668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:47.970337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:47.990651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:48.131212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:48.139510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3423fa6f-69ba-40fd-a40e-faff41d05f1c tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1516 microversion: 2.1 time: 0.183518 Sep 14 09:26:48.140181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1256/1932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:47 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:48.145553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:48.146304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:48.152770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.153249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.153729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.154468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.154985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.155408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.310336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:48.319292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c706ecd8-9a3c-4c9b-a897-adc5e875d696 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1366 microversion: 2.1 time: 0.178052 Sep 14 09:26:48.319924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1257/1933] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:48 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:48.324978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a740969b-78b2-4da9-bde2-7efff593f4fb tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f9de8b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:48.374170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a740969b-78b2-4da9-bde2-7efff593f4fb tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1423 microversion: 2.1 time: 0.053140 Sep 14 09:26:48.374783 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1258/1934] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:48 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1423 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:48.380634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:48.381266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:48.388158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.388655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.389104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.389867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.390334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.390763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.562628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:48.571988 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3344371d-2d04-4e51-ac99-c760cd3ee4a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1509 microversion: 2.1 time: 0.195861 Sep 14 09:26:48.573149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1259/1935] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:48 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:48.579201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:48.581214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:48.590277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.591051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.591595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.592615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.593338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.593774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.747846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:48.757310 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f47ed26-e890-4b8f-b27b-1c5e32b9c9de tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1507 microversion: 2.1 time: 0.182696 Sep 14 09:26:48.758100 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1260/1936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:48 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:48.764367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:48.765201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:48.772562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.773079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.774152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:48.774937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:48.775399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:48.775826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.039491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:49.048432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9711324a-736f-4275-be3a-e89c318670a7 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1471 microversion: 2.1 time: 0.289432 Sep 14 09:26:49.049461 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1261/1937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:48 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:49.055265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:49.055890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:49.063920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.064877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.065515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.067019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.067697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.068248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.125044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:49.257094 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b88a74ba-a3f7-46e5-83a3-28af47ef2536 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 204 len: 0 microversion: 2.1 time: 0.205623 Sep 14 09:26:49.258604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1262/1938] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:49 2022] DELETE /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:49.267848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:49.268774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:49.275751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.276917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.277658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.278951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.279824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.280648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.577533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:49.589478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-229ee418-6fc3-4bbb-9740-131275f55202 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1507 microversion: 2.1 time: 0.329329 Sep 14 09:26:49.590407 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1263/1939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:49 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:49.595855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:49.599053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:49.606774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.607274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.607712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.608448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.608905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.609393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.657264 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d220567-3e80-4589-92e2-44038f8197c4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065692 Sep 14 09:26:49.663681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1264/1940] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:49 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:49.670369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:49.671281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:49.681431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.682097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.682610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.683481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.684241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.684755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.875598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:49.901183 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52eb52cf-ef82-4f6e-9b14-cbbae058a62e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1516 microversion: 2.1 time: 0.235809 Sep 14 09:26:49.920932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1265/1941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:49 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:49.926954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:49.927735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:49.934629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.935402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.935948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:49.937339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:49.937948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:49.938469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:50.150318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:50.163625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f6a9b40-a91e-45df-a4eb-70a7fdb3e7d0 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1515 microversion: 2.1 time: 0.237265 Sep 14 09:26:50.164516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1266/1942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:49 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:50.173515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:50.173804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:50.194268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:50.198602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:50.199203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:50.200317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:50.200869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:50.201306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:50.744855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:50.768694 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5d7382d-b8bd-4c4c-b44b-8ba294880d10 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1366 microversion: 2.1 time: 0.603125 Sep 14 09:26:50.779835 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1267/1943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:50 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:50.792867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2749d79f-499f-4431-8143-7eb0acb7ab31 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fa2c3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:50.896058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2749d79f-499f-4431-8143-7eb0acb7ab31 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1423 microversion: 2.1 time: 0.114383 Sep 14 09:26:50.896772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1268/1944] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:50 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:50.908808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-plugged", "status": "completed", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:50.943326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:50.943816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:50.944277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:50.970005 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] Creating event network-vif-plugged:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:26:51.004583 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7b6c079b-ca7f-4ec3-afb8-8981e661ef38 req-f752023f-053f-492e-b462-8443b2dfc0e5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106256 Sep 14 09:26:51.011325 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1269/1945] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:51.026738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:51.027212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:51.052812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:51.053551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:51.054003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:51.054851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:51.055416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:51.055931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:51.119413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:51.243523 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46d309e4-9294-454b-b305-0ec96c136ffb tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 204 len: 0 microversion: 2.1 time: 0.227782 Sep 14 09:26:51.244343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1270/1946] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:51 2022] DELETE /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:51.251146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:51.252000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:51.278427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:51.278949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:51.285992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:51.287095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:51.287599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:51.290657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:51.885900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:51.899482 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c393e8dc-9227-43b2-abaa-282f4ba001d5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1471 microversion: 2.1 time: 0.653736 Sep 14 09:26:51.909008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1271/1947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:51 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1471 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:51.915769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bfa8ab-cc6c-4295-b478-b32a440a7b49", "name": "network-vif-deleted", "tag": "240e3ba3-9852-4b02-b0d7-234acbe03731"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:51.947818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:51.949092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:51.949815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:51.966613 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] Creating event network-vif-deleted:240e3ba3-9852-4b02-b0d7-234acbe03731 for instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 on n-h2-851028-12 Sep 14 09:26:51.981081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0f3e3012-584e-46aa-816b-83c33c612e3c req-e278c579-e018-47a4-ac76-d0c7ae2af53c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064528 Sep 14 09:26:51.983346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1272/1948] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:52.012767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:52.015913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:52.062324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.063365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.067332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.068792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.069394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.069918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.077285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:52.168612 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26c78d4a-2b7d-42aa-ab5e-56f639d8bbc5 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183128 Sep 14 09:26:52.178584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1273/1949] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:26:51 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7/os-volume_attachments => generated 25 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:26:52.193265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:52.194577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:52.207536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.207946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.212951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.215460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.216041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.216485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.285156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.285625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.286028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.286479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lazy-loading 'fault' on Instance uuid 56bfa8ab-cc6c-4295-b478-b32a440a7b49 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:52.348360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:52.364465 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c9ed61a-fd8c-49d1-a84a-8734bbd186bc tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 200 len: 1310 microversion: 2.1 time: 0.184258 Sep 14 09:26:52.365285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1274/1950] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:52 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:52.371629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:52.371629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:52.377882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.378931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.379404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.380374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.381589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.382071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.439803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.440618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.442967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.444469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'fault' on Instance uuid af26482e-96cd-4f2e-b7ee-54c507a2055c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:26:52.510238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:52.529951 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42029ae5-8f16-401f-8b79-9dc9ccf3029f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 200 len: 1318 microversion: 2.1 time: 0.163342 Sep 14 09:26:52.532239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1275/1951] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:52 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:52.540260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:52.540941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:52.549063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.549566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.550007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.551254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.551889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.552510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.591761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:26:52.729278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Instance is already in deleting state, ignoring this request Sep 14 09:26:52.730212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9639ceeb-314b-4488-9982-05a83f0c1bf3 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 204 len: 0 microversion: 2.1 time: 0.196639 Sep 14 09:26:52.731079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1276/1952] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:26:52 2022] DELETE /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:26:52.737267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:52.738066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:52.754184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.756419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.756870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.757719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:52.758187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:52.759241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:52.762084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:26:53.092208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:53.120605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e381d33b-a0cf-4791-a31c-07e0f572d883 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1366 microversion: 2.1 time: 0.387936 Sep 14 09:26:53.121258 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1277/1953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:52 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:53.128254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d66e797-700f-4970-8ffb-56b50abf1983 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f850940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:53.247191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d66e797-700f-4970-8ffb-56b50abf1983 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1423 microversion: 2.1 time: 0.124513 Sep 14 09:26:53.260215 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1278/1954] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:53 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:53.266145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:53.267115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:53.282973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:53.283157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:53.283746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:53.284611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:53.285193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:53.285751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:53.666650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e324dca163fb48d1841ee61468a1133b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065eedc8ca0d41be8926e1fbb75540d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:53.680775 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f242e9b6-9690-4dd4-b037-bbaa865ccda2 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 200 len: 1513 microversion: 2.1 time: 0.419140 Sep 14 09:26:53.682143 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1279/1955] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:53 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 1513 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:53.687170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:53.689050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:53.696825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:53.696825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:53.697299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:53.708446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:53.709492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:53.709960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.061704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:54.074357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c39e929e-1ab4-4b78-a068-d7f5f3d1f16f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1471 microversion: 2.1 time: 0.390991 Sep 14 09:26:54.108993 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1280/1956] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:53 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1471 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:54.126256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5a9435-f248-4f27-a4f8-a5b98ebdaf31", "name": "network-vif-plugged", "status": "completed", "tag": "427da0f5-1cf9-487f-849b-8f231087f747"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:54.152344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.153855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.154321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.222900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] Creating event network-vif-plugged:427da0f5-1cf9-487f-849b-8f231087f747 for instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 on n-h1-851028-12 Sep 14 09:26:54.240827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b21e296b-73fd-4667-90c8-e071b2ea3cf5 req-3361d590-9f17-4265-ab5c-bd8f79e09c5d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123215 Sep 14 09:26:54.241898 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1281/1957] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:54.260684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:54.261935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: 56bfa8ab-cc6c-4295-b478-b32a440a7b49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:54.297333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.300903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.302325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.305021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.305920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.309196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.348571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] HTTP exception thrown: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Request method failure captured: Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 HTTP/1.1 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3Yp3cw5o6LI4rgZGyOeyDuJ_QF8yX1_oZ7imx61qIpXosqFJ5a68MvO5TzE4PxEMaW5HMTzyeKCJgviJLOonhJfOeX-r1T1y6OCTp-CpNmGBeV2BSGu0wdP1moR_AIbrmtSeWVJ0ac4w6SM-dCCONOqsctIeJSxGzkTM3rCJR3h80 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_113d4425ab5a4bd69e2a6d38d3528869", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/113d4425ab5a4bd69e2a6d38d3528869"}]}] Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c9110ece398944bd9f4434b7e32b98cf Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '56bfa8ab-cc6c-4295-b478-b32a440a7b49'} Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:54.352564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. Sep 14 09:26:54.360024 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.364735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Returning 404 to user: Instance 56bfa8ab-cc6c-4295-b478-b32a440a7b49 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:54.366532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b0acef1-af34-40db-bf4a-c7fe77bdbbc8 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49" status: 404 len: 111 microversion: 2.1 time: 0.122910 Sep 14 09:26:54.368073 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1282/1958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:54 2022] GET /compute/v2.1/servers/56bfa8ab-cc6c-4295-b478-b32a440a7b49 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:54.379494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:54.380717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:54.388776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.390412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.391435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.393790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.395168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.396200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.415760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c HTTP/1.1 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'af26482e-96cd-4f2e-b7ee-54c507a2055c'} Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.419764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:26:54.428872 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:26:54.445294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:26:54.446884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-156e2303-df6f-4aa8-a6fb-f8173b3599ec tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 404 len: 111 microversion: 2.1 time: 0.077536 Sep 14 09:26:54.453248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1283/1959] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:54 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:26:54.465434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af26482e-96cd-4f2e-b7ee-54c507a2055c", "name": "network-vif-deleted", "tag": "3bf23a78-2a68-4f3f-9cf7-3f3dc34051db"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:26:54.491966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.493409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.494514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.516154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] Creating event network-vif-deleted:3bf23a78-2a68-4f3f-9cf7-3f3dc34051db for instance af26482e-96cd-4f2e-b7ee-54c507a2055c on n-h1-851028-12 Sep 14 09:26:54.523467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f5463bd2-2259-4836-b43d-6d248cdb13d2 req-4f12019e-c82f-41ca-833d-6e3e859cad05 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067680 Sep 14 09:26:54.524989 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1284/1960] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:26:54.537296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:54.538783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:26:54.548969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.550011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.550759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.551923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:26:54.552717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:26:54.553664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:26:54.977855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:26:54.996881 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f26888a0-1fbc-4616-b3df-82a1bfb65f67 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1366 microversion: 2.1 time: 0.469129 Sep 14 09:26:55.001864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1285/1961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:26:54 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:26:55.037130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66ec0cc0-1e1d-4b88-8c7f-be253a5a16b9 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fa6aca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:26:55.841489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=9 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:03.376921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66ec0cc0-1e1d-4b88-8c7f-be253a5a16b9 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1432 microversion: 2.1 time: 8.371616 Sep 14 09:27:03.377666 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1286/1962] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:26:55 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1432 bytes in 8375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:03.382251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:03.382913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:03.392348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.392845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.393284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.393996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.394993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.395600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.423467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:03.515522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f30859b-8a40-4cfd-b9d6-eff95be52a95 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 204 len: 0 microversion: 2.1 time: 0.136548 Sep 14 09:27:03.516137 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1287/1963] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:03 2022] DELETE /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:03.523787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bfa80ede-0ce5-488c-aa0d-ab46515cc4ff tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '.version_select at 0x7f693fda8940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:03.553539 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bfa80ede-0ce5-488c-aa0d-ab46515cc4ff tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-key-776320988" status: 202 len: 0 microversion: 2.1 time: 0.035960 Sep 14 09:27:03.560045 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1288/1964] 10.222.0.90 () {58 vars in 1206 bytes} [Wed Sep 14 09:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-776320988 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:27:03.565236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:03.567032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:03.575565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.576493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.577162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.577891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.578364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.578782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.596502 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] HTTP exception thrown: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Request method failure captured: Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 HTTP/1.1 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2rl1oVaOPZxkVKm3tS_ZjiP-60eAL7x14aaabN02aFYPisV7CvuFRKch_8qvtKpNxfIT53ZaLSPtdpvt9dtNv_N_-KuCrZpMIpBExavkdxfA4M36kAb7THSSluFx1HrkDUqzDSbCd8xVzbOyUQGrAQNhL2peRIdgo-PG8AYNQbqFk Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_065eedc8ca0d41be8926e1fbb75540d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/065eedc8ca0d41be8926e1fbb75540d9"}]}] Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e324dca163fb48d1841ee61468a1133b Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60'} Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:03.598532 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Returning 404 to user: Instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:03.603180 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-beaa4a1c-2d4b-441f-8e14-646d6d736f82 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60" status: 404 len: 111 microversion: 2.1 time: 0.038901 Sep 14 09:27:03.603825 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1289/1965] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:03 2022] GET /compute/v2.1/servers/60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:03.608936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:03.609576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:03.616809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.617292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.617741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.618460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.618919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.619704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.776629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:03.792862 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bb18f11-64a4-4738-89aa-da82c5de80dd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1477 microversion: 2.1 time: 0.187350 Sep 14 09:27:03.793272 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1290/1966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:03 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:03.799198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:03.800022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:03.807570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.808186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.808804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.809986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.810563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.811278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:03.971392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:03.980071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f2aac3f-a6a3-4214-acdc-02c52d0e5ad7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1556 microversion: 2.1 time: 0.185584 Sep 14 09:27:03.980752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1291/1967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:03 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:03.985808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60", "name": "network-vif-deleted", "tag": "fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:03.997020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:03.997499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:03.997925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.011139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] Creating event network-vif-deleted:fc169d1a-fa6a-444d-a6ab-7f1aaf0ba702 for instance 60b8e2a2-1ddd-4be2-b4de-dadf6bca3d60 on n-h2-851028-12 Sep 14 09:27:04.016790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-733f3d9a-9671-4d30-8741-05a481818063 req-0b48e6b7-e337-4588-8e40-770aea56baa3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034687 Sep 14 09:27:04.017734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1292/1968] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:04.022943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a33b139-539a-4629-9db9-84f3a237dc30 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f9ded30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:04.077504 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a33b139-539a-4629-9db9-84f3a237dc30 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 200 len: 1432 microversion: 2.1 time: 0.058814 Sep 14 09:27:04.078117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1293/1969] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:04 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 1432 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:04.083720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:04.084124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:04.090886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.091443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.091823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.092564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.093015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.093440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.097900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:04.263490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:04.273023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3eb1e755-8029-4445-919e-fba791b14496 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 200 len: 1516 microversion: 2.1 time: 0.193834 Sep 14 09:27:04.273956 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1294/1970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:04 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:04.278333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:04.278834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:04.287553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.288169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.288620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.289524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.290007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.290807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.307985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] HTTP exception thrown: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Request method failure captured: Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 HTTP/1.1 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2rl1oVaOPZxkVKm3tS_ZjiP-60eAL7x14aaabN02aFYPisV7CvuFRKch_8qvtKpNxfIT53ZaLSPtdpvt9dtNv_N_-KuCrZpMIpBExavkdxfA4M36kAb7THSSluFx1HrkDUqzDSbCd8xVzbOyUQGrAQNhL2peRIdgo-PG8AYNQbqFk Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_065eedc8ca0d41be8926e1fbb75540d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/065eedc8ca0d41be8926e1fbb75540d9"}]}] Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e324dca163fb48d1841ee61468a1133b Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9fca862d-f120-453f-984f-5858f579a581'} Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:04.309561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:04.313022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Returning 404 to user: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:04.313714 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6998f9a-828c-44b3-9e7e-983622e7aa14 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 404 len: 111 microversion: 2.1 time: 0.038510 Sep 14 09:27:04.314273 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1295/1971] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:04 2022] DELETE /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:04.320048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1007588576", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:04.392120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:27:04.882542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:04.883012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:04.883532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:04.884155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:04.884873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:04.887104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:04.900109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.900679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.901250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.902054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:04.902508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:04.902936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:04.930297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:04.936374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:04.951724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:04.954278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:05.013924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbb3d100-1211-4509-935f-2aa8aa90ee25 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698123 Sep 14 09:27:05.014931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1296/1972] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:27:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:27:05.020445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:05.021079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:05.029390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.029893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.030336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.031128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.031591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.032195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.183746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e126d68-6a49-4ec8-8f3f-9cf43d822c18 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167549 Sep 14 09:27:05.184529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1297/1973] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:27:05 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:05.194253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:05.194253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:05.209852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.210362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.210807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.211638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.212124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.212554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.526582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:05.535041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87917047-a832-4497-aee1-b4dfb32330ac tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1466 microversion: 2.1 time: 0.349365 Sep 14 09:27:05.536003 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1298/1974] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:05 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1466 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:05.540668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:05.541298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 9fca862d-f120-453f-984f-5858f579a581] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:05.554922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.560513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.562825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.563625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.564129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.564565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.593833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] HTTP exception thrown: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Request method failure captured: Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 HTTP/1.1 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2rl1oVaOPZxkVKm3tS_ZjiP-60eAL7x14aaabN02aFYPisV7CvuFRKch_8qvtKpNxfIT53ZaLSPtdpvt9dtNv_N_-KuCrZpMIpBExavkdxfA4M36kAb7THSSluFx1HrkDUqzDSbCd8xVzbOyUQGrAQNhL2peRIdgo-PG8AYNQbqFk Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_065eedc8ca0d41be8926e1fbb75540d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/065eedc8ca0d41be8926e1fbb75540d9"}]}] Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e324dca163fb48d1841ee61468a1133b Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9fca862d-f120-453f-984f-5858f579a581'} Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:05.596195 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:05.601613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Returning 404 to user: Instance 9fca862d-f120-453f-984f-5858f579a581 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:05.602984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c586a706-3989-4f40-9ace-1547055f5f8c tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581" status: 404 len: 111 microversion: 2.1 time: 0.065556 Sep 14 09:27:05.607168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1299/1975] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:05 2022] GET /compute/v2.1/servers/9fca862d-f120-453f-984f-5858f579a581 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:05.614561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:05.616214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:05.627004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.627860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.628437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:05.629936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:05.631270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:05.631818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.068544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:06.082871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ad3bfbcd-80a9-4423-957e-52d501fc014c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1477 microversion: 2.1 time: 0.477461 Sep 14 09:27:06.087949 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1300/1976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:05 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1477 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:06.088733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.089350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:06.107539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.108073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.108517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.115825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.118801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.118801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.255277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:06.261259 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09d59787-f855-46d0-82da-459425b6a499 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1205 microversion: 2.1 time: 0.176080 Sep 14 09:27:06.276807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1301/1977] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:06 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1205 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:06.284419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.284419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:06.290398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.290907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.291333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.292089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.292549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.292976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.378396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:06.389281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bdcb986e-1e72-4535-ac6a-6441985633a4 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 200 len: 1305 microversion: 2.1 time: 0.111214 Sep 14 09:27:06.389900 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1302/1978] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:06 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:06.399251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9c0b10c-beb2-40ec-8b30-9661c7ff8693 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f0638b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.481000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9c0b10c-beb2-40ec-8b30-9661c7ff8693 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55" status: 200 len: 784 microversion: 2.1 time: 0.089994 Sep 14 09:27:06.481725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1303/1979] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:06 2022] GET /compute/v2.1/images/cd58b78d-2815-4d3d-9878-b3c3c5fdce55 => generated 784 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:06.504573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.505367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:06.521930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.522438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.522927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.523716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.524229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.524632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.560390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] HTTP exception thrown: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Request method failure captured: Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 HTTP/1.1 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2rl1oVaOPZxkVKm3tS_ZjiP-60eAL7x14aaabN02aFYPisV7CvuFRKch_8qvtKpNxfIT53ZaLSPtdpvt9dtNv_N_-KuCrZpMIpBExavkdxfA4M36kAb7THSSluFx1HrkDUqzDSbCd8xVzbOyUQGrAQNhL2peRIdgo-PG8AYNQbqFk Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_065eedc8ca0d41be8926e1fbb75540d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/065eedc8ca0d41be8926e1fbb75540d9"}]}] Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e324dca163fb48d1841ee61468a1133b Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3edef393-edfa-4999-b821-eb052e9c0693'} Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:06.561901 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Returning 404 to user: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:06.566721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-07a93250-2d22-4928-a292-6d4b12b3dbc1 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 404 len: 111 microversion: 2.1 time: 0.068593 Sep 14 09:27:06.572637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1304/1980] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:06 2022] DELETE /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:06.579540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad42d30-6426-4382-a73f-d01e686a7a97", "name": "network-vif-deleted", "tag": "8fb85bcd-f8e1-45b2-a635-171bf5f950e2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:06.601935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.602423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.605553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.640640 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] Creating event network-vif-deleted:8fb85bcd-f8e1-45b2-a635-171bf5f950e2 for instance fad42d30-6426-4382-a73f-d01e686a7a97 on n-h1-851028-12 Sep 14 09:27:06.653447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2eada5c8-1604-4845-917e-f719e6f90967 req-dc8bcff8-2ca9-49cd-851d-808449200161 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083713 Sep 14 09:27:06.656149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1305/1981] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:06.670930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a520f2f-6913-4d59-8b1f-22628d13070e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.686734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a520f2f-6913-4d59-8b1f-22628d13070e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019389 Sep 14 09:27:06.688230 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1306/1982] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:27:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:06.695119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:06.696648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] [instance: 3edef393-edfa-4999-b821-eb052e9c0693] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:06.707540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.708813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.709538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.711037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:06.712384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:06.714359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:06.750528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] HTTP exception thrown: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Request method failure captured: Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 HTTP/1.1 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2rl1oVaOPZxkVKm3tS_ZjiP-60eAL7x14aaabN02aFYPisV7CvuFRKch_8qvtKpNxfIT53ZaLSPtdpvt9dtNv_N_-KuCrZpMIpBExavkdxfA4M36kAb7THSSluFx1HrkDUqzDSbCd8xVzbOyUQGrAQNhL2peRIdgo-PG8AYNQbqFk Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_065eedc8ca0d41be8926e1fbb75540d9", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/065eedc8ca0d41be8926e1fbb75540d9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/065eedc8ca0d41be8926e1fbb75540d9"}]}] Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 065eedc8ca0d41be8926e1fbb75540d9 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1342600682 Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e324dca163fb48d1841ee61468a1133b Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1342600682-project Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3edef393-edfa-4999-b821-eb052e9c0693'} Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:06.754923 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. Sep 14 09:27:06.758621 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:06.762949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] Returning 404 to user: Instance 3edef393-edfa-4999-b821-eb052e9c0693 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:06.764246 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a862d4c9-41e9-4d9a-bf27-e5e8f2403358 tempest-ServerDiskConfigTestJSON-1342600682 tempest-ServerDiskConfigTestJSON-1342600682-project] 10.222.0.90 "GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693" status: 404 len: 111 microversion: 2.1 time: 0.074629 Sep 14 09:27:06.765818 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1307/1983] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:06 2022] GET /compute/v2.1/servers/3edef393-edfa-4999-b821-eb052e9c0693 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:06.779415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5e33e52-5f51-488b-bdfe-a545b8eab9fe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fa22af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:07.888288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5e33e52-5f51-488b-bdfe-a545b8eab9fe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "DELETE /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 204 len: 0 microversion: 2.1 time: 1.120819 Sep 14 09:27:07.889151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1308/1984] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:06 2022] DELETE /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 0 bytes in 1123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:07.898582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:07.902432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:07.926757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:07.936557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:07.938204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:07.939719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:07.945027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:07.945991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.565171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:08.583642 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb2b0afa-e688-45ee-8b2b-b29a214fd48b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1477 microversion: 2.1 time: 0.693084 Sep 14 09:27:08.588260 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1309/1985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:07 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1477 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:08.603209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:08.604143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:08.619061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.624865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.625620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.627863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.629389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.640009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.752918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:08.766704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a933a484-8512-4d38-aeb9-a71b6c4c12d9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1267 microversion: 2.1 time: 0.176408 Sep 14 09:27:08.768540 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1310/1986] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:08 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:08.775641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:08.777115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: fad42d30-6426-4382-a73f-d01e686a7a97] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:08.784162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.785034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.785756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.786720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.787187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.787623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.810625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] HTTP exception thrown: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Request method failure captured: Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 HTTP/1.1 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3Yp3cw5o6LI4rgZGyOeyDuJ_QF8yX1_oZ7imx61qIpXosqFJ5a68MvO5TzE4PxEMaW5HMTzyeKCJgviJLOonhJfOeX-r1T1y6OCTp-CpNmGBeV2BSGu0wdP1moR_AIbrmtSeWVJ0ac4w6SM-dCCONOqsctIeJSxGzkTM3rCJR3h80 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_113d4425ab5a4bd69e2a6d38d3528869", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/113d4425ab5a4bd69e2a6d38d3528869"}]}] Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c9110ece398944bd9f4434b7e32b98cf Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'fad42d30-6426-4382-a73f-d01e686a7a97'} Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:08.812224 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Returning 404 to user: Instance fad42d30-6426-4382-a73f-d01e686a7a97 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:08.815920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b046c3f-cadc-4379-82c6-cc9c454fb58e tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97" status: 404 len: 111 microversion: 2.1 time: 0.043374 Sep 14 09:27:08.818735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1311/1987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:08 2022] GET /compute/v2.1/servers/fad42d30-6426-4382-a73f-d01e686a7a97 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:08.824688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5a9435-f248-4f27-a4f8-a5b98ebdaf31", "tag": "427da0f5-1cf9-487f-849b-8f231087f747"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:08.841953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.842694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.843569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.857445 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] Creating event network-changed:427da0f5-1cf9-487f-849b-8f231087f747 for instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 on n-h1-851028-12 Sep 14 09:27:08.864173 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c60b1ecd-9877-4792-947f-a7c6d6abdf0c req-43378c61-8781-4b8a-b029-c354646ed038 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043137 Sep 14 09:27:08.865537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1312/1988] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:08.871695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e32905bf-21da-4fb7-b9dc-1aff341c7079 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f93e040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:08.903718 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e32905bf-21da-4fb7-b9dc-1aff341c7079 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] HTTP exception thrown: Image not found. Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e32905bf-21da-4fb7-b9dc-1aff341c7079 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Request method failure captured: Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e HTTP/1.1 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ46cS9a0f_H9tDQoUqlIY_e9zsIA6U1_b5y0v4sE4xr_1xPH1Kb6tRFUhPFt7-7_y-1dQFFA_7a30OsziumBaLihY1aii4I6puUecAsC1e7UycUanzuAxwDztw86KI7YppEDm5JvgpNHI2wyQMNHzZRPOLh7p9aV6vDVxn_DTvypTs Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9e85d24fd65549fc9d175f029b6f70da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9e85d24fd65549fc9d175f029b6f70da"}]}] Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 7057aebe52b64551be533bb5121a70ff Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3838a510-4e94-4899-9b7d-07bdd088325e'} Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3838a510-4e94-4899-9b7d-07bdd088325e Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:27:08.908835 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3838a510-4e94-4899-9b7d-07bdd088325e could not be found. Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:27:08.914747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:08.920786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e32905bf-21da-4fb7-b9dc-1aff341c7079 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:08.920786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e32905bf-21da-4fb7-b9dc-1aff341c7079 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 404 len: 62 microversion: 2.1 time: 0.050119 Sep 14 09:27:08.920786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1313/1989] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:08 2022] GET /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:27:08.927401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "name": "network-vif-plugged", "status": "completed", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:08.941943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.942437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.942871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.958390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] Creating event network-vif-plugged:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:27:08.967362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3600551b-78b8-48d8-af3c-d37de84ba45c req-1f779697-46ed-43e5-afda-16cb19198733 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046883 Sep 14 09:27:08.969061 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1314/1990] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:08.980539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:08.981471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:08.995069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:08.996055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:08.997208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:08.999217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:09.000201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:09.000856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:09.084404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:09.305625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe163418-ecf3-4b36-bbdf-2c2298419ae9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 204 len: 0 microversion: 2.1 time: 0.331704 Sep 14 09:27:09.310348 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1315/1991] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:08 2022] DELETE /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:09.316828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-813469642"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:09.319293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:09.328163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:09.328921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:09.329613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:09.330590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:09.332092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:09.332806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:09.657188 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ee0afdf-5f86-4560-a8bd-7b8e2314ca65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "POST /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c/action" status: 202 len: 0 microversion: 2.1 time: 0.330322 Sep 14 09:27:09.659362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1316/1992] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:27:09 2022] POST /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:27:09.676287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:09.678600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:09.687568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:09.689050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:09.689504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:09.690437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:09.690761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:09.691485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:10.090015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:10.109725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f5789e1-aac9-4485-a9db-d2c8d1d360e9 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1516 microversion: 2.1 time: 0.446990 Sep 14 09:27:10.111074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1317/1993] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:09 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1516 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:10.117275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:10.117980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:10.126653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:10.127524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:10.128344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:10.129713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:10.130393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:10.131041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:10.137794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:10.392888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:10.402773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68622d0e-5a16-4931-92a2-bc0579a75a8f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1477 microversion: 2.1 time: 0.290392 Sep 14 09:27:10.404349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1318/1994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:10 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:10.409297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d2d4736-86f4-4503-a3f2-637bb329506f tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f063a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:10.502881 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d2d4736-86f4-4503-a3f2-637bb329506f tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.097326 Sep 14 09:27:10.511554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1319/1995] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:10 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:10.516661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:10.517498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:10.526447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:10.527283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:10.528098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:10.531284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:10.531929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:10.532490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:10.916385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:10.927287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b64c8ac0-ad61-4fe5-9dac-60da34aa57fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.413626 Sep 14 09:27:10.928575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1320/1996] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:10 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:10.988358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-unplugged", "status": "completed", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:11.021916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:11.023048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:11.024467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:11.054636 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] Creating event network-vif-unplugged:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:27:11.086956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ce298f3e-2ce7-4aec-a9a2-5d3e416b8b3b req-7ad74e90-932c-40ca-995b-4b68ccc05890 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102697 Sep 14 09:27:11.087676 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1321/1997] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:27:11.140763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:11.142705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:11.151643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:11.152559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:11.153216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:11.154458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:11.155753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:11.156408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:11.707378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9110ece398944bd9f4434b7e32b98cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '113d4425ab5a4bd69e2a6d38d3528869', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:11.720632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1de7f9f8-580e-43d5-916c-226b116be6c6 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 200 len: 1516 microversion: 2.1 time: 0.584787 Sep 14 09:27:11.721601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1322/1998] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:11 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 1516 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:11.731763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:11.736116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:11.748969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:11.749472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:11.749918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:11.762467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:11.763057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:11.763711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:12.211876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:12.223292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72d965e8-f076-4547-b329-40c4325dda28 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1463 microversion: 2.1 time: 0.499805 Sep 14 09:27:12.235923 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1323/1999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:11 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1463 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:12.237218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d83abe2-5803-4029-be47-4d3579416771 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f93e0d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:12.325009 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d83abe2-5803-4029-be47-4d3579416771 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.094014 Sep 14 09:27:12.326718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1324/2000] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:12 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:12.361127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:12.364349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:12.394271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:12.395585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:12.397154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:12.399119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:12.401603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:12.402804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:12.851666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:12.863026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c793266-a4c0-43cd-b45a-f9cf56be01de tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.534810 Sep 14 09:27:12.875818 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1325/2001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:12 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:12.884388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:12.885176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:12.893730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:12.896031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:12.896543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:12.897432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:12.899008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:12.899466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:13.676510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:13.689496 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a08fd220-95bf-46bd-90b1-fc78afaae240 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1463 microversion: 2.1 time: 0.812483 Sep 14 09:27:13.690268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1326/2002] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:12 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1463 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:13.714539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00e7b84-acbf-48cb-91d1-3b4278875b71", "name": "network-vif-deleted", "tag": "4eecdbb4-04f3-4db6-95be-7515c7eab0b2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:13.729693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:13.730186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:13.730623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:13.746276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] Creating event network-vif-deleted:4eecdbb4-04f3-4db6-95be-7515c7eab0b2 for instance e00e7b84-acbf-48cb-91d1-3b4278875b71 on n-h1-851028-12 Sep 14 09:27:13.755393 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-43865822-70db-43b1-942d-a77c37b5624e req-c877107e-bab7-4780-9789-195b44bc5f76 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049919 Sep 14 09:27:13.756769 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1327/2003] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:13.763258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:13.764321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] [instance: e00e7b84-acbf-48cb-91d1-3b4278875b71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:13.771635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:13.772431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:13.772984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:13.773970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:13.774526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:13.775088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:13.792292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] HTTP exception thrown: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Request method failure captured: Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 HTTP/1.1 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ3Yp3cw5o6LI4rgZGyOeyDuJ_QF8yX1_oZ7imx61qIpXosqFJ5a68MvO5TzE4PxEMaW5HMTzyeKCJgviJLOonhJfOeX-r1T1y6OCTp-CpNmGBeV2BSGu0wdP1moR_AIbrmtSeWVJ0ac4w6SM-dCCONOqsctIeJSxGzkTM3rCJR3h80 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_113d4425ab5a4bd69e2a6d38d3528869", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/113d4425ab5a4bd69e2a6d38d3528869"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/113d4425ab5a4bd69e2a6d38d3528869"}]}] Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 113d4425ab5a4bd69e2a6d38d3528869 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-12284232 Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c9110ece398944bd9f4434b7e32b98cf Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServerFiltersTestJSON-12284232-project Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e00e7b84-acbf-48cb-91d1-3b4278875b71'} Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:13.794083 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:13.798894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] Returning 404 to user: Instance e00e7b84-acbf-48cb-91d1-3b4278875b71 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:13.800116 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efcfbaab-c2f9-40fb-b0f7-571074eff7e3 tempest-ListServerFiltersTestJSON-12284232 tempest-ListServerFiltersTestJSON-12284232-project] 10.222.0.90 "GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71" status: 404 len: 111 microversion: 2.1 time: 0.041949 Sep 14 09:27:13.800952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1328/2004] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:13 2022] GET /compute/v2.1/servers/e00e7b84-acbf-48cb-91d1-3b4278875b71 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:13.806230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f73ca1c-4e9b-4c98-b7ed-65964173b6a8 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f86b550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:13.857889 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f73ca1c-4e9b-4c98-b7ed-65964173b6a8 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.055461 Sep 14 09:27:13.866859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1329/2005] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:13 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:13.873488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:13.876884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:13.888052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:13.888763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:13.889424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:13.890307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:13.890911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:13.891491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:14.017298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:14.017621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:14.020967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:14.021614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:14.022228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:14.176662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:14.200891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:14.201460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:14.202076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:14.202956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:14.203621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:14.205991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:14.303886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2bae141a-a574-45be-a364-41ecb23a8de8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 1067 microversion: 2.1 time: 0.432304 Sep 14 09:27:14.306908 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1330/2006] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:27:13 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 1067 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 09:27:14.314664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:14.315285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:14.336890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:14.337625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:14.338072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:14.342843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:14.346605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:14.346605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:14.916762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:14.945497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:14.967263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:14.980557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ec330ee6-2e95-4f4b-815f-626a6b593d94 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.672219 Sep 14 09:27:14.992244 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1331/2007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:14 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:15.012705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:15.013901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:15.025775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:15.029702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:15.031023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:15.032074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:15.034177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:15.042538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:15.537621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:15.548659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f1a062f-4c4b-4fd7-9254-1b39fff6121b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.554338 Sep 14 09:27:15.549427 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1332/2008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:14 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:15.563464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4ce92ea3-3628-43a3-b48c-0fa8531f10bf tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f6944428040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:15.649006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4ce92ea3-3628-43a3-b48c-0fa8531f10bf tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.093850 Sep 14 09:27:15.652216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1333/2009] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:15 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:15.814399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c7def9-4769-4c28-8aaa-b15e960ea346", "tag": "8043924d-38f5-4e72-91c1-a3c6eac9bf1b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:15.836467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:15.836966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:15.837391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:15.870616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] Creating event network-changed:8043924d-38f5-4e72-91c1-a3c6eac9bf1b for instance b2c7def9-4769-4c28-8aaa-b15e960ea346 on n-h1-851028-12 Sep 14 09:27:15.876839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1dd05714-550e-4040-a139-4d827319ee1b req-df400b46-efea-4b71-b0a3-8af409ff87bd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066079 Sep 14 09:27:15.877808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1334/2010] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:27:16.015863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:16.016590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:16.030993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:16.031428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:16.031867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:16.032617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:16.033074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:16.033501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:16.608780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:16.618485 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9df617b1-d473-4647-8ee9-53f6b7dbbfac tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.607801 Sep 14 09:27:16.644099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1335/2011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:16 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:27:16.650449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:16.651474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:16.670289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:16.671006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:16.671639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:16.672492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:16.674067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:16.684720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:16.932493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:16.947080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0127b518-9c6c-45e5-a30b-a0e84394ac2e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.298195 Sep 14 09:27:16.947874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1336/2012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:16 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:16.978447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2aab959-9589-41d7-bf31-a794620c4f65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f75e1f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:17.067510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2aab959-9589-41d7-bf31-a794620c4f65 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.102274 Sep 14 09:27:17.077233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1337/2013] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:16 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:17.637650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-plugged", "status": "completed", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:17.669195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:17.669961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:17.672646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:17.703598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] Creating event network-vif-plugged:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:27:17.738037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-99683571-31ec-4de7-b365-9d9823959005 req-80129df0-5242-4341-ad5c-76dd1c8ee1a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104939 Sep 14 09:27:17.739708 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1338/2014] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:17.760097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:17.762125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:17.775909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:17.776706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:17.778654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:17.782617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:17.785392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:17.786255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:18.116936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:18.127186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8bec6f1-8088-43d6-a5cc-bc6fd0205cc4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.385007 Sep 14 09:27:18.129910 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1339/2015] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:17 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:18.145756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:18.148079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:18.173256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:18.175885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:18.180667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:18.181758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:18.183180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:18.186472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:18.510294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:18.523767 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-958ce563-512d-42cb-9b73-5967f8797488 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.391969 Sep 14 09:27:18.526031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1340/2016] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:18 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:18.538238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7bb7764-ceda-475b-a623-1accc92fee2f tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f06ec10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:18.627733 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7bb7764-ceda-475b-a623-1accc92fee2f tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.100278 Sep 14 09:27:18.629841 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1341/2017] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:18 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:19.187314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:19.188091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:19.213477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.215390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.217219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:19.218639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.221418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.222375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:19.231942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:19.468688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:19.480732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f711dcb-459a-4e68-965a-1bbdca4c6aef tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.326042 Sep 14 09:27:19.486292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1342/2018] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:19 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:27:19.668851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1194560495", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:19.750678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:19.751470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:19.752795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:19.753435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:19.754859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:19.760914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:19.767452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.768294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.768910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:19.769904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.770651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.771287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:19.795943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Getting quotas for project 7aa4cac1e10b4188841a7db1a130b5ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:19.806240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Getting quotas for user e2578092d0f04990ae49d6e074575a88 and project 7aa4cac1e10b4188841a7db1a130b5ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:19.821956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:19.828100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:19.895529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9705d2de-00bf-48f0-98ab-53d4ad78402c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.407471 Sep 14 09:27:19.896946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1343/2019] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:27:19.902950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:19.903854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:19.911873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.912744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.913401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:19.914352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:19.915025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:19.915673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:20.120785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:20.133456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-93a5b999-e097-4872-a6d2-9c5dea8675b5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.234533 Sep 14 09:27:20.145875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1344/2020] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:19 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:20.145875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14a40011-aab6-4dd4-abce-8ebcbb2dad70 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f69441b98b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:20.216200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14a40011-aab6-4dd4-abce-8ebcbb2dad70 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.079829 Sep 14 09:27:20.218073 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1345/2021] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:20 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:20.223689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c7def9-4769-4c28-8aaa-b15e960ea346", "name": "network-vif-plugged", "status": "completed", "tag": "8043924d-38f5-4e72-91c1-a3c6eac9bf1b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:20.235674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:20.236274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:20.236857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:20.251313 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] Creating event network-vif-plugged:8043924d-38f5-4e72-91c1-a3c6eac9bf1b for instance b2c7def9-4769-4c28-8aaa-b15e960ea346 on n-h1-851028-12 Sep 14 09:27:20.257152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3e7dec80-0a33-4c0c-9da3-f90432ab16d0 req-dbba0f48-f007-4ada-a73f-51b9e2b1cc1c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037766 Sep 14 09:27:20.257878 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1346/2022] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:20.266673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:20.267621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:20.333585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:20.342158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:20.344473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:20.345816 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a6e5b0e-1fa9-4d0a-897a-5bb7b2a0ceb6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1278 microversion: 2.57 time: 0.086366 Sep 14 09:27:20.346897 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1347/2023] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:20 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:20.353704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1820465047", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8"}], "block_device_mapping_v2": [{"uuid": "c686bafa-9a16-49fe-9fb6-0b6ecd17e2e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:20.467721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] validate_networks() for [('d0ebd700-88bd-404d-9d21-6a9dbf8ad2e8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:27:21.547269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:21.547938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:21.548216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:21.548600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:21.549052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:21.570168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:21.574608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:21.575148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:21.575975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:21.576457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:21.577074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:21.619235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:21.638581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Getting quotas for user acf0e1a651e34682923f8eb74872adb1 and project 99a70cfdb4e44723b3900decc2ec03a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:21.792851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:21.795035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c686bafa-9a16-49fe-9fb6-0b6ecd17e2e2',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:22.052985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fbd4dad5-9093-44a9-ab8f-3f8ed6669e6b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.702933 Sep 14 09:27:22.054960 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1348/2024] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:27:22.089425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:22.092815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:22.126889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:22.130034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:22.131192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:22.132156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:22.132753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:22.133335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:22.798366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:22.808273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb596c1a-e5c7-4286-8a24-c184fa78588f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1309 microversion: 2.1 time: 0.745972 Sep 14 09:27:22.809147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1349/2025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:22 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1309 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:22.833840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:22.836537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:22.849469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:22.849991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:22.850434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:22.851159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:22.851618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:22.852118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.187781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:23.201161 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4202e0e0-ee16-4eae-a5c6-e8b0ae0eda7b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.375045 Sep 14 09:27:23.221429 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1350/2026] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:22 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:23.231608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3e6c6c3-5389-49bc-9a91-4e283b2a340e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f75e8b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:23.296518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3e6c6c3-5389-49bc-9a91-4e283b2a340e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.071469 Sep 14 09:27:23.297313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1351/2027] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:23 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:23.310119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:23.317490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:23.335381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.337713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.338648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.339692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.343648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.344383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.531422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:23.544954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:23.546971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:23.548432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b52c4851-1804-46a0-9b24-9b7895fe9abb tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1336 microversion: 2.57 time: 0.249939 Sep 14 09:27:23.549572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1352/2028] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:23 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1336 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:23.576752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:23.577640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:23.600408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.602213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.602831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.603715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.604368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.604973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.701827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:23.712950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0284f2e9-db34-483f-b732-36a5b89197b1 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1151 microversion: 2.1 time: 0.142077 Sep 14 09:27:23.714326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1353/2029] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:23 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1151 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:23.838924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:23.839851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:23.850877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.851380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.851818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:23.858433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:23.858929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:23.859374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:24.220987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:24.237607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-962ce0b8-fa2b-4458-8746-7081d9bc0f48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1490 microversion: 2.1 time: 0.403866 Sep 14 09:27:24.240196 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1354/2030] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:23 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1490 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:24.246254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:24.247070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:24.254853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:24.257006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:24.257671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:24.258604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:24.259262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:24.259888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:24.894492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:24.931715 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e033327d-e2c8-48b1-bf58-fedd9862e40d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.689820 Sep 14 09:27:24.934029 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1355/2031] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:24 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:24.967252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5520ce6-8550-4c1c-ae9e-31f335f6dee6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fa6a550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:25.073047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5520ce6-8550-4c1c-ae9e-31f335f6dee6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.134394 Sep 14 09:27:25.085149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1356/2032] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:24 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:25.101085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1007588576", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:25.218807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:27:26.465597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:26.468038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:26.468927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:26.469822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:26.470403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:26.492678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:26.494564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:26.495168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:26.497551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:26.500254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:26.500953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:26.558964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:26.573032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:26.618572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:26.626663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:26.705141 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1120a0e8-375e-4dc6-940e-66edf7683a5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.622954 Sep 14 09:27:26.708067 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1357/2033] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:27:26.720123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:26.721046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:26.743610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:26.744172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:26.744625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:26.746935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:26.747528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:26.747996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:26.990407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:27.004943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:27.010503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:27.013643 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52959c20-0224-466b-a707-1a966a876788 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1357 microversion: 2.57 time: 0.303935 Sep 14 09:27:27.027939 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1358/2034] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:26 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:27.027939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:27.027939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:27.049517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:27.050702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:27.052482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:27.054876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:27.056244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:27.057567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:27.636718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:27.655845 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cb870ab-d8c9-4a57-ac7a-1e1324e5fab4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1211 microversion: 2.1 time: 0.636484 Sep 14 09:27:27.657974 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1359/2035] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:27 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1211 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:27.669116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:27.673911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:27.694373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:27.698551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:27.699357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:27.700627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:27.703691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:27.704398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:28.672297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:28.704925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9af64b2-2a26-4113-9746-11b5713f41c1 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 1.045479 Sep 14 09:27:28.708142 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1360/2036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:27 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:28.713854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38b9ee2e-0826-4e32-a16c-4f9c25a30d21 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f6944fea5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:28.788606 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38b9ee2e-0826-4e32-a16c-4f9c25a30d21 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.078897 Sep 14 09:27:28.789983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1361/2037] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:28 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:28.795058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:28.795862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:28.805460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:28.810622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:28.811340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:28.812285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:28.813012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:28.814352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:28.969978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:28.982764 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a41b522-9a79-4d7c-ae87-78c706d57592 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1261 microversion: 2.1 time: 0.191474 Sep 14 09:27:28.983376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1362/2038] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:28 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:28.989028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:29.016132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:29.031670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.032208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.032647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.033357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.033808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.034234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.235633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:29.235633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:29.235633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:29.235633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:29.235633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.396790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.452299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd4c4ba0-d954-4eae-b3c3-06f1685e446f tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "POST /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256/action" status: 202 len: 1138 microversion: 2.57 time: 0.465186 Sep 14 09:27:29.455604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1363/2039] 10.222.0.90 () {62 vars in 1320 bytes} [Wed Sep 14 09:27:28 2022] POST /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256/action => generated 1138 bytes in 470 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 09:27:29.455604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6937c32d-b9f3-45c4-a000-428cbd5eeafb", "tag": "41d1034c-a2c8-4ab4-be64-2eca390bf965"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:29.498182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.499755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.500332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.533029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] Creating event network-changed:41d1034c-a2c8-4ab4-be64-2eca390bf965 for instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb on n-h1-851028-12 Sep 14 09:27:29.546766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c06ef19b-ff40-4830-a990-57dd2346822a req-01c38ef3-4112-41e6-8f0a-ae5564270acf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089629 Sep 14 09:27:29.547863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1364/2040] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:29.579164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:29.583258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:29.606998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.607624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.608198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.608979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:29.609503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:29.610008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:29.694886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:30.518696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:30.529202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e27dfa26-6359-49a1-b659-10520e5f55aa tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1211 microversion: 2.1 time: 0.967268 Sep 14 09:27:30.541112 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1365/2041] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:29 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1211 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:30.623031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-695573199", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6c125ccb-f9a6-4b3c-9fe5-1a53ba07cff3"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:30.701553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] validate_networks() for [('6c125ccb-f9a6-4b3c-9fe5-1a53ba07cff3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:27:32.128180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:32.130217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:32.131010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:32.131643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:32.132271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:32.159800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:32.162688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:32.163461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:32.164532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:32.167466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:32.169039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:32.229413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Getting quotas for project 4b48c2623b614e1f81780d51dc76b352. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:32.245700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Getting quotas for user df286a953333434d8b163349ab1290a6 and project 4b48c2623b614e1f81780d51dc76b352. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:32.290387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Going to run 2 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:32.301203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:32.414672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 2695c22d-8a1d-4416-983c-4c0895ae78ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=01e84265-2bd0-4a62-9c1e-af94ef9d1b1f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:32.544107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:32.637540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7363d9f-92ac-4473-9030-0550b1ed8a80 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.094917 Sep 14 09:27:32.642347 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1366/2042] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:27:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:27:32.654662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:32.657529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:32.704602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:32.706291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:32.707739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:32.710152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:32.714053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:32.714924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:33.059938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:33.074936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:33.079652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:33.084423 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-781883c2-5d98-45f6-813a-fb34a11d4108 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.439234 Sep 14 09:27:33.086241 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1367/2043] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:32 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:33.096718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:33.098619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:33.117208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:33.118718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:33.119171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:33.123069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:33.123741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:33.124222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:33.728361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:33.742838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d30d5c02-ba74-434e-bf9d-d36bb34ad52a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.654683 Sep 14 09:27:33.746416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1368/2044] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:33 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:33.766372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d4b03ba-1b65-490b-a617-4fbfff8b7698 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f06e3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:33.984323 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d4b03ba-1b65-490b-a617-4fbfff8b7698 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.234825 Sep 14 09:27:33.987182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1369/2045] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:33 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:33.998473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:34.000719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:34.017921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:34.019788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:34.022749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:34.023824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:34.024977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:34.028038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:34.589807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:34.601652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43f74f83-1b17-4abc-bb6f-f8186a8a938b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.612095 Sep 14 09:27:34.617058 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1370/2046] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:33 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:34.622305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:34.622954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:34.671625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:34.681861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:34.682591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:34.689037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:34.689788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:34.690422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:34.967601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:34.977649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b48b3c9a-45ad-4f5c-810a-4fe3a7d949ff tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1211 microversion: 2.1 time: 0.359388 Sep 14 09:27:34.996310 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1371/2047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:34 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1211 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:35.007313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:35.012646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:35.013659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Searching by: {'deleted': False, 'project_id': '4b48c2623b614e1f81780d51dc76b352'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:27:35.020344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.021311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.021908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.022829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.023424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.024157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.054776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:27:35.099262 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d491ec32-7b93-45a0-9166-79bdffbfb776 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.101425 Sep 14 09:27:35.100119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1372/2048] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:27:34 2022] GET /compute/v2.1/servers => generated 675 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:35.113531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:35.114309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:35.121638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.122385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.123003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.124117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.124734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.125313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.182462 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ae5610c-7666-459c-978e-65363af478d1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/ips" status: 200 len: 150 microversion: 2.1 time: 0.073983 Sep 14 09:27:35.183910 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1373/2049] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:27:35 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:35.196852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:35.200673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:35.213110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.213948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.214599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.215859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.216629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.217667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.417840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:35.430408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:35.432454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:35.434005 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-059ba629-b077-4dbb-a29b-8fd3ea932aac tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.248885 Sep 14 09:27:35.435222 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1374/2050] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:35 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:35.440925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:35.442217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:35.450842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.451730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.452356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:35.454155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:35.454784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:35.455364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.028636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:36.043678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e3da264-9725-4b0f-bb68-122141bb5be3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.604570 Sep 14 09:27:36.044950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1375/2051] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:35 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:36.170816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b8f5cf-e732-43a1-bcdd-9355a33f2d0f", "tag": "ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:36.185972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.186465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.186915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.199494 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] Creating event network-changed:ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48 for instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f on n-h1-851028-12 Sep 14 09:27:36.205887 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-faa57d2e-b913-4425-832b-2b8a77f4ebc4 req-79b4f0fb-1c3c-4ea8-8c62-746ee122952a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159489 Sep 14 09:27:36.207535 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1376/2052] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:36.214770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-267e40f3-756f-4969-b445-828e7a5ea13c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fb5c4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:36.297709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-267e40f3-756f-4969-b445-828e7a5ea13c tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.088346 Sep 14 09:27:36.313016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1377/2053] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:36 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:36.319639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:36.326292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:36.336376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.336880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.337364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.338076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.338533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.338953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.432141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:36.443375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72f035d6-603c-4fa9-abcf-7b1996145883 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1271 microversion: 2.1 time: 0.128829 Sep 14 09:27:36.452812 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1378/2054] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:36 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:36.459283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:36.459922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:36.477615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.478368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.478987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.484883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.485604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.486199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.968342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:36.978493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ea33ea0-9ac7-45d3-86e9-82acd0263816 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.524155 Sep 14 09:27:36.979253 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1379/2055] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:36 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:36.983962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:36.984851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:36.992255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.993064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.993710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:36.995290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:36.995991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:36.996651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.200728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:37.212512 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49067639-848e-4a3b-86ae-2c4850649a21 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.231894 Sep 14 09:27:37.214734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1380/2056] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:36 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:37.221734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:37.223262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:37.231322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.232219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.232902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.233873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.234509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.234938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.386558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:37.405530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:37.408327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:37.410412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-74304723-a8d1-48ea-86db-4b89f51b904e tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.193438 Sep 14 09:27:37.420217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1381/2057] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:37 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:37.431734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:37.432388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:37.443132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.444844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.445586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.446559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.447349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.448531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.687971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:37.697696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66af6969-b5f2-407a-9d1e-df7cfc5898e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.276302 Sep 14 09:27:37.711920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1382/2058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:37 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:37.711920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68583de4-69ee-4645-8ae1-f939de174b1a tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fb5c4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:37.783572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68583de4-69ee-4645-8ae1-f939de174b1a tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1428 microversion: 2.1 time: 0.084022 Sep 14 09:27:37.785687 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1383/2059] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:37 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:37.790444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:37.791047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:37.811747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.812822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.813628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:37.814851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:37.815547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:37.816270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:38.293574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:38.309238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cbd2a192-6a96-435f-b373-98197a5b0a76 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.521083 Sep 14 09:27:38.310654 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1384/2060] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:37 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:38.316405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:38.318378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:38.337812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:38.338425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:38.338740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:38.343278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:38.343831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:38.344321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.016636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:39.024454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dfb7a640-1c0b-4f8f-8a07-f0d2853be540 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.712360 Sep 14 09:27:39.040325 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1385/2061] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:38 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:39.046395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a0a7df7-c537-45ec-a7c5-bf58b31dd619"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:39.048867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:39.056495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.056983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.057416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.058121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.058571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.058993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.063108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:39.421926 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2e157aa-f1dc-4d0f-99e1-a236e1bcb0b3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379225 Sep 14 09:27:39.422934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1386/2062] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:27:39 2022] POST /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:39.456180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:39.458642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:39.485407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.489231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.491607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.508839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.509538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.510185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.826372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:39.839936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6d8eb4a-4bea-4548-bb7f-47fab18671f6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.412677 Sep 14 09:27:39.840694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1387/2063] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:39 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:39.846186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:39.847019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:39.854645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.855370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.856134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.857016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.857622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.858201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.956357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:39.967275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:39.968922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:39.970136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1418d4f-65db-461d-90a7-db3ceb254e2c tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.128300 Sep 14 09:27:39.970710 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1388/2064] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:39 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:39.977702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:39.978542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:39.984976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.985750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.986348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:39.987242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:39.987858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:39.989064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.297469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:40.306259 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81281350-aec5-41ed-a22e-8ce50a05b6ee tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.332951 Sep 14 09:27:40.306851 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1389/2065] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:39 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:40.311442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ea21214-8a02-4b42-ac0b-ef99a28ab530 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693fd91550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:40.380989 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ea21214-8a02-4b42-ac0b-ef99a28ab530 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1437 microversion: 2.1 time: 0.072999 Sep 14 09:27:40.382100 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1390/2066] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:40 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1437 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:40.388572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e84265-2bd0-4a62-9c1e-af94ef9d1b1f", "tag": "deeb328d-0099-4204-8c6a-d60a7f50266e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:40.401597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:40.402269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:40.402783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.415303 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] Creating event network-changed:deeb328d-0099-4204-8c6a-d60a7f50266e for instance 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f on n-h2-851028-12 Sep 14 09:27:40.420546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e726c576-9432-4b75-a21b-f18e6e10d05d req-ebdada31-8a64-4fb9-a46e-ffa259bcc774 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Sep 14 09:27:40.421477 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1391/2067] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:40.427325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:40.429039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:40.436265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:40.436651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:40.437081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.437792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:40.438233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:40.438655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.704665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:40.718024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78ca6825-f627-440c-aa82-c6a5c5ee262c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.295289 Sep 14 09:27:40.719009 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1392/2068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:40 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:40.724662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:40.725278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:40.736275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:40.738013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:40.738930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.740386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:40.741195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:40.742591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:40.996536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.009812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41f80e45-eaf7-48ff-a570-58705cf07a37 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.289673 Sep 14 09:27:41.010900 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1393/2069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:40 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:41.017406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c6320e7-6ac6-48d7-b2f8-886e65439f43 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f6944270700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:41.085655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c6320e7-6ac6-48d7-b2f8-886e65439f43 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 200 len: 1437 microversion: 2.1 time: 0.073518 Sep 14 09:27:41.097893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1394/2070] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:27:41 2022] GET /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:41.105140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:41.105890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:41.115930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.116972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.117868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.118955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.120128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.120851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.408936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.418858 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45c3b232-4b99-4a4f-b526-23a36d94f672 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.319198 Sep 14 09:27:41.419679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1395/2071] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:41 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:41.429181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-unplugged", "status": "completed", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:41.443455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.444778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.445216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.457979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] Creating event network-vif-unplugged:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:27:41.463458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f33abdfd-1b40-40e8-af00-d935090b2f2b req-a17bc6fb-9d83-422a-8b8c-c77381bbb259 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039860 Sep 14 09:27:41.464691 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1396/2072] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:41.471136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2695c22d-8a1d-4416-983c-4c0895ae78ea", "tag": "db66741b-4ec5-4b10-aaa4-482a27840aa1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:41.481897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.482897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.483824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.498876 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] Creating event network-changed:db66741b-4ec5-4b10-aaa4-482a27840aa1 for instance 2695c22d-8a1d-4416-983c-4c0895ae78ea on n-h1-851028-12 Sep 14 09:27:41.506754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cfda2faf-a53a-4dd3-bd77-41d439b40a0f req-b0d93a5c-7a2a-4d14-a6ce-e228c42ddd20 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040339 Sep 14 09:27:41.507787 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1397/2073] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:41.513246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:41.514105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:41.521455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.522099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.522655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.523654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.524288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.524946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.654422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.665154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.666660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.667884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f383d67-d87d-4814-bce8-081641870fec tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.158871 Sep 14 09:27:41.668673 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1398/2074] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:41 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:41.673310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:41.673987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:41.680571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.681070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.681523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.682228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.682687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.683125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.852527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:41.862156 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8bd0853-a7ff-47e3-8c65-af18fae03c7e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1466 microversion: 2.1 time: 0.192631 Sep 14 09:27:41.875934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1399/2075] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:41 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:41.875934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:41.875934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:41.879969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.879969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.879969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:41.879969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:41.880385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:41.880469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:42.045456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:42.055037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4a39898-78d5-4b66-9e5d-b0f56c47ae98 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.189559 Sep 14 09:27:42.055643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1400/2076] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:41 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:42.060330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:42.060951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:42.068002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:42.068499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:42.068938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:42.069640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:42.070101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:42.070592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:42.226208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:42.234368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1319c51f-4ba2-4f15-9a2f-64838bb7c95d tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.177504 Sep 14 09:27:42.235011 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1401/2077] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:42 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:42.240123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa027ddc-f8d2-4338-a3b4-dad590ab02d5 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f100160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:42.270954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=26 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:42.915435 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fa027ddc-f8d2-4338-a3b4-dad590ab02d5 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "DELETE /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc" status: 204 len: 0 microversion: 2.1 time: 0.679353 Sep 14 09:27:42.916110 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1402/2078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:42 2022] DELETE /compute/v2.1/images/5d6010f8-3d3e-4d00-961b-da62b67581bc => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:42.923706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:42.924586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:42.936593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:42.937297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:42.937913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:42.938773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:42.939380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:42.939991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.202714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.218657 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-058c914d-37f2-4184-8955-d60f07bcbbdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.298382 Sep 14 09:27:43.220946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1403/2079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:42 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:43.397572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:43.398199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:43.404532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.405028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.405688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.406404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.406861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.407287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.550205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.559226 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14ec1cdf-a7da-4584-ab4b-8c513ecbb57e tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.334807 Sep 14 09:27:43.559844 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1404/2080] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:43 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:43.564652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:43.565458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:43.572485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.572972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.573400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.574117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.574546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.575408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.664898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.673963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.675401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.677715 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-71379140-0fe3-45c5-98cb-670df08346e8 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.116662 Sep 14 09:27:43.678281 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1405/2081] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:43 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:43.683311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e424d49-509a-4ba6-9b1b-7d79a205b9a3 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '.version_select at 0x7f693f119670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:43.728943 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4e424d49-509a-4ba6-9b1b-7d79a205b9a3 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] HTTP exception thrown: Image not found. Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e424d49-509a-4ba6-9b1b-7d79a205b9a3 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Request method failure captured: Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e HTTP/1.1 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ46cS9a0f_H9tDQoUqlIY_e9zsIA6U1_b5y0v4sE4xr_1xPH1Kb6tRFUhPFt7-7_y-1dQFFA_7a30OsziumBaLihY1aii4I6puUecAsC1e7UycUanzuAxwDztw86KI7YppEDm5JvgpNHI2wyQMNHzZRPOLh7p9aV6vDVxn_DTvypTs Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9e85d24fd65549fc9d175f029b6f70da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9e85d24fd65549fc9d175f029b6f70da"}]}] Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 7057aebe52b64551be533bb5121a70ff Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3838a510-4e94-4899-9b7d-07bdd088325e'} Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3838a510-4e94-4899-9b7d-07bdd088325e to delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3838a510-4e94-4899-9b7d-07bdd088325e could not be found. Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.731246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e424d49-509a-4ba6-9b1b-7d79a205b9a3 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e424d49-509a-4ba6-9b1b-7d79a205b9a3 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "DELETE /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e" status: 404 len: 62 microversion: 2.1 time: 0.053331 Sep 14 09:27:43.738360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1406/2082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:43 2022] DELETE /compute/v2.1/images/3838a510-4e94-4899-9b7d-07bdd088325e => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:27:43.742690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:43.742690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:43.748012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.748513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.748955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.749669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.750131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.750556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.774644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:43.952167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:43.962808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5667ba6-576e-4234-824f-064433ca24bc tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.228102 Sep 14 09:27:43.963516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1407/2083] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:43 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:43.974942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:43.975640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:43.984327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.984856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.985287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:43.986448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:43.986966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:43.987376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.132968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.141730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59e95ab8-52ed-4a5c-a3cd-d9c904f91428 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.170685 Sep 14 09:27:44.142330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1408/2084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:43 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:44.147578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b8f5cf-e732-43a1-bcdd-9355a33f2d0f", "name": "network-vif-plugged", "status": "completed", "tag": "ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:44.157827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.158316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.158898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.173586 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] Creating event network-vif-plugged:ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48 for instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f on n-h1-851028-12 Sep 14 09:27:44.179408 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d1b1a26a-9130-4b91-9104-c8fc1038d0ab req-afcbf994-db3d-4f37-a803-e770338443d6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Sep 14 09:27:44.180170 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1409/2085] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:44.185294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.185876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.193393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.193888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.194431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.195020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.195480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.195931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.224388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:44.323121 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b00c027-8efc-47cc-adf5-d64242cec874 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 204 len: 0 microversion: 2.1 time: 0.141408 Sep 14 09:27:44.324039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1410/2086] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:44 2022] DELETE /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:44.330411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.331131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.338860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.338860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.339505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.340252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.340708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.341391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.489153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.497162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38d76790-a5e7-4ed5-8b47-eda08f2b3280 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.172020 Sep 14 09:27:44.497746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1411/2087] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:44 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:44.503431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.504855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.511425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.512028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.512588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.513293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.513746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.514204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.653893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.662566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-343497c5-0d04-4710-b844-6d20b6148208 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1472 microversion: 2.1 time: 0.163840 Sep 14 09:27:44.663155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1412/2088] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:44 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:44.667725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.668353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.675137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.675757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.676826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.677633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.678158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.678649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.825791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.835182 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01a65633-054f-4d94-a75d-8e164c3518ae tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.170893 Sep 14 09:27:44.835920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1413/2089] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:44 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:44.840697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.841391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.848559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.848559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.849398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.850181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.850704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.851199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.927191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.939528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.941937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:44.943157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a69cd4a-97b4-4665-8576-c21f66bbcb50 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.106214 Sep 14 09:27:44.943727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1414/2090] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:44 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:44.986279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:44.987024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:44.993954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.994476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.994967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:44.995683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:44.996235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:44.996713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.036570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:45.164716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:45.175678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f02356c-ed7e-4baf-956b-95af7bc7e891 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.193085 Sep 14 09:27:45.176804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1415/2091] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:44 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:27:45.181575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:45.182297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:45.189267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.189751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.190177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.190911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.191359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.191831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.351849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:45.360540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5b9cbd3-cf31-48b3-8c80-64fc1fadc6e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.182637 Sep 14 09:27:45.361132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1416/2092] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:45 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:45.522974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:45.523651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:45.530179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.530688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.531327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.532127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.532611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.533191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.698044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:45.709848 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08dc748b-8aa9-48f3-a549-60031a5f9a6a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1309 microversion: 2.1 time: 0.192359 Sep 14 09:27:45.710462 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1417/2093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:45 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:45.716337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:45.717331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:45.728705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.729216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.729758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.730493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.730951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.731381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.884290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:45.892339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d421a911-531e-4e33-93a5-8538a2ee1e3e tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1472 microversion: 2.1 time: 0.180806 Sep 14 09:27:45.893027 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1418/2094] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:45 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:45.897546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:45.898148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:45.899871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:45.905596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.906127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.906563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:45.907261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:45.907714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:45.908194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.058964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.074363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b2c4444-1370-4dff-8421-cb5c1d8d6931 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.180281 Sep 14 09:27:46.074968 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1419/2095] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:45 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:46.084084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:46.084084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:46.087265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.087758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.088214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.088902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.089353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.089779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.164895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.174383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.176512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.177892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a040c2d8-b52e-4f08-a5cc-c90486ead4b6 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.101732 Sep 14 09:27:46.178457 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1420/2096] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:46 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:46.194585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937c32d-b9f3-45c4-a000-428cbd5eeafb", "name": "network-vif-plugged", "status": "completed", "tag": "41d1034c-a2c8-4ab4-be64-2eca390bf965"}, {"server_uuid": "01e84265-2bd0-4a62-9c1e-af94ef9d1b1f", "name": "network-vif-plugged", "status": "completed", "tag": "deeb328d-0099-4204-8c6a-d60a7f50266e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:46.205555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.206049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.206477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.219789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Creating event network-vif-plugged:41d1034c-a2c8-4ab4-be64-2eca390bf965 for instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb on n-h1-851028-12 Sep 14 09:27:46.220333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] Creating event network-vif-plugged:deeb328d-0099-4204-8c6a-d60a7f50266e for instance 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f on n-h2-851028-12 Sep 14 09:27:46.229019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-37734449-ecd3-47df-b8db-a1743075fbcb req-69dd14e0-446b-4569-a787-de04f3ca1600 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038228 Sep 14 09:27:46.229625 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1421/2097] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:46.234928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:46.235583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:46.242607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.243105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.243544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.244290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.244753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.245183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.444270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.452508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab9a7a91-cb9a-4553-a824-4479b9c40c5d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.221701 Sep 14 09:27:46.453171 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1422/2098] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:46 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:46.458249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:46.458999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:46.465719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.465719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.465719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.466614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.466913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.467254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.603870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.607551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:46.614000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d35c1e45-c027-4921-9d37-129041657891 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.159400 Sep 14 09:27:46.614577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1423/2099] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:46 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:46.736000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:46.736610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:46.745280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.745763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.746230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.746931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.747380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.747800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.881118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:46.889074 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c100220c-278a-40d0-9b52-28afa98ea8d5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1489 microversion: 2.1 time: 0.158308 Sep 14 09:27:46.889653 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1424/2100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:46 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1489 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:27:46.912322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:46.912967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:46.918853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.919340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.919776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:46.920496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:46.920948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:46.921371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.081058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.089824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-551d85bd-9c71-4c9e-97a0-6708bcfe63fd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1490 microversion: 2.1 time: 0.181925 Sep 14 09:27:47.090416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1425/2101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:46 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1490 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.104168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.104647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.104749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.248458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.257261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82747eeb-31f7-40fa-a31c-045a49e34abe tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1472 microversion: 2.1 time: 0.165785 Sep 14 09:27:47.257866 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1426/2102] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:47.262356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.262966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.269428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.270541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.270989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.271798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.272281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.272710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.411226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.419385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4ea7be63-576a-4c84-8107-db482bc9ebef tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1199 microversion: 2.1 time: 0.160542 Sep 14 09:27:47.420158 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1427/2103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1199 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:47.424872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.425418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.431823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.432457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.432927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.433623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.434075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.434500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.579535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.587673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0a57b37-9c40-499c-bd27-2ac03e79eb92 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1489 microversion: 2.1 time: 0.166420 Sep 14 09:27:47.588353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1428/2104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1489 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:47.592969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.593609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.599799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.600316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.600739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.601427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.601870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.602285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.672105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.681825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.683206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.684411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18e44886-0bcb-48bd-83aa-bb25f7f0c53a tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.095143 Sep 14 09:27:47.684985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1429/2105] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:47.689578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.690190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.696578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.697068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.697504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.698207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.698660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.699083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.850809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:47.858629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f19e7711-8704-4cc9-a2ce-d932e7ff5d2b tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1472 microversion: 2.1 time: 0.172665 Sep 14 09:27:47.859181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1430/2106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:47.864333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:47.864818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:47.870594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.871060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.871478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.872475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:47.872780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:47.873199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:47.900337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:47.994358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b1c7275-0c6a-46f7-bff6-e6966c7f0f44 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 204 len: 0 microversion: 2.1 time: 0.133917 Sep 14 09:27:47.994974 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1431/2107] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:47 2022] DELETE /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:48.000238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.001003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.007220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.007713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.008183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.008889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.009341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.009761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.150837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.159860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-193c3370-c4b7-45e4-9c3b-7420e96811b1 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.163652 Sep 14 09:27:48.161583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1432/2108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:47 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:48.166052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.166672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.173078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.173566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.174005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.174718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.175259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.175763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.314260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.322936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d91e74a-73e8-4458-94e7-89c28709cdd8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1495 microversion: 2.1 time: 0.160557 Sep 14 09:27:48.323529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1433/2109] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:48 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1495 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:48.328656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2695c22d-8a1d-4416-983c-4c0895ae78ea", "name": "network-vif-plugged", "status": "completed", "tag": "db66741b-4ec5-4b10-aaa4-482a27840aa1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:48.338185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.338666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.339095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.351519 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] Creating event network-vif-plugged:db66741b-4ec5-4b10-aaa4-482a27840aa1 for instance 2695c22d-8a1d-4416-983c-4c0895ae78ea on n-h1-851028-12 Sep 14 09:27:48.356557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-547301d3-8c93-48fc-9a5c-228151506ebd req-7fd8a10c-5164-4e16-b251-d071ee86a65a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031893 Sep 14 09:27:48.357379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1434/2110] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:48.362501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.363207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.369974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.370459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.370899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.371621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.372105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.372540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.513406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.522299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d440414-0748-461b-b379-f955034ba865 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1472 microversion: 2.1 time: 0.163897 Sep 14 09:27:48.522869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1435/2111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:48 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:48.527824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.528772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.543495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.544030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.544530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.545256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.545714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.546143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.713143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.723666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aafc1f57-9738-48a5-bf1f-5bf9fb4189d2 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1381 microversion: 2.1 time: 0.199063 Sep 14 09:27:48.724163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1436/2112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:48 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1381 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:48.729067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.729687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.735664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.736674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.737252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.737989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.739063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.739484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.813049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.821662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.823087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:48.824287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2caf243-7d83-4c83-b12b-0c1b544d2476 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.099177 Sep 14 09:27:48.824847 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1437/2113] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:48 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:48.830756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:48.831829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:48.840790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.841289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.841737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:48.842637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:48.843341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:48.843809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.033209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:49.044031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:49.045480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:49.046761 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bfb78f14-1047-4356-a064-6dc10e98f766 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2946 microversion: 2.32 time: 0.220164 Sep 14 09:27:49.047744 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1438/2114] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:48 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2946 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:49.052597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:49.053271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:49.070743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.071181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.071691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.072492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.072944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.073434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.093047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:49.275166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b5f4d39-e3c6-407d-8885-c8a3bd583398 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1534 microversion: 2.1 time: 0.226648 Sep 14 09:27:49.275754 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1439/2115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:49 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1534 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:49.280295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:49.281008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:49.287522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.288040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.288485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.289180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.289630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.290051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.460046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:49.471834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04121e15-137a-433e-8804-656673e12c6a tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1478 microversion: 2.1 time: 0.194383 Sep 14 09:27:49.475164 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1440/2116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:49 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1478 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:49.485161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:49.485910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:49.499598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.500244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.500811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.501385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.501840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.502844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.635617 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-060dfb38-2cd6-4b7a-913b-829c21777239 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.156381 Sep 14 09:27:49.636268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1441/2117] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:27:49 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a/os-interface => generated 1829 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:49.640860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9650fceb-b0cf-4986-adb7-fa0bbc52a33c", "name": "network-vif-deleted", "tag": "7567e815-c798-4f53-af0a-0ba9b2f34a5d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:49.653864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.654342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.654770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.667478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] Creating event network-vif-deleted:7567e815-c798-4f53-af0a-0ba9b2f34a5d for instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c on n-h2-851028-12 Sep 14 09:27:49.672644 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-76a23cc4-bf1c-413b-a48d-372ef1ff8980 req-7de0196e-fd13-4e82-9b17-426862d76525 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Sep 14 09:27:49.673354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1442/2118] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:49.681797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:49.682973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:49.694532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.695383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.696015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.696889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.697408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.697893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.944958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:49.953534 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3c72862-c46c-4e71-a990-fd5785cb6a63 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1319 microversion: 2.1 time: 0.278915 Sep 14 09:27:49.954238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1443/2119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:49 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:49.959868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:49.960572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:49.966980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.967547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.968089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:49.969002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:49.969724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:49.970239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.443252 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7da55b7a-96ab-4461-a2cb-6f253e6ee6dc tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1534 microversion: 2.1 time: 0.487749 Sep 14 09:27:50.444083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1444/2120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:49 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1534 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:50.452467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:50.452467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:50.456719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.458005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.458840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.459807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.460403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.460956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.557139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:50.570382 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-736cbc99-ad4d-4d39-aeff-cbb0d7edbc5f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 200 len: 1453 microversion: 2.1 time: 0.125085 Sep 14 09:27:50.575680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1445/2121] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:50 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:50.582487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:50.583248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:50.592397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.592927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.593373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.594681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.595140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.595575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.689437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7057aebe52b64551be533bb5121a70ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e85d24fd65549fc9d175f029b6f70da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:50.699256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8122cfc0-d8e2-4ebe-967d-f018538323d6 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 200 len: 1302 microversion: 2.1 time: 0.122194 Sep 14 09:27:50.701156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1446/2122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:50 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:50.706910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:50.708189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:50.717553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.718050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.718583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.719309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.719754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.720299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.811389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:50.822935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:50.824913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:50.826674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5eeae8ed-c9bd-48f5-ba42-9f948a599c15 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.124220 Sep 14 09:27:50.836202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1447/2123] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:50 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:50.852820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:50.856959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.857537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.858042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.858865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.859322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.859881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.886956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c26e104d-3d22-490e-98cf-e48b123dd807 tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038265 Sep 14 09:27:50.887812 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1448/2124] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:27:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:50.892834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:50.893495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:50.900734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.901264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.901751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:50.902556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:50.903063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:50.903532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:51.073627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:51.086348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba5b1fda-cbfe-4aac-a598-3b9c0383c75f tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1478 microversion: 2.1 time: 0.197269 Sep 14 09:27:51.101750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1449/2125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:50 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1478 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:51.101750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b8f5cf-e732-43a1-bcdd-9355a33f2d0f", "name": "network-vif-deleted", "tag": "ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:51.102368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:51.102860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:51.103288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:51.116440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] Creating event network-vif-deleted:ef19d7e1-6cb3-4856-93ca-f7c85b0f2f48 for instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f on n-h1-851028-12 Sep 14 09:27:51.121396 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fdc4a426-5f57-4998-9406-808d659ae1a2 req-c32d5788-3a35-43fd-8f67-f5d18ac3f09c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 Sep 14 09:27:51.122075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1450/2126] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:51.127736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-851028-12", "block_migration": false, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:51.131248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:51.138302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:51.139007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:51.139226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:51.140020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:51.140423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:51.140845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:51.232204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lazy-loading 'flavor' on Instance uuid 6937c32d-b9f3-45c4-a000-428cbd5eeafb {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:27:51.246869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Going to try to live migrate instance to n-h2-851028-12 {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 09:27:53.636955 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1ba109b-e826-40a7-ba0e-85505cc0311c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb/action" status: 202 len: 0 microversion: 2.1 time: 2.513501 Sep 14 09:27:53.637736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1451/2127] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:27:51 2022] POST /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb/action => generated 0 bytes in 2515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:27:53.658955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:53.659911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:53.672476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:53.673847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:53.674295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:53.675112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:53.675564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:53.676688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:53.883655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:53.897100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8743f121-660e-40c1-bed7-6c2b38eef771 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 200 len: 1507 microversion: 2.1 time: 0.254267 Sep 14 09:27:53.898346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1452/2128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:53 2022] GET /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:53.917234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a0a7df7-c537-45ec-a7c5-bf58b31dd619"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:53.922985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:53.935306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:53.936514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:53.937348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:53.938260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:53.938767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:53.939207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.085464 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments HTTP/1.1 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 74 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: {"volumeAttachment": {"volumeId": "6a0a7df7-c537-45ec-a7c5-bf58b31dd619"}} Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '8e5a9435-f248-4f27-a4f8-a5b98ebdaf31', 'body': {'volumeAttachment': {'volumeId': '6a0a7df7-c537-45ec-a7c5-bf58b31dd619'}}} Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:27:54.090059 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 400 to user: Invalid volume: volume 6a0a7df7-c537-45ec-a7c5-bf58b31dd619 is already attached to instances: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:54.094732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86c2a815-2a75-4fa3-86b3-6a18bbf323ef tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.192107 Sep 14 09:27:54.098862 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1453/2129] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:27:53 2022] POST /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:27:54.106278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "name": "network-vif-unplugged", "status": "completed", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:54.119179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.120520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.121244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.138900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] Creating event network-vif-unplugged:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:27:54.146060 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-204abe99-0d06-433b-9769-23e98e81d927 req-61eed01f-1635-4721-aa6a-58f2121f3c94 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044188 Sep 14 09:27:54.149023 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1454/2130] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:54.155835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:54.157465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:54.168964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.170033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.171034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.172797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.173902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.174969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.223356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f HTTP/1.1 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '22b8f5cf-e732-43a1-bcdd-9355a33f2d0f'} Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.225739 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4eccc358-98e2-447d-90c9-c7ea238a5a48 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 404 len: 111 microversion: 2.1 time: 0.076712 Sep 14 09:27:54.231851 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1455/2131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:54 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:54.249192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:54.250165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] [instance: 9650fceb-b0cf-4986-adb7-fa0bbc52a33c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:54.258602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.259217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.259758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.260653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.261267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.261696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.284508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] HTTP exception thrown: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Request method failure captured: Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c HTTP/1.1 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ46cS9a0f_H9tDQoUqlIY_e9zsIA6U1_b5y0v4sE4xr_1xPH1Kb6tRFUhPFt7-7_y-1dQFFA_7a30OsziumBaLihY1aii4I6puUecAsC1e7UycUanzuAxwDztw86KI7YppEDm5JvgpNHI2wyQMNHzZRPOLh7p9aV6vDVxn_DTvypTs Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9e85d24fd65549fc9d175f029b6f70da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9e85d24fd65549fc9d175f029b6f70da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9e85d24fd65549fc9d175f029b6f70da"}]}] Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9e85d24fd65549fc9d175f029b6f70da Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1290320984 Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 7057aebe52b64551be533bb5121a70ff Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerTestJSON-1290320984-project Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9650fceb-b0cf-4986-adb7-fa0bbc52a33c'} Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:27:54.287113 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] Returning 404 to user: Instance 9650fceb-b0cf-4986-adb7-fa0bbc52a33c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-360a5794-4af1-4d48-819b-38a38fc34770 tempest-ImagesOneServerTestJSON-1290320984 tempest-ImagesOneServerTestJSON-1290320984-project] 10.222.0.90 "GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c" status: 404 len: 111 microversion: 2.1 time: 0.055974 Sep 14 09:27:54.291720 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1456/2132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:54 2022] GET /compute/v2.1/servers/9650fceb-b0cf-4986-adb7-fa0bbc52a33c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:27:54.294797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:54.295459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:54.312835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.313492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.313926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.314671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.315128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.315553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.459481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:54.492239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:54.497185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:54.498716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed943aa5-c2b0-44be-9489-6f20ffd1676b tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.207968 Sep 14 09:27:54.499920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1457/2133] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:54 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:54.509066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:54.510009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:54.521643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.522692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.523378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.524684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.525380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.526131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.559022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:54.820590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:54.835371 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f72b2b3-df83-4e9a-9fbc-538dfa627c7e tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1478 microversion: 2.1 time: 0.333291 Sep 14 09:27:54.837480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1458/2134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:54 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1478 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:54.845027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:54.846054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:54.854599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.855471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.856181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:54.857133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:54.857825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:54.859042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.090285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:55.100612 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05c8a806-c419-4e72-a7b1-d7816724be3a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.261459 Sep 14 09:27:55.101527 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1459/2135] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:54 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:55.106905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:55.107772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 2695c22d-8a1d-4416-983c-4c0895ae78ea] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:55.116358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.117268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.118049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.119202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.119951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.120694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.326624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:55.340349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8a422a0-e5a1-4cfd-adb7-37caa7e09645 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/2695c22d-8a1d-4416-983c-4c0895ae78ea" status: 200 len: 1507 microversion: 2.1 time: 0.237293 Sep 14 09:27:55.341039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1460/2136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:55 2022] GET /compute/v2.1/servers/2695c22d-8a1d-4416-983c-4c0895ae78ea => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:55.346800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:55.347292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:55.355772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.356511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.356952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.357718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.358165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.358629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.391496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:55.485135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:55.492275 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b615b22c-f6ff-4c79-aa0d-0a3885e4b570 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 204 len: 0 microversion: 2.1 time: 0.149106 Sep 14 09:27:55.493633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1461/2137] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:55 2022] DELETE /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:55.500458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:55.501371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:55.509524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.510307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.510751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.511471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.512134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.512563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.643932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'services' on Instance uuid 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:27:55.726254 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-951a73bb-b462-4493-9253-d174254b43f4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments/6a0a7df7-c537-45ec-a7c5-bf58b31dd619" status: 202 len: 0 microversion: 2.1 time: 0.230895 Sep 14 09:27:55.730258 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1462/2138] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:27:55 2022] DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments/6a0a7df7-c537-45ec-a7c5-bf58b31dd619 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:27:55.732596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:55.734909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 2695c22d-8a1d-4416-983c-4c0895ae78ea] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:55.743761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.744337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.744721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.745444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.745896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.746312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.781670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 2695c22d-8a1d-4416-983c-4c0895ae78ea] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:55.940490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d2d06d0-75c7-4e00-adab-1e7ac65706e8 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2695c22d-8a1d-4416-983c-4c0895ae78ea" status: 204 len: 0 microversion: 2.1 time: 0.210433 Sep 14 09:27:55.943792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1463/2139] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:55 2022] DELETE /compute/v2.1/servers/2695c22d-8a1d-4416-983c-4c0895ae78ea => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:55.955013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:55.956021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:55.964022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.964815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.965436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:55.966900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:55.967561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:55.968654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.206056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.215320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94a74d3d-47b2-4c20-8fae-4b62a748e5fb tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1496 microversion: 2.1 time: 0.269928 Sep 14 09:27:56.216567 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1464/2140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:55 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1496 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:56.225376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:56.226460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:56.235971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.236905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.237466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.238297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.239518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.240379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.316837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.325462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.327308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.328529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d166cbc7-8f11-473e-808a-2a53cd628338 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.110847 Sep 14 09:27:56.329203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1465/2141] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:56 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:56.334676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:56.337109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:56.343294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.343787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.344330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.345852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.345852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.346137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.380391 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b1f1adf-1621-4115-8715-3ca65ccdfde6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050050 Sep 14 09:27:56.380999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1466/2142] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:27:56 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:56.385649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:56.386262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:56.392420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.393004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.393445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.394147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.395241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.395669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.537547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.545551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21055616-3b1a-4c88-a68f-6c778d6354b3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1478 microversion: 2.1 time: 0.163543 Sep 14 09:27:56.546138 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1467/2143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:56 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:56.551617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:56.552653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:56.559273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.559752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.560211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.560901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.561349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.561765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.592577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:27:56.684966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04d18f6a-0b64-41cb-9461-760728817b83 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f" status: 204 len: 0 microversion: 2.1 time: 0.136829 Sep 14 09:27:56.693830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1468/2144] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:27:56 2022] DELETE /compute/v2.1/servers/01e84265-2bd0-4a62-9c1e-af94ef9d1b1f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:27:56.693830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:56.693830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:56.702735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.703990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.704688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.705671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.705990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.706472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.734377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:27:56.880918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:56.892065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-751bc32d-39f1-41b6-88e6-0628f23008b4 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.205066 Sep 14 09:27:56.892883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1469/2145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:56 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:56.901075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "name": "network-vif-plugged", "status": "completed", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:56.913598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:56.913996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:56.914455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:56.927715 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] Creating event network-vif-plugged:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:27:56.933002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0aec4b1a-9876-4d8a-956e-f521755bcb3f req-ed468cf8-0973-4ba0-a705-a85cca202521 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035673 Sep 14 09:27:56.933651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1470/2146] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:57.089496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f2dc281-075e-490f-a11a-da62bb3e7e90 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f693e40e670>, body: {"keypair": {"name": "tempest-keypair-1393547527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkOMP6R5r1hodrAsMq9ahehQsInLTtBWiUy7NNI4nJ1CgYt3RMhDmvwG81KQ/OY8TkzbL/KoUK07QMc9siPcxZRZ6FrIxiw6s0ZE3IVSzbkZn/FkKttUhvCeZWt8YQG/g=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:57.110140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9f2dc281-075e-490f-a11a-da62bb3e7e90 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:57.114843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9f2dc281-075e-490f-a11a-da62bb3e7e90 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:57.139293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f2dc281-075e-490f-a11a-da62bb3e7e90 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.204469 Sep 14 09:27:57.139921 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1471/2147] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:27:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:57.144455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1961557681", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6c125ccb-f9a6-4b3c-9fe5-1a53ba07cff3"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:57.204001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] validate_networks() for [('6c125ccb-f9a6-4b3c-9fe5-1a53ba07cff3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:27:57.616666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:27:57.617089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:27:57.617562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:27:57.617974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:27:57.618387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:27:57.628256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.628792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.629732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:57.630602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.631092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.631502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:57.650316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Getting quotas for project 4b48c2623b614e1f81780d51dc76b352. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:57.657674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Getting quotas for user df286a953333434d8b163349ab1290a6 and project 4b48c2623b614e1f81780d51dc76b352. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:57.676967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Going to run 2 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:27:57.679444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:57.718425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=8298e261-6ef8-4388-8c25-3ebffb7f5085,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:27:57.776915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db1883ba-9767-4ddb-adf9-c1994795d448 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.635860 Sep 14 09:27:57.780293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1472/2148] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:27:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:27:57.782073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b6b0115-6464-49e8-a615-d45fd7ec34b5 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693e4461f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:57.792284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b6b0115-6464-49e8-a615-d45fd7ec34b5 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs/tempest-keypair-1393547527" status: 200 len: 498 microversion: 2.1 time: 0.013649 Sep 14 09:27:57.792797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1473/2149] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:27:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1393547527 => generated 498 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:57.797361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:57.797968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:57.804885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.805375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.805841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:57.806506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.806932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.807353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:57.968208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:57.980354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1d4c0cd-ae8d-4dda-839c-8d901f2ba3a2 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1496 microversion: 2.1 time: 0.186072 Sep 14 09:27:57.980971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1474/2150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:57 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1496 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:57.985745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:57.986173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:57.993862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.994351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.994789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:57.995491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:57.995998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:57.996379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.088932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:58.098769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:58.101690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:58.103879 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f27cf7f-482c-4736-95e5-2f5bc3c307d2 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.121241 Sep 14 09:27:58.119622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1475/2151] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:27:57 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:27:58.132389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:58.140474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:58.149882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.151056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.151875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.153022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.153934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.154682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.205204 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83a547dd-d4e6-4c7b-bd49-8c845af15338 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083968 Sep 14 09:27:58.206422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1476/2152] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:27:58 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:58.212745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:58.213722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:58.221012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.222191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.223786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.225154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.225976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.226564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.556264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:58.572749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2327e92-7001-40d0-a9b8-f217eeb23f07 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1478 microversion: 2.1 time: 0.364680 Sep 14 09:27:58.575407 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1477/2153] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:58 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1478 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:58.589977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:58.598445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:58.599296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Searching by: {'deleted': False, 'project_id': '4b48c2623b614e1f81780d51dc76b352'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:27:58.655759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.658250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.659602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.661142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.662297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.662888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.707839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:27:58.773918 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15990f6f-0f44-4fac-bd88-e52cbb40151f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.191190 Sep 14 09:27:58.775219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1478/2154] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:27:58 2022] GET /compute/v2.1/servers => generated 1335 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:58.791310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a51644ad-1a3a-464e-9e8a-bc06bc6b57fa tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693e40e9d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:58.835970 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a51644ad-1a3a-464e-9e8a-bc06bc6b57fa tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393547527" status: 202 len: 0 microversion: 2.1 time: 0.057398 Sep 14 09:27:58.836902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1479/2155] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1393547527 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:27:58.872282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:58.874378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:58.892010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.892787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.893512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:58.914715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:58.915475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:58.915942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:59.581001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:59.595477 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91031385-078f-4c66-b241-5885e03685a6 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.757135 Sep 14 09:27:59.596721 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1480/2156] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:58 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:59.612426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:59.613450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:59.643188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:59.645591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:59.646547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:59.648807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:59.650251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:59.652682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:59.811644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:27:59.833577 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45a13a14-0d8a-42f1-8a54-fc1bc0234c6f tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1270 microversion: 2.1 time: 0.232102 Sep 14 09:27:59.836242 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1481/2157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:59 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:27:59.856249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1055441-37a8-447c-9346-9174b236cd77 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f693e4198b0>, body: {"keypair": {"name": "tempest-keypair-1368233374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILDmtaWRAZ7iirsb7c9FRePbkYx/v/yzhD+aapiIolDDWnOQYYQkH6mIfPdeTNS0izpYjXc0PEAQHGq3C0yemvKbIvqvREc5XFJFSZ3r2o29BosduqvrWWnAJP7fDqJLQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:27:59.906072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d1055441-37a8-447c-9346-9174b236cd77 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:27:59.922025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d1055441-37a8-447c-9346-9174b236cd77 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:27:59.965224 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1055441-37a8-447c-9346-9174b236cd77 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126877 Sep 14 09:27:59.976779 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1482/2158] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:27:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:27:59.987121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:27:59.987934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:27:59.996999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:27:59.997653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:27:59.998308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:27:59.999358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.000064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.000794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.068333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.069984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.070643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.071678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'fault' on Instance uuid b2c7def9-4769-4c28-8aaa-b15e960ea346 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:00.257148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:00.271288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3dc1590-efe2-4882-b5fd-31023672d7b9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 200 len: 1299 microversion: 2.1 time: 0.292560 Sep 14 09:28:00.273820 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1483/2159] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:27:59 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:00.281986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:00.293445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:00.304061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:00.318629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.320629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.321908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.324241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.328244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.330446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.476460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:00.489712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:00.491558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:00.492732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fcef87b-8ae5-496b-b2db-48b316066b34 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.217892 Sep 14 09:28:00.493579 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1484/2160] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:00 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:00.498373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:00.500574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:00.516175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.516671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.517286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.518169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.518628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.519054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.568852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccec4bcb-211d-4db1-b2f4-594d97203ece tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074175 Sep 14 09:28:00.574216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1485/2161] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:28:00 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:00.578702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c7def9-4769-4c28-8aaa-b15e960ea346", "name": "network-vif-deleted", "tag": "8043924d-38f5-4e72-91c1-a3c6eac9bf1b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:00.613423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.615684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.617072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.650967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] Creating event network-vif-deleted:8043924d-38f5-4e72-91c1-a3c6eac9bf1b for instance b2c7def9-4769-4c28-8aaa-b15e960ea346 on n-h1-851028-12 Sep 14 09:28:00.658565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d20a90d3-c7ce-421b-ad3d-d0c354456bb9 req-dbee0872-1537-4416-9a68-1c6b3ac596b5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084444 Sep 14 09:28:00.661244 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1486/2162] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:00.668489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:00.669539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:00.678623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.679192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.679852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.680990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.681678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.682263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.914845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:00.923735 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b46e6a4-186b-44dd-a13a-be2e038a65c5 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1463 microversion: 2.1 time: 0.260467 Sep 14 09:28:00.930659 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1487/2163] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:00 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:00.930659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e84265-2bd0-4a62-9c1e-af94ef9d1b1f", "name": "network-vif-deleted", "tag": "deeb328d-0099-4204-8c6a-d60a7f50266e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:00.941472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:00.941964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:00.942405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:00.961820 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] Creating event network-vif-deleted:deeb328d-0099-4204-8c6a-d60a7f50266e for instance 01e84265-2bd0-4a62-9c1e-af94ef9d1b1f on n-h2-851028-12 Sep 14 09:28:00.967185 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6e1defe4-1a4e-44c4-a8ca-71b8a073a913 req-c56a3a60-d4f2-49e1-a1d7-c16bae4db16a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Sep 14 09:28:00.968010 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1488/2164] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:00.973951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35265142-18b3-4b48-b2e1-46c4516c8218 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693e4f5790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:00.996284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35265142-18b3-4b48-b2e1-46c4516c8218 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368233374" status: 202 len: 0 microversion: 2.1 time: 0.026980 Sep 14 09:28:00.997061 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1489/2165] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368233374 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:01.010549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:01.012293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:01.027026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:01.027686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:01.030002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:01.030002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:01.030316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:01.031055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.072142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:02.089949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cb346168-d0c8-4b1e-9612-91f782c73a6d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 1.091803 Sep 14 09:28:02.104081 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1490/2166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:00 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:02.120995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:02.122663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:02.137272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.138147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.139006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.140081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.141460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.146300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.460291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:02.473080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dc8cc83-fe96-4c59-92a4-a230813f7f5a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.365673 Sep 14 09:28:02.489193 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1491/2167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:02 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:02.494228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:02.500284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:02.516003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.517348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.519429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.520450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.521215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.522388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.578304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:02.627353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88b3f6c1-f5ec-4bbe-a818-2298df1c73d6 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.136698 Sep 14 09:28:02.631289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1492/2168] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:28:02 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:02.634843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d3dd137-aae9-4a3f-a49d-8d8f37796bb4 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f693e42c1f0>, body: {"keypair": {"name": "tempest-keypair-1209681128", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:02.653960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4d3dd137-aae9-4a3f-a49d-8d8f37796bb4 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:02.659512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4d3dd137-aae9-4a3f-a49d-8d8f37796bb4 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:02.695377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d3dd137-aae9-4a3f-a49d-8d8f37796bb4 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.065030 Sep 14 09:28:02.697470 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1493/2169] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:02 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:02.704921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:02.705745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:02.716019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.717847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.718784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.719718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.720349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.721735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.741578 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 HTTP/1.1 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b2c7def9-4769-4c28-8aaa-b15e960ea346'} Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:02.744716 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:28:02.749179 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:02.751234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:02.752387 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a0931c3-f72c-485b-b8e5-4ad0f9f8e76b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 404 len: 111 microversion: 2.1 time: 0.052785 Sep 14 09:28:02.753329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1494/2170] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:02 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:02.761719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:02.761719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:02.769819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.771372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.772134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.777772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.778511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.779187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.912651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:02.941881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:02.947595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:02.949625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97fd68fe-be9a-4b32-8896-7abb4f146d33 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1366 microversion: 2.57 time: 0.195496 Sep 14 09:28:02.951167 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1495/2171] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:02 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:02.957310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:02.960542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:02.975458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.976646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.979606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:02.980813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:02.985193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:02.986570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:03.025914 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c4744d5-5971-4ff7-8fc4-685ce2f6b32e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073140 Sep 14 09:28:03.027074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1496/2172] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:28:02 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:03.031889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:03.038102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:03.056923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:03.057697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:03.058453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:03.059326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:03.059976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:03.060564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:03.101033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:03.101696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:03.101941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:03.102405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lazy-loading 'fault' on Instance uuid 7ba4d5ad-d65c-4243-b783-b6f307b22d1c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:03.352363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7361420-ea4b-47e4-9ef3-3f2b7a772944 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1599 microversion: 2.1 time: 0.324002 Sep 14 09:28:03.354536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1497/2173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:03 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1599 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:03.362522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e0180c6-bd75-40eb-ab38-0f24d1e2462a tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693e4f5790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:03.398063 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e0180c6-bd75-40eb-ab38-0f24d1e2462a tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209681128" status: 202 len: 0 microversion: 2.1 time: 0.041004 Sep 14 09:28:03.406686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1498/2174] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209681128 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:03.406686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2695c22d-8a1d-4416-983c-4c0895ae78ea", "name": "network-vif-deleted", "tag": "db66741b-4ec5-4b10-aaa4-482a27840aa1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:03.420152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:03.420653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:03.421090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:03.436546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] Creating event network-vif-deleted:db66741b-4ec5-4b10-aaa4-482a27840aa1 for instance 2695c22d-8a1d-4416-983c-4c0895ae78ea on n-h1-851028-12 Sep 14 09:28:03.445880 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-31fc9523-c149-4a68-b930-cb26f0962e13 req-123b6235-d001-4a04-8853-939dedce2cf3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044808 Sep 14 09:28:03.446690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1499/2175] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:03.454789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1958502720", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:03.526952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:28:04.614892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:28:04.615527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:28:04.615910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:28:04.617458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:28:04.618219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:28:04.633585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:04.634330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:04.634869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:04.636024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:04.636593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:04.637408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:04.662537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:04.669739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:04.702817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:28:04.706401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:28:04.780832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cb82464-17c0-4a7e-b65a-94ce6fb7ffb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.332733 Sep 14 09:28:04.790232 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1500/2176] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:28:04.790232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:04.790232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:04.804259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:04.804697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:04.805445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:04.806375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:04.807061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:04.807731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.192930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:05.205550 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc7cfe35-d951-4df1-a9b6-fcf043f318c8 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.421221 Sep 14 09:28:05.216012 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1501/2177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:04 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:05.219585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:05.226770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:05.244063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.245761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.248687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.250705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.252425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.254200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.375280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-992b50fa-4deb-4abe-8cc6-200739e97875 tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action" status: 202 len: 0 microversion: 2.1 time: 0.165201 Sep 14 09:28:05.377036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1502/2178] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:28:05 2022] POST /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:05.391005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3caf6fd-4de4-4fed-a1af-0f9d837bd4ff tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f693e3da040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1702580418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+u3zs02Fd7We/ra+pJwrZ7/Zls2TRvCCrz0YpyPO5ytfgi6o3kg8Vr9xrgLkVlJ2/x7fczkn3Jv7PjugP3W5uf120mzwTQJLj63oVFONfCW3tcZ6vllOK4XGyd0wrT0w=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:05.420194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d3caf6fd-4de4-4fed-a1af-0f9d837bd4ff tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:05.427706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d3caf6fd-4de4-4fed-a1af-0f9d837bd4ff tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:05.480430 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3caf6fd-4de4-4fed-a1af-0f9d837bd4ff tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.101149 Sep 14 09:28:05.490551 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1503/2179] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:05.496032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:05.496944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:05.506061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.507099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.507553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.508489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.509067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.509595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.795312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:05.805750 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32dd970a-5dd1-433c-a591-c73ab893ef3a tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.314677 Sep 14 09:28:05.806327 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1504/2180] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:05 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:05.811294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:05.812391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:05.820559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.821277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.821875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.822813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.823269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.823697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.896808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:05.906861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:05.908453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:05.911332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7cb3e606-22ee-47bf-9506-b0c98c8e26e4 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1357 microversion: 2.57 time: 0.102411 Sep 14 09:28:05.912482 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1505/2181] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:05 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1357 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:05.917874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:05.920731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:05.928079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.928793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.929633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.930521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.931128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.931708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.969397 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0b67a51-8fb3-476d-9bf1-088a265f0be6 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055832 Sep 14 09:28:05.969983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1506/2182] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:28:05 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:05.976975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:05.977537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:05.984131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.985065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.985065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:05.985574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:05.986178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:05.986756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.063098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:06.074696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bbf58083-add3-4cc5-bb6a-f43c82dec122 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1261 microversion: 2.1 time: 0.103331 Sep 14 09:28:06.075502 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1507/2183] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:05 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:06.080409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:06.081011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:06.091691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.092431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.093269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.094283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.094993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.095583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.274217 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4ea5895-e716-4e19-8c13-c6898330923f tempest-ServersAdminTestJSON-969298714 tempest-ServersAdminTestJSON-969298714-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1616 microversion: 2.1 time: 0.197289 Sep 14 09:28:06.274922 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1508/2184] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:06 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1616 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:06.279418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6355c35f-82f5-4b4b-a629-bc92283f369b tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f693e40a1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1195533462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFnOwlnHDmwtEVEcc9N5aG5XSDCXRUmUmTjEbGB3LWB8WyQ/gvMEcRsnVfTREPw1G6SbM3+XgVad8alqsOrjeqT544FO2YWaxEpGorSZDTpecDL2LAuUt31Ok3+8ggFd9A=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:06.297371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-6355c35f-82f5-4b4b-a629-bc92283f369b tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:06.302761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-6355c35f-82f5-4b4b-a629-bc92283f369b tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:06.318117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:06.336508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6355c35f-82f5-4b4b-a629-bc92283f369b tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.060362 Sep 14 09:28:06.337134 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1509/2185] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:06.350354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944ea143-d181-4781-83b5-96863212f8bb", "tag": "e1be2a65-3410-463e-ad9e-2c711e13ecd4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:06.360544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.361035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.361480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.375079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] Creating event network-changed:e1be2a65-3410-463e-ad9e-2c711e13ecd4 for instance 944ea143-d181-4781-83b5-96863212f8bb on n-h1-851028-12 Sep 14 09:28:06.380590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f34daa28-6d50-4522-acf8-5e6c41ed56f3 req-3d291015-40b7-4bd4-bcb1-69cda5dfce3c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035200 Sep 14 09:28:06.381220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1510/2186] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:06.387624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:06.391462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:06.402068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.402570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.403011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.403770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.404272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.404705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.434616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:06.490459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=5,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:06.526023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5c77a9e-e895-46e0-a8ce-fccbf393dc29 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "DELETE /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 204 len: 0 microversion: 2.57 time: 0.143378 Sep 14 09:28:06.526662 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1511/2187] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:28:06 2022] DELETE /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:28:06.534016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:06.535030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:06.542227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.542595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.544739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:06.545120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:06.545589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:06.546539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.215933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:07.226788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4ccd925-314c-4938-a646-69c63c42ab18 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.697549 Sep 14 09:28:07.239923 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1512/2188] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:06 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:07.239923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:07.239923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:07.249424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.250132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.250947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.251792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.252394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.252887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.284241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:07.375680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b07d663-a6ee-4c75-9651-db32d910ef70 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 204 len: 0 microversion: 2.1 time: 0.145200 Sep 14 09:28:07.379965 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1513/2189] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:07 2022] DELETE /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:07.386283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75c9aafe-993a-419e-a967-333d08b598fe tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Action: 'create', calling method: .version_select at 0x7f69440743a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1146027156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNfl7vEPyqGHd8mvnFPUSU0CBpUZz3BY5iO6XUHMUn1h45D6am1RGAlNAkM+o1H0xlXYzUX1GJ+hKKbrZjHXRU180dmtGdXvW5FT5bLJ/ilaAhj8mTmbvEmZKRxgyVPTQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:07.407487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-75c9aafe-993a-419e-a967-333d08b598fe tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:07.413108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-75c9aafe-993a-419e-a967-333d08b598fe tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Getting quotas for user 22dc8a80349542f79b401e42933d65a4 and project e940b3aa6b3e413bb1cf484486697c9d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:07.440826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75c9aafe-993a-419e-a967-333d08b598fe tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058846 Sep 14 09:28:07.442361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1514/2190] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:07.449475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:07.450512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:07.459225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.460698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.461191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.462350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.462613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.463141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.575570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:07.594313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:07.595781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:07.597027 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5cd9bfe-1597-4dbb-8f60-2b5b32744246 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1363 microversion: 2.57 time: 0.153563 Sep 14 09:28:07.599178 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1515/2191] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:07 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:07.604700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:07.605555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:07.626215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.626621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.627071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.627804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.628301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.629211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.942865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:07.951377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-033dcc3f-1a85-4f42-9b6a-0051a120afaa tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.350846 Sep 14 09:28:07.952530 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1516/2192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:07 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:07.958001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:07.960495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:07.967678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.968209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.968657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:07.969446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:07.969905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:07.970987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.004201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17d6248c-e0ce-4b30-868d-3236cb94e55c tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050353 Sep 14 09:28:08.005898 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1517/2193] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:28:07 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:28:08.010299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.011012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:08.018880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.019428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.019917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.020656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.021107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.021531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.185089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:08.197073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-693cba69-bca4-4713-b9c8-89f09a8c584f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.190472 Sep 14 09:28:08.197666 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1518/2194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:08 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:08.202475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.203066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:08.209710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.210197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.210632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.211324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.211775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.212222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.358882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:08.371511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f8efa84-b634-4b88-a1e5-db3c020402bd tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1469 microversion: 2.1 time: 0.172380 Sep 14 09:28:08.372534 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1519/2195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:08 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:08.380109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5012427-074a-4290-b4af-3eb2d4041150 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f69440ee040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.385856 n-d-851028-12 devstack@n-api.service[122444]: WARNING oslo_db.sqlalchemy.utils [None req-a5012427-074a-4290-b4af-3eb2d4041150 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:28:08.392336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5012427-074a-4290-b4af-3eb2d4041150 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.017153 Sep 14 09:28:08.393205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1520/2196] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:28:08 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:08.397633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.398189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:08.404844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.405330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.405760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.406450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.406890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.407308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.438399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:08.532996 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bac77d97-05ad-4e96-93ad-c57ea12db929 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 204 len: 0 microversion: 2.1 time: 0.138675 Sep 14 09:28:08.535012 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1521/2197] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:08 2022] DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:08.541914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.542527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:08.549261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.549868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.550321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.551612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.552252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.552683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.772550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:08.789107 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4452141d-744a-4ade-ace1-bb3ac5691848 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.250969 Sep 14 09:28:08.789853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1522/2198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:08 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:08.795626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a88ce2c3-f1b2-4a8e-9eb9-77185954fd95 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693e40e790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.828730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a88ce2c3-f1b2-4a8e-9eb9-77185954fd95 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1146027156" status: 202 len: 0 microversion: 2.1 time: 0.037550 Sep 14 09:28:08.829416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1523/2199] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 09:28:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1146027156 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:08.836038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8298e261-6ef8-4388-8c25-3ebffb7f5085", "tag": "82f56d37-f14f-4c46-a72a-d5123c8e05a4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:08.849801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.850286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.850833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.864379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] Creating event network-changed:82f56d37-f14f-4c46-a72a-d5123c8e05a4 for instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 on n-h1-851028-12 Sep 14 09:28:08.871441 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e48d4e0d-3a49-4859-8ff3-93aa1aef8bf4 req-c389b004-f69b-4419-b028-226058f2b8f3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040506 Sep 14 09:28:08.872572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1524/2200] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:08.879796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:08.880661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:08.891618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.892150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.892591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:08.893312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:08.893763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:08.894182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.147296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.157496 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b25c921-5f23-4b1f-97f1-57c3f69db3c3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1681 microversion: 2.1 time: 0.283263 Sep 14 09:28:09.158267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1525/2201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:08 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1681 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:09.166273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.166795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:09.176712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.177419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.178569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.179223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.179671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.180994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.250378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.259857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.261327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.262541 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c498436-e76f-43c9-bdfd-023cd7712226 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1363 microversion: 2.57 time: 0.102897 Sep 14 09:28:09.263119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1526/2202] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:09 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1363 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:09.267487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1f8a82b-3b74-4b71-9923-210859b53501 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693fdf0c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.286183 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1f8a82b-3b74-4b71-9923-210859b53501 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1195533462" status: 202 len: 0 microversion: 2.1 time: 0.021530 Sep 14 09:28:09.286769 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1527/2203] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 09:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1195533462 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:09.291234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.291849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:09.297740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.298224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.298660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.299359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.299812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.300269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.454690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.462678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b758b05e-7201-4696-8a97-657baea28269 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.174905 Sep 14 09:28:09.463276 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1528/2204] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:09 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:09.467819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67c3413-be58-4542-935e-625a9653c64c", "tag": "b281a8f0-a67a-4e1f-81f1-2e972c1e040d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:09.477857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.478341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.478775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.491281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] Creating event network-changed:b281a8f0-a67a-4e1f-81f1-2e972c1e040d for instance d67c3413-be58-4542-935e-625a9653c64c on n-h2-851028-12 Sep 14 09:28:09.496265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d6a70606-3910-4fd7-a14f-971b569f4564 req-fe740db4-0c1f-41f7-95e9-906ac7b0f334 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031778 Sep 14 09:28:09.497083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1529/2205] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:09.503737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.505136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:09.511579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.512101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.512535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.513233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.513687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.514110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.519062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:09.663294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.671411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ffedc57-a10d-4c68-9d82-d58e8636cfdd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.173252 Sep 14 09:28:09.672454 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1530/2206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:09 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:09.690914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d0a9841-c471-4263-8cc9-ccbbcaeab282 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] Calling method '.version_select at 0x7f693fd91d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.712807 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d0a9841-c471-4263-8cc9-ccbbcaeab282 tempest-KeyPairsV2TestJSON-2044751809 tempest-KeyPairsV2TestJSON-2044751809-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1702580418" status: 202 len: 0 microversion: 2.1 time: 0.031337 Sep 14 09:28:09.713537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1531/2207] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 09:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1702580418 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:09.721663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.722435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:09.734462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.735331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.736393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.737643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.739045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.739798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.906916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:09.917269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96c0e243-a974-4c20-b825-951e4ba6f281 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1469 microversion: 2.1 time: 0.202286 Sep 14 09:28:09.918085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1532/2208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:09 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:09.941108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:09.942180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:09.948827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.949384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.949904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:09.950712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:09.951554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:09.952581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.108182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:10.116731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83c214e4-e0a3-4f6a-b78b-09548b6ac95b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.187317 Sep 14 09:28:10.117345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1533/2209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:09 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:10.186231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:10.187010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:10.194112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.194732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.195173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.195879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.196397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.196849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.348992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:10.358324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b07150d6-507f-453c-9d46-5e40298e0351 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1681 microversion: 2.1 time: 0.175887 Sep 14 09:28:10.358920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1534/2210] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:10 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:28:10.382499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:10.383161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:10.392071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.392573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.393021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.393745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.394201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.395324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.456427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.457628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.458709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.460101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lazy-loading 'fault' on Instance uuid 541de050-9f3a-443e-9916-268bd87d8256 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:10.522756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:10.531509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:10.532999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2578092d0f04990ae49d6e074575a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4cac1e10b4188841a7db1a130b5ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:10.534359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2376975f-c917-4b55-8aca-fbcdabc0ffae tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 200 len: 1368 microversion: 2.57 time: 0.174156 Sep 14 09:28:10.534940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1535/2211] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:10 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:28:10.540340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:10.540963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:10.547595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.548258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.548701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:10.549410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:10.549867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:10.550295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.205818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:11.217555 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0d7b63a-a8d0-4352-b865-58a036bbe13e tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.681334 Sep 14 09:28:11.218367 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1536/2212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:10 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:11.233337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:11.234374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:11.242434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:11.243165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:11.244164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.246039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:11.246623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:11.247289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.811445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:11.824835 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a0f7fce-ca38-4fd3-87c7-8717806493ee tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.600577 Sep 14 09:28:11.825647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1537/2213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:11 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:11.839024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:11.843301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:11.865091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:11.865934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:11.866537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.867733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:11.871395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:11.871852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.959079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:11.960064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:11.960725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:11.961566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lazy-loading 'fault' on Instance uuid 8725cbad-a54d-41e2-ab0f-671beda0e871 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:12.105295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:12.119195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d1a0f83-bce7-447d-b2ca-51b41834c3e8 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 200 len: 1304 microversion: 2.1 time: 0.288849 Sep 14 09:28:12.129795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1538/2214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:11 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:12.129795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:12.129795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:12.144115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:12.146104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:12.146691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:12.147551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:12.148908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:12.149713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:12.877614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:12.886487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-653c4f31-4e3a-4c34-92c0-6f3c1d0ce0bc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.765072 Sep 14 09:28:12.887121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1539/2215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:12 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:12.893938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:12.895654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:12.899705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:12.916588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:12.917408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:12.918013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:12.918798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:12.919415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:12.919861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.257173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:13.274751 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e27a2ba-19e9-4455-abf9-88ba748f7a14 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1681 microversion: 2.1 time: 0.386314 Sep 14 09:28:13.276304 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1540/2216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:12 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1681 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:13.291238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:13.293278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] [instance: 541de050-9f3a-443e-9916-268bd87d8256] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:13.300084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:13.301777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:13.302824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.303971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:13.305120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:13.305779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.326917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] HTTP exception thrown: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Request method failure captured: Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 HTTP/1.1 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ529hVa-xboCMWDHSLvLji14e_ZXJbZ71kE75QcWm6-x_HkpAXx2WUHYZDXjpWmhkFemYAvyF7MdlK6fyfId_ReUdJayHkLhwtCzb7dkinkgd1ztsCfC9gtkxOhTjjPZgMhncfV_1T9wMDHealIIojhIaKmoKZkSDBQz6YvAMYhRuY Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.57 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7aa4cac1e10b4188841a7db1a130b5ac Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerShowV257Test-1826573701 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7aa4cac1e10b4188841a7db1a130b5ac", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7aa4cac1e10b4188841a7db1a130b5ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7aa4cac1e10b4188841a7db1a130b5ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7aa4cac1e10b4188841a7db1a130b5ac"}]}] Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerShowV257Test-1826573701 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7aa4cac1e10b4188841a7db1a130b5ac Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerShowV257Test-1826573701 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerShowV257Test-1826573701-project Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e2578092d0f04990ae49d6e074575a88 Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerShowV257Test-1826573701-project Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '541de050-9f3a-443e-9916-268bd87d8256'} Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:13.328627 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] Returning 404 to user: Instance 541de050-9f3a-443e-9916-268bd87d8256 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:13.335439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6c80824-ab56-4b8d-ac0d-421687bce717 tempest-ServerShowV257Test-1826573701 tempest-ServerShowV257Test-1826573701-project] 10.222.0.90 "GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256" status: 404 len: 111 microversion: 2.57 time: 0.051566 Sep 14 09:28:13.356941 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1541/2217] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:28:13 2022] GET /compute/v2.1/servers/541de050-9f3a-443e-9916-268bd87d8256 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:28:13.368834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8725cbad-a54d-41e2-ab0f-671beda0e871", "name": "network-vif-deleted", "tag": "6c0a47e3-87c9-4272-993c-7c2abf696baa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:13.388652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:13.389317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:13.390622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.418723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] Creating event network-vif-deleted:6c0a47e3-87c9-4272-993c-7c2abf696baa for instance 8725cbad-a54d-41e2-ab0f-671beda0e871 on n-h2-851028-12 Sep 14 09:28:13.428116 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-61c8a4a4-1a57-4a3d-9f0b-71ccf570d98a req-63e9adaf-5dae-44c0-9b4a-345fe17375ba service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067441 Sep 14 09:28:13.432233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1542/2218] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:13.437466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:13.438231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:13.448047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:13.448614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:13.449054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.449909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:13.450365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:13.450970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:13.953954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:13.966189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-159fec09-b44d-4fcb-9af5-dc25a1b83c78 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.532652 Sep 14 09:28:13.966802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1543/2219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:13 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:13.980014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944ea143-d181-4781-83b5-96863212f8bb", "name": "network-vif-plugged", "status": "completed", "tag": "e1be2a65-3410-463e-ad9e-2c711e13ecd4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:14.014100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.014908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.016008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.032389 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] Creating event network-vif-plugged:e1be2a65-3410-463e-ad9e-2c711e13ecd4 for instance 944ea143-d181-4781-83b5-96863212f8bb on n-h1-851028-12 Sep 14 09:28:14.049056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4291e856-5555-47d1-894d-396cad4c3247 req-5c16aefa-489d-4afe-bc6b-4fe72560642d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074968 Sep 14 09:28:14.050027 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1544/2220] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:14.378164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbfe2e58-ef78-4e0c-a85c-d45a27cffa16 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e3b4af0>, body: {"keypair": {"name": "tempest-keypair-1285449368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpdg2+YZHDu36eVHYoGdFo6fcxwiNN/xrYTHb/JKA2haTceLjmmXcm4buh4VhvmCn7UXkj1xIjZcC6ATdnVt8yCQ3lJFb2OqU8qIsYg2siRM2x/KuoHJDDyWXuPAj4FhA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:14.400603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dbfe2e58-ef78-4e0c-a85c-d45a27cffa16 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:14.407643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dbfe2e58-ef78-4e0c-a85c-d45a27cffa16 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:14.452219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbfe2e58-ef78-4e0c-a85c-d45a27cffa16 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.400093 Sep 14 09:28:14.454010 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1545/2221] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 403 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:14.460760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:14.461681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:14.473650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.474142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.474575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.475275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.475721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.476164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.647750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:14.690722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:14.702447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3056985-799b-415d-b8e0-fa1a737776fa tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.246257 Sep 14 09:28:14.703401 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1546/2222] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:14 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:14.724437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937c32d-b9f3-45c4-a000-428cbd5eeafb", "name": "network-vif-unplugged", "status": "completed", "tag": "41d1034c-a2c8-4ab4-be64-2eca390bf965"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:14.735269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.735762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.736480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.750732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] Creating event network-vif-unplugged:41d1034c-a2c8-4ab4-be64-2eca390bf965 for instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb on n-h1-851028-12 Sep 14 09:28:14.756579 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b71dd451-1a8d-430e-b66a-ebe37a41628d req-6be44787-f5fd-4abb-b195-53770c2915e1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038787 Sep 14 09:28:14.757351 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1547/2223] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:14.763558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:14.764505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 8725cbad-a54d-41e2-ab0f-671beda0e871] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:14.771994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.772716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.773153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.773860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.774425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.775053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.794024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] HTTP exception thrown: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Request method failure captured: Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 HTTP/1.1 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4JBVmZVdAiBKqA9cnV8P3f-Itt8nZOnL_tZzQ728o-Jw0mPpT5I58_vdGKJgahh04GuxW_tqjhoioWz5lfKYUvonoJfBymHfkG2J7BN6JOXb1z8oiVSxsyo951Iv0OJiWw4THJMEkHzRNTbIzzwe7yb41oLn6Y9w2tU9jheQN1oHU Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6ba112b4965542eea489647d01a6476f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6ba112b4965542eea489647d01a6476f"}]}] Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: fff8ac76bff9488bbd3718967820c39a Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8725cbad-a54d-41e2-ab0f-671beda0e871'} Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:14.795929 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Returning 404 to user: Instance 8725cbad-a54d-41e2-ab0f-671beda0e871 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60fbd206-e01a-4157-96d7-a6dc644145a3 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871" status: 404 len: 111 microversion: 2.1 time: 0.039141 Sep 14 09:28:14.803737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1548/2224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:14 2022] GET /compute/v2.1/servers/8725cbad-a54d-41e2-ab0f-671beda0e871 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:14.809557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:14.810069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:14.817049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.818261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.820332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:14.821094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:14.821608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:14.822049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.000537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:15.010104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-518127a5-62ea-493a-b767-f7928a215a3c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.210562 Sep 14 09:28:15.010725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1549/2225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:14 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:15.023682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.024446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:15.031296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.032565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.033256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.034208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.035942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.036778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.085180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.086647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.087386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.088403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'fault' on Instance uuid 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:15.148381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:15.159627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5035e155-23c4-40e5-a609-5ae6fa7f44b7 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1330 microversion: 2.1 time: 0.142776 Sep 14 09:28:15.176530 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1550/2226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:15 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1330 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:15.181787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-119f3a0a-0946-4ddf-83ba-f7c542aa4fd7 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e3bd040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.192501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-119f3a0a-0946-4ddf-83ba-f7c542aa4fd7 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs/tempest-keypair-1285449368" status: 200 len: 513 microversion: 2.2 time: 0.013572 Sep 14 09:28:15.200560 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1551/2227] 10.222.0.90 () {60 vars in 1258 bytes} [Wed Sep 14 09:28:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1285449368 => generated 513 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:15.205674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.206182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:15.215124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.215637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.216112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.216838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.217292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.217719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.223809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:15.250245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:15.350604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87f24b3f-ae5f-4d8c-acb8-dd151c3e474d tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 204 len: 0 microversion: 2.1 time: 0.148475 Sep 14 09:28:15.354589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1552/2228] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:15 2022] DELETE /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:15.360835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.361744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:15.368529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.369016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.369449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.370325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.370789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.371214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.551393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:15.560007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43d9b527-358d-4d9c-9cf3-7912d7df89ed tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1318 microversion: 2.1 time: 0.204072 Sep 14 09:28:15.560618 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1553/2229] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:15 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:15.566000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef40e852-0827-4896-99fc-b6b9177706ea tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e473dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.587826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef40e852-0827-4896-99fc-b6b9177706ea tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285449368" status: 204 len: 0 microversion: 2.2 time: 0.025953 Sep 14 09:28:15.588426 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1554/2230] 10.222.0.90 () {60 vars in 1261 bytes} [Wed Sep 14 09:28:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285449368 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:15.600908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.601741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:15.609000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.609215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.609541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.610244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.611007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.611380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.837932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:15.874731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe1cd479-748e-428a-b1ae-158064cddb37 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1469 microversion: 2.1 time: 0.285028 Sep 14 09:28:15.876654 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1555/2231] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:15 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:15.883110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a8db757-2300-4a68-9e89-654d90132402 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e3f0e50>, body: {"keypair": {"name": "tempest-keypair-34384779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6NxHYwVuAF4cSr2fP87ZmST5kCyE94denZNwDnOcWHhaSxtO2Q9EM0Eo9Q1ilpiYaUkQ5T33vJg23Mtq4+pBaTb4pAZMeWogrmTH41Ie+VbkeyHvTfbORhzI4WjfgJSQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:15.906764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0a8db757-2300-4a68-9e89-654d90132402 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:15.913581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0a8db757-2300-4a68-9e89-654d90132402 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:15.943775 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a8db757-2300-4a68-9e89-654d90132402 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.065230 Sep 14 09:28:15.945261 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1556/2232] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:15.952557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:15.953454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:15.964030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.964834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.965486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:15.966484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:15.967394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:15.968217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.183098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:16.192028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d65fc8b5-eb7a-4109-a875-c4242a82989f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.244759 Sep 14 09:28:16.207932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1557/2233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:15 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:16.207932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b71c890f-2f50-4f3e-bf18-4e67bdee8135 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e3b4a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:16.232066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b71c890f-2f50-4f3e-bf18-4e67bdee8135 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34384779" status: 204 len: 0 microversion: 2.2 time: 0.034582 Sep 14 09:28:16.238023 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1558/2234] 10.222.0.90 () {60 vars in 1255 bytes} [Wed Sep 14 09:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34384779 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:16.244417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:16.245082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:16.252178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.252672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.253372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.254755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.255219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.255857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.427838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:16.437220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17decaaf-a8db-497f-878a-ed492127f31d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.197030 Sep 14 09:28:16.438241 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1559/2235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:16 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:16.444414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8298e261-6ef8-4388-8c25-3ebffb7f5085", "name": "network-vif-plugged", "status": "completed", "tag": "82f56d37-f14f-4c46-a72a-d5123c8e05a4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:16.456392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.456968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.457479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.470679 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] Creating event network-vif-plugged:82f56d37-f14f-4c46-a72a-d5123c8e05a4 for instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 on n-h1-851028-12 Sep 14 09:28:16.476415 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ee4b30f2-6454-484c-ab88-5c9763963b48 req-7844dc6e-f3d0-4fe7-b750-3cb2fcb805dc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036451 Sep 14 09:28:16.477143 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1560/2236] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:16.690535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:16.691483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:16.699093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.700848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.701761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.702814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.703474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.704279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.749832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.750677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.751465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.752174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'fault' on Instance uuid 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:16.860595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:16.870417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7654684a-a905-441d-8141-211399376ddc tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 200 len: 1330 microversion: 2.1 time: 0.391791 Sep 14 09:28:16.871013 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1561/2237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:16 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 1330 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:16.877069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-076b391a-b0e7-4274-9210-77ec1f8cfa8c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f69440ee040>, body: {"keypair": {"name": "tempest-keypair-283378612", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:16.893970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-076b391a-b0e7-4274-9210-77ec1f8cfa8c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:16.899644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-076b391a-b0e7-4274-9210-77ec1f8cfa8c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:16.932142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-076b391a-b0e7-4274-9210-77ec1f8cfa8c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.059666 Sep 14 09:28:16.933338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1562/2238] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:16 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:16.939120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:16.940130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:16.947549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.948134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.948789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:16.949502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:16.950179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:16.950644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:17.246845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:17.257306 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81aa8801-6450-4e7c-93a3-e76d9c168871 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 200 len: 1507 microversion: 2.1 time: 0.322036 Sep 14 09:28:17.258208 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1563/2239] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:16 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:17.266585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6937c32d-b9f3-45c4-a000-428cbd5eeafb", "tag": "41d1034c-a2c8-4ab4-be64-2eca390bf965"}, {"server_uuid": "8e5a9435-f248-4f27-a4f8-a5b98ebdaf31", "name": "network-vif-deleted", "tag": "427da0f5-1cf9-487f-849b-8f231087f747"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:17.279548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:17.280237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:17.280673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:17.309993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Creating event network-changed:41d1034c-a2c8-4ab4-be64-2eca390bf965 for instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb on n-h1-851028-12 Sep 14 09:28:17.310569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] Creating event network-vif-deleted:427da0f5-1cf9-487f-849b-8f231087f747 for instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 on n-h1-851028-12 Sep 14 09:28:17.320270 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1a8e5b49-50d8-489d-bc0d-7d4d066aa830 req-aa83d251-c033-498d-8aff-4aa1773d4655 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060398 Sep 14 09:28:17.321570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1564/2240] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:17.327502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:17.328779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:17.337374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:17.337901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:17.338346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:17.339232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:17.339685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:17.340147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:17.766311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:17.781652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef992167-b6df-4cb0-ba03-ca5f0eccf5f9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1469 microversion: 2.1 time: 0.458529 Sep 14 09:28:17.792376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1565/2241] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:17 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:17.800250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e62c554-12db-40b2-8dc1-fd6628d49ac9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e473160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:17.829427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e62c554-12db-40b2-8dc1-fd6628d49ac9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283378612" status: 204 len: 0 microversion: 2.2 time: 0.035814 Sep 14 09:28:17.830937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1566/2242] 10.222.0.90 () {60 vars in 1258 bytes} [Wed Sep 14 09:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283378612 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:17.849921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:17.851299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:17.859491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:17.867620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:17.868559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:17.869418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:17.870515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:17.872323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:17.873084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:18.954836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:18.967726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9da1fa76-2cc4-488b-8eb7-1b7305025a53 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 1.134154 Sep 14 09:28:18.969104 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1567/2243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:17 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:18.976534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:18.977482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:18.996345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:18.998848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:19.001116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:19.002178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:19.005001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:19.005001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:19.632584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:19.640765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4fdd84e4-473b-4eb0-8315-60371e234a45 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085" status: 200 len: 1506 microversion: 2.1 time: 0.670206 Sep 14 09:28:19.641622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1568/2244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:18 2022] GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:19.647003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:19.647833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:19.654214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:19.655718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:19.656723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:19.658208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:19.662760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:19.663212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.150053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:20.158778 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd95035c-e675-4b6d-8fc4-435e50c1af3b tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.515901 Sep 14 09:28:20.164121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1569/2245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:19 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:20.171438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f4b3c641-a6ee-42aa-b569-dad714ba810a tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e372f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-694690761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUggWjTN5trLmIoaHcPTBVIa9ZFNHaqNCMtCULUAGZBqQotaWMIBjGsmRb7MM+V4N49cgVBN2r82cjgsK8LwAyNYH3I0lMSoZ+9Ogi0Td3qOSr60tjd5F8OXZygywKTRA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:20.214476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f4b3c641-a6ee-42aa-b569-dad714ba810a tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:20.220462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f4b3c641-a6ee-42aa-b569-dad714ba810a tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:20.252509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f4b3c641-a6ee-42aa-b569-dad714ba810a tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.091225 Sep 14 09:28:20.253405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1570/2246] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:20.258533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:20.259162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:20.265567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.266065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.266503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.267412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.267881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.268327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.287923 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 HTTP/1.1 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8e5a9435-f248-4f27-a4f8-a5b98ebdaf31'} Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:20.289974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77e8048c-f39f-4957-a928-5576ca053d96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 404 len: 111 microversion: 2.1 time: 0.036865 Sep 14 09:28:20.296993 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1571/2247] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:20 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:20.299572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c3413-be58-4542-935e-625a9653c64c", "name": "network-vif-plugged", "status": "completed", "tag": "b281a8f0-a67a-4e1f-81f1-2e972c1e040d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:20.311969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.312525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.313353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.330136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] Creating event network-vif-plugged:b281a8f0-a67a-4e1f-81f1-2e972c1e040d for instance d67c3413-be58-4542-935e-625a9653c64c on n-h2-851028-12 Sep 14 09:28:20.337528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c08e9e91-0566-4f02-8cab-5c3b84b680d2 req-169dca1f-6fe2-4f23-9eee-47844916aa84 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043559 Sep 14 09:28:20.341575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1572/2248] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:20.363302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:20.366327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:20.381985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.382672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.383322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.384866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.385446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.385977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.431962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.432466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.432903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.433356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lazy-loading 'fault' on Instance uuid 5688ca53-9b1d-4ac5-8961-ca20b218ea40 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:20.541273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:20.552885 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6f4b4b8-da75-4003-9bfd-d3d9812f8644 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 200 len: 1303 microversion: 2.1 time: 0.208807 Sep 14 09:28:20.554121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1573/2249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:20 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 1303 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:20.559377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:20.560140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:20.580374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.582434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.582896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.583830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.584649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.585261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.620763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:20.636863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:20.711263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-979f29cc-6267-406c-9f90-7712b43a6220 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085" status: 204 len: 0 microversion: 2.1 time: 0.155494 Sep 14 09:28:20.712678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1574/2250] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:20 2022] DELETE /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:20.719639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:20.720702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:20.729889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.730616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.731241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:20.732009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:20.732604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:20.733178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.064800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:21.075038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3c4a804-253a-43b5-99d6-9175985412e1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1309 microversion: 2.1 time: 0.360097 Sep 14 09:28:21.088283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1575/2251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:20 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:21.098776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5688ca53-9b1d-4ac5-8961-ca20b218ea40", "name": "network-vif-deleted", "tag": "e6587b73-159e-49e3-94fd-6c5a594d7777"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:21.110311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.111138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.111723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.124439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] Creating event network-vif-deleted:e6587b73-159e-49e3-94fd-6c5a594d7777 for instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 on n-h1-851028-12 Sep 14 09:28:21.130528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7fb0b759-c45c-43c7-a9ff-86824769f01a req-0b4df224-faef-4649-a431-6660c71af6e6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040902 Sep 14 09:28:21.131393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1576/2252] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:21.137664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15440f63-4611-4c12-aa47-3c8194087c2c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e3bda60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1034362119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQfudiHl4igSKYwJ+iNWKmvl+jUo3hL7ssH/AKaSF7UpcBlHQw/0jP4aIbqv3A0iIMrHy2I0CU+kB/wKabDEM0anQ+f1K3eE01zSwdMi1u9lvbgJ+Im5eaPl4ohZ0F+9w=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:21.175329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-15440f63-4611-4c12-aa47-3c8194087c2c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:21.182899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-15440f63-4611-4c12-aa47-3c8194087c2c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:21.215028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15440f63-4611-4c12-aa47-3c8194087c2c tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.082118 Sep 14 09:28:21.216806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1577/2253] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:21.224745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1fd70f9d-a297-4a4c-a3b0-24e72df7d1e1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '.version_select at 0x7f693fdf0280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:21.258812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1fd70f9d-a297-4a4c-a3b0-24e72df7d1e1 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454044207" status: 202 len: 0 microversion: 2.1 time: 0.040203 Sep 14 09:28:21.260069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1578/2254] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454044207 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:28:21.271567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:21.273566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:21.282508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.283320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.284011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.285774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.287552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.288254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.327056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:21.441113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03d2b346-d236-4353-8ca4-af2584775fba tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "DELETE /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 204 len: 0 microversion: 2.1 time: 0.179471 Sep 14 09:28:21.442935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1579/2255] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:21 2022] DELETE /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:21.455224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:21.456015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:21.462905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.463788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.464471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.465199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.465659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.466088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.794796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:21.805592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b4ab92f-7d9d-4f1c-aa22-5da376ea5087 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.360675 Sep 14 09:28:21.817454 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1580/2256] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:21 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:21.828910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4fddc1e9-31a2-4f9d-b2e4-5561aeafa4c9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e3f0e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2103500264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZr/d4Ymg1b+62b3Q0mHzXz8M6eNCnG1507drBxVs9eeVK/q1ZR2zdtVtowqawUPHD0FubhRjNu4KUcthQyizeL7KXQyBX0yWEkWVANMUgQTHlmKOEYOvirJxZzCVlBDQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:21.847382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4fddc1e9-31a2-4f9d-b2e4-5561aeafa4c9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:21.853302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4fddc1e9-31a2-4f9d-b2e4-5561aeafa4c9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:21.889727 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4fddc1e9-31a2-4f9d-b2e4-5561aeafa4c9 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.071011 Sep 14 09:28:21.891938 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1581/2257] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:21.900502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:21.901766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:21.908900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.909467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.911271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:21.912151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:21.912547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:21.913142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:22.787073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:22.800625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-050bbafd-50dd-4ea4-930d-d3d2fec1a697 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085" status: 200 len: 1512 microversion: 2.1 time: 0.907247 Sep 14 09:28:22.801780 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1582/2258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:21 2022] GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 => generated 1512 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:22.814108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:22.814736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 5688ca53-9b1d-4ac5-8961-ca20b218ea40] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:22.840882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:22.841178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:22.841877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:22.842886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:22.843330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:22.844189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:22.860590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] HTTP exception thrown: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Request method failure captured: Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 HTTP/1.1 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4JBVmZVdAiBKqA9cnV8P3f-Itt8nZOnL_tZzQ728o-Jw0mPpT5I58_vdGKJgahh04GuxW_tqjhoioWz5lfKYUvonoJfBymHfkG2J7BN6JOXb1z8oiVSxsyo951Iv0OJiWw4THJMEkHzRNTbIzzwe7yb41oLn6Y9w2tU9jheQN1oHU Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6ba112b4965542eea489647d01a6476f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6ba112b4965542eea489647d01a6476f"}]}] Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: fff8ac76bff9488bbd3718967820c39a Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5688ca53-9b1d-4ac5-8961-ca20b218ea40'} Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:22.862699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. Sep 14 09:28:22.868148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:22.869518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Returning 404 to user: Instance 5688ca53-9b1d-4ac5-8961-ca20b218ea40 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:22.870732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a624195-fd9a-4888-a21e-717b0a75b5a9 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40" status: 404 len: 111 microversion: 2.1 time: 0.068246 Sep 14 09:28:22.874808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1583/2259] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:22 2022] GET /compute/v2.1/servers/5688ca53-9b1d-4ac5-8961-ca20b218ea40 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:22.881295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3e8be70-57ab-4302-81e6-351fdc55286f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e35a940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:22.885924 n-d-851028-12 devstack@n-api.service[122444]: WARNING oslo_db.sqlalchemy.utils [None req-a3e8be70-57ab-4302-81e6-351fdc55286f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:28:22.893347 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3e8be70-57ab-4302-81e6-351fdc55286f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.017084 Sep 14 09:28:22.894806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1584/2260] 10.222.0.90 () {60 vars in 1177 bytes} [Wed Sep 14 09:28:22 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:22.900265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:22.900877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:22.908900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:22.909614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:22.910445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:22.911992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:22.912684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:22.913409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:23.271716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:23.282388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c24e25e-0009-4234-b176-06ea533fdb83 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1490 microversion: 2.1 time: 0.385889 Sep 14 09:28:23.283644 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1585/2261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:22 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1490 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:23.289883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:23.290721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:23.303302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:23.307444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:23.308055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:23.309203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:23.309975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:23.310640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:23.993010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:24.005931 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e354a7ae-9ca4-45ee-ba99-41fbd9b936dc tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1391 microversion: 2.1 time: 0.720770 Sep 14 09:28:24.025180 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1586/2262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:23 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1391 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:24.030226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:24.030803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:24.038316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.039079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.039779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:24.041902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.041902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.041902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:24.076202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:24.215448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89104914-57bd-456b-895e-aed8f654eb52 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 204 len: 0 microversion: 2.1 time: 0.188569 Sep 14 09:28:24.216639 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1587/2263] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:24 2022] DELETE /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:24.228457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16333622-4f5e-4722-affe-102a68528b69 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e312c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:24.260091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16333622-4f5e-4722-affe-102a68528b69 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2103500264" status: 204 len: 0 microversion: 2.2 time: 0.041200 Sep 14 09:28:24.261426 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1588/2264] 10.222.0.90 () {60 vars in 1321 bytes} [Wed Sep 14 09:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2103500264 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:24.267876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8899e272-7bdc-4a8c-b23d-ab0eaf524b36 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: .version_select at 0x7f693e31f550>, body: {"keypair": {"name": "tempest-keypair-516161777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvVaw2JKE8WSrdkclM8OzLPiVgrs7df4Pugk0Icvyz7exyzNqYDXX9kSrSjGP19IagKLInCxwzW01inY+VN3BLUdxA3fE8+/8qJhX6sbyh+ju2cGITrHbGE/C4p5vcxOQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:24.291146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:24.298575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=61 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:24.302402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8899e272-7bdc-4a8c-b23d-ab0eaf524b36 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:24.311631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8899e272-7bdc-4a8c-b23d-ab0eaf524b36 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:24.350795 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8899e272-7bdc-4a8c-b23d-ab0eaf524b36 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087972 Sep 14 09:28:24.351952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1589/2265] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:28:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:24.357342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:24.360274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:24.368849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.369360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.369862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:24.370608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.371045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.371468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:24.485153 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd8be29a-c7cd-44e6-8777-7326b4201fe6 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "PUT /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1085 microversion: 2.1 time: 0.131159 Sep 14 09:28:24.496744 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1590/2266] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:28:24 2022] PUT /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1085 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:24.496744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:24.496744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:24.502137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.502638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.503152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:24.504637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:24.505922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:24.506537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:25.032791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df286a953333434d8b163349ab1290a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48c2623b614e1f81780d51dc76b352', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:25.066797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2aab663c-c415-4bc9-b9d9-26e884f92819 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085" status: 200 len: 1512 microversion: 2.1 time: 0.567030 Sep 14 09:28:25.067613 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1591/2267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:24 2022] GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 => generated 1512 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:25.072899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:25.073561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:25.081297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:25.082041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:25.082556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:25.083242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:25.098128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:25.098648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:25.663188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:25.686609 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4b4d4c0-856a-4c1a-af85-13f52a72d6eb tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1469 microversion: 2.1 time: 0.617791 Sep 14 09:28:25.687221 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1592/2268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:25 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:25.693532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49cf4366-3418-4c70-bc73-d0fa398b726d tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e31f790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:25.763092 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49cf4366-3418-4c70-bc73-d0fa398b726d tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1034362119" status: 204 len: 0 microversion: 2.2 time: 0.072016 Sep 14 09:28:25.763963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1593/2269] 10.222.0.90 () {60 vars in 1321 bytes} [Wed Sep 14 09:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1034362119 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:25.782595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:25.786435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:25.803133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:25.804070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:25.804921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:25.806122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:25.807984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:25.813676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:25.881324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:26.143726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:26.172666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a828da2-1a14-4404-bcea-64055e90ef97 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1511 microversion: 2.1 time: 0.406547 Sep 14 09:28:26.175790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1594/2270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:25 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1511 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:26.197835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:26.200670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:26.213964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.215072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.216105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.218026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.219099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.220057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.558593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:26.573013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b7ebe07-0e67-4dce-bab3-6e66cde3529d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1381 microversion: 2.1 time: 0.397448 Sep 14 09:28:26.574917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1595/2271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:26 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1381 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:26.589959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8298e261-6ef8-4388-8c25-3ebffb7f5085", "name": "network-vif-deleted", "tag": "82f56d37-f14f-4c46-a72a-d5123c8e05a4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:26.617813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.622658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.623269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.663709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] Creating event network-vif-deleted:82f56d37-f14f-4c46-a72a-d5123c8e05a4 for instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 on n-h1-851028-12 Sep 14 09:28:26.696408 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-555bafd4-f463-4505-80ec-71c5ee96ad5a req-99db3861-7441-4fb8-8d8f-502483ac11d1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118450 Sep 14 09:28:26.712404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1596/2272] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:26.735808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a7a4d48-6b4a-4d6e-8c11-0b9d77831779 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e3b4dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:26.784307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a7a4d48-6b4a-4d6e-8c11-0b9d77831779 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-694690761" status: 204 len: 0 microversion: 2.2 time: 0.070466 Sep 14 09:28:26.785622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1597/2273] 10.222.0.90 () {60 vars in 1318 bytes} [Wed Sep 14 09:28:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-694690761 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:26.797387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:26.798126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 8298e261-6ef8-4388-8c25-3ebffb7f5085] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:26.826261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.826761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.827228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.827913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.828367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.828792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.869689 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] HTTP exception thrown: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Request method failure captured: Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 HTTP/1.1 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ6AffTaJ7mggnCb3PoonvUP90UZKwipbI_nyPktxnSO4Ya7ceI3iWL0AKBU1_EO7pVCJGJdHBz4DUbvaKcXgMHAN1keiJzxeNDXVvMvd4ZoyiGQx0PLsVWO5kpa9ev5-YDfP6E56AY0AFS2Vaa1lM3jvpzBSH0YNKaar70Qi0kV99w Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b48c2623b614e1f81780d51dc76b352 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b48c2623b614e1f81780d51dc76b352", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b48c2623b614e1f81780d51dc76b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b48c2623b614e1f81780d51dc76b352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b48c2623b614e1f81780d51dc76b352"}]}] Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b48c2623b614e1f81780d51dc76b352 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateTestJSON-1831536698-project Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: df286a953333434d8b163349ab1290a6 Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateTestJSON-1831536698-project Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8298e261-6ef8-4388-8c25-3ebffb7f5085'} Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:26.871440 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Returning 404 to user: Instance 8298e261-6ef8-4388-8c25-3ebffb7f5085 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:26.875304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-861db218-f7cc-4aca-9f62-c729793340f5 tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085" status: 404 len: 111 microversion: 2.1 time: 0.079438 Sep 14 09:28:26.876318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1598/2274] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:26 2022] GET /compute/v2.1/servers/8298e261-6ef8-4388-8c25-3ebffb7f5085 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:26.888330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:26.889396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:26.906659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.907208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.907672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:26.910775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:26.911365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:26.911801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:27.935380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:27.949248 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6f78927-bfb2-4d49-ac4b-e95e7ada1bda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1511 microversion: 2.1 time: 1.071347 Sep 14 09:28:28.006835 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1599/2275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:26 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1511 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:28.017617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42e27071-510a-44d5-b59a-575bc912d56a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '.version_select at 0x7f693e35a700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:28.026231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42e27071-510a-44d5-b59a-575bc912d56a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.027173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42e27071-510a-44d5-b59a-575bc912d56a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.028771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42e27071-510a-44d5-b59a-575bc912d56a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.055465 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42e27071-510a-44d5-b59a-575bc912d56a tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.044718 Sep 14 09:28:28.057031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1600/2276] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:28:28 2022] GET /compute/v2.1/os-migrations => generated 1568 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:28.063352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:28.064468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:28.078549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.083290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.083290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.084707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.086184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.086639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.173941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.187451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.189640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.192436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lazy-loading 'fault' on Instance uuid 7ba4d5ad-d65c-4243-b783-b6f307b22d1c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:28.284828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff8ac76bff9488bbd3718967820c39a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba112b4965542eea489647d01a6476f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:28.297253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d234c23-d7dc-4a9a-a76c-5ee7a7dd2380 tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 200 len: 1303 microversion: 2.1 time: 0.238441 Sep 14 09:28:28.297793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1601/2277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:28 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 1303 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:28.316710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2384f020-76a9-425c-8742-f321f3c2d4a3 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e308310>, body: {"keypair": {"name": "tempest-keypair-1434463652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWhyys6O+pCb0XRXucTQ9xJ5xT33cCDcVG9mHyQFxDfFXhW+9Y50f/0wEQyfkbv9eSTdGXPm2KshdG/PYI5au9Ue14Qk16hSxynH+URtpdZujtomuMEU2AfTlz+q4gNqQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:28.336097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2384f020-76a9-425c-8742-f321f3c2d4a3 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:28.341982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2384f020-76a9-425c-8742-f321f3c2d4a3 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:28.374718 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2384f020-76a9-425c-8742-f321f3c2d4a3 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.072852 Sep 14 09:28:28.376201 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1602/2278] 10.222.0.90 () {62 vars in 1199 bytes} [Wed Sep 14 09:28:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 77 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:28:28.383010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:28.383967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] [instance: 944ea143-d181-4781-83b5-96863212f8bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:28.404213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.409279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.413474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.414630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.415387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.416558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.463161 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] HTTP exception thrown: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Request method failure captured: Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb HTTP/1.1 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ6AffTaJ7mggnCb3PoonvUP90UZKwipbI_nyPktxnSO4Ya7ceI3iWL0AKBU1_EO7pVCJGJdHBz4DUbvaKcXgMHAN1keiJzxeNDXVvMvd4ZoyiGQx0PLsVWO5kpa9ev5-YDfP6E56AY0AFS2Vaa1lM3jvpzBSH0YNKaar70Qi0kV99w Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4b48c2623b614e1f81780d51dc76b352 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4b48c2623b614e1f81780d51dc76b352", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b48c2623b614e1f81780d51dc76b352"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4b48c2623b614e1f81780d51dc76b352"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4b48c2623b614e1f81780d51dc76b352"}]}] Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4b48c2623b614e1f81780d51dc76b352 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1831536698 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateTestJSON-1831536698-project Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: df286a953333434d8b163349ab1290a6 Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateTestJSON-1831536698-project Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '944ea143-d181-4781-83b5-96863212f8bb'} Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:28.465758 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. Sep 14 09:28:28.470637 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:28.471131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] Returning 404 to user: Instance 944ea143-d181-4781-83b5-96863212f8bb could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:28.472892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc192d4f-9ca1-47af-a2fd-f6bd10aadb0c tempest-MultipleCreateTestJSON-1831536698 tempest-MultipleCreateTestJSON-1831536698-project] 10.222.0.90 "GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb" status: 404 len: 111 microversion: 2.1 time: 0.094460 Sep 14 09:28:28.473970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1603/2279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:28 2022] GET /compute/v2.1/servers/944ea143-d181-4781-83b5-96863212f8bb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:28.481613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:28.482255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:28.493731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.494514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.498073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.499504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.500231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.501478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.540509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:28.687384 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-309e22b9-9794-4c85-9f1e-44b35d750227 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 204 len: 0 microversion: 2.1 time: 0.209048 Sep 14 09:28:28.693801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1604/2280] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:28 2022] DELETE /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:28.705715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:28.706665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:28.714544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.715195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.715742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:28.716612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:28.718244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:28.719304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.130711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6ce898d-f733-4f54-ab4a-91404847aa1c tempest-LiveMigrationTest-1086431468 tempest-LiveMigrationTest-1086431468-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1534 microversion: 2.1 time: 0.435675 Sep 14 09:28:29.131740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1605/2281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:28 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1534 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:29.151643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8211697-9622-4ca6-9979-3f2290746fdb tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e35af70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:29.190419 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8211697-9622-4ca6-9979-3f2290746fdb tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs/tempest-keypair-1434463652" status: 200 len: 513 microversion: 2.2 time: 0.056799 Sep 14 09:28:29.200237 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1606/2282] 10.222.0.90 () {60 vars in 1258 bytes} [Wed Sep 14 09:28:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1434463652 => generated 513 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:29.207502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:29.208799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:29.216907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:29.217751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:29.218685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.219849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:29.221206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:29.221875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.729184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:29.745782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f513b42c-cdc6-47e8-9417-77e52dd8241e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1517 microversion: 2.1 time: 0.543445 Sep 14 09:28:29.746816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1607/2283] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:29 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1517 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:29.761803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944ea143-d181-4781-83b5-96863212f8bb", "name": "network-vif-deleted", "tag": "e1be2a65-3410-463e-ad9e-2c711e13ecd4"}, {"server_uuid": "7ba4d5ad-d65c-4243-b783-b6f307b22d1c", "name": "network-vif-deleted", "tag": "cae40115-7df1-4ace-ae55-bf301671d36c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:29.782092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:29.782665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:29.783417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.822276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Creating event network-vif-deleted:e1be2a65-3410-463e-ad9e-2c711e13ecd4 for instance 944ea143-d181-4781-83b5-96863212f8bb on n-h1-851028-12 Sep 14 09:28:29.822794 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] Creating event network-vif-deleted:cae40115-7df1-4ace-ae55-bf301671d36c for instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c on n-h2-851028-12 Sep 14 09:28:29.835950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4a6661b4-2593-4f30-ac7a-eff5a189774d req-4194f3dc-9049-4786-9164-15125c987113 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087194 Sep 14 09:28:29.836521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1608/2284] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:29.843163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:29.843876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:29.852134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:29.852639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:29.853078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.853805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:29.854265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:29.854682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:29.901501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:30.022007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5631155c-68a6-41e5-b57a-7397bfe141da tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 204 len: 0 microversion: 2.1 time: 0.183646 Sep 14 09:28:30.023002 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1609/2285] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:29 2022] DELETE /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:30.029533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a16d24a3-f11b-4ce4-abb5-3c13f9d717d0 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e31f280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:30.035296 n-d-851028-12 devstack@n-api.service[122444]: WARNING oslo_db.sqlalchemy.utils [None req-a16d24a3-f11b-4ce4-abb5-3c13f9d717d0 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:28:30.051303 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a16d24a3-f11b-4ce4-abb5-3c13f9d717d0 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.018360 Sep 14 09:28:30.051303 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1610/2286] 10.222.0.90 () {60 vars in 1177 bytes} [Wed Sep 14 09:28:30 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:30.070309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:30.071087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] [instance: 7ba4d5ad-d65c-4243-b783-b6f307b22d1c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:30.092387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:30.092974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:30.093748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:30.095220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:30.096724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:30.097851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:30.115195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] HTTP exception thrown: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Request method failure captured: Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c HTTP/1.1 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4JBVmZVdAiBKqA9cnV8P3f-Itt8nZOnL_tZzQ728o-Jw0mPpT5I58_vdGKJgahh04GuxW_tqjhoioWz5lfKYUvonoJfBymHfkG2J7BN6JOXb1z8oiVSxsyo951Iv0OJiWw4THJMEkHzRNTbIzzwe7yb41oLn6Y9w2tU9jheQN1oHU Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6ba112b4965542eea489647d01a6476f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6ba112b4965542eea489647d01a6476f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6ba112b4965542eea489647d01a6476f"}]}] Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 6ba112b4965542eea489647d01a6476f Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAdminTestJSON-163200655 Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: fff8ac76bff9488bbd3718967820c39a Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAdminTestJSON-163200655-project Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7ba4d5ad-d65c-4243-b783-b6f307b22d1c'} Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:30.117236 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] Returning 404 to user: Instance 7ba4d5ad-d65c-4243-b783-b6f307b22d1c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81f247dd-17ca-4227-ac1b-7684c03e306c tempest-ServersAdminTestJSON-163200655 tempest-ServersAdminTestJSON-163200655-project] 10.222.0.90 "GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c" status: 404 len: 111 microversion: 2.1 time: 0.069341 Sep 14 09:28:30.123203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1611/2287] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:30 2022] GET /compute/v2.1/servers/7ba4d5ad-d65c-4243-b783-b6f307b22d1c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:30.125355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1526607869", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a04cbd6c-4f78-440b-8f5b-69cafd708616"}], "security_groups": [{"name": "tempest-securitygroup--1284114139"}], "key_name": "tempest-keypair-516161777", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:30.497628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] validate_networks() for [('a04cbd6c-4f78-440b-8f5b-69cafd708616', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:28:32.048773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:28:32.052705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:28:32.054163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:28:32.054914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:28:32.055577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:28:32.078166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:32.083234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:32.084115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:32.085397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:32.086119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:32.088654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:32.142356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:32.156566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Getting quotas for user 0f4798765d684da993cd6315ea8dbf9f and project c0b16a76f7234e4aa780e76c321aa8a3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:32.194259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:28:32.199243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:28:32.355388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d2b4379-a3b8-4995-97a4-2b05379a4665 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.235047 Sep 14 09:28:32.356081 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1612/2288] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:28:32.369587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:32.370497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:32.380274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:32.381277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:32.382082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:32.395726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:32.396616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:32.397233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:32.942520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:32.979784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-321768e8-13d0-4884-8282-0f0e7fad081a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1345 microversion: 2.1 time: 0.606141 Sep 14 09:28:32.983109 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1613/2289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:32 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1345 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:33.008560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95f209aa-1dbd-44cd-875f-ef21eed1bc88 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e331940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:33.045090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:33.089364 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95f209aa-1dbd-44cd-875f-ef21eed1bc88 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434463652" status: 204 len: 0 microversion: 2.2 time: 0.100750 Sep 14 09:28:33.098781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1614/2290] 10.222.0.90 () {60 vars in 1261 bytes} [Wed Sep 14 09:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434463652 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:33.114579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:33.116712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:33.142097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:33.144065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:33.145115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:33.150876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:33.151613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:33.154888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:33.432312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:33.435653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:33.444301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:33.445259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lazy-loading 'fault' on Instance uuid d67c3413-be58-4542-935e-625a9653c64c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:28:33.627333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:33.646808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a939445-ccb4-47dc-94d0-36bda8f7bfda tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 200 len: 1320 microversion: 2.1 time: 0.546420 Sep 14 09:28:33.675966 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1615/2291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:33 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 1320 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:33.696476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c249e9ac-b5ed-40fd-b23f-882d3b5094e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:33.697387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c249e9ac-b5ed-40fd-b23f-882d3b5094e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:34.156016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c249e9ac-b5ed-40fd-b23f-882d3b5094e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:34.173845 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c249e9ac-b5ed-40fd-b23f-882d3b5094e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1241 microversion: 2.1 time: 0.492993 Sep 14 09:28:34.174460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1616/2292] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:33 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1241 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:34.202722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6937c32d-b9f3-45c4-a000-428cbd5eeafb", "name": "network-vif-deleted", "tag": "41d1034c-a2c8-4ab4-be64-2eca390bf965"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:34.255578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:34.266370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:34.267135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:34.312150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] Creating event network-vif-deleted:41d1034c-a2c8-4ab4-be64-2eca390bf965 for instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb on n-h2-851028-12 Sep 14 09:28:34.337902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d3ddff52-f476-4d92-81a8-4466d982f252 req-ee09aa3b-fd95-43eb-975b-547dac23c516 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149962 Sep 14 09:28:34.341202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1617/2293] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:34.356692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c3413-be58-4542-935e-625a9653c64c", "name": "network-vif-deleted", "tag": "b281a8f0-a67a-4e1f-81f1-2e972c1e040d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:34.401686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:34.403728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:34.405584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:34.433867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] Creating event network-vif-deleted:b281a8f0-a67a-4e1f-81f1-2e972c1e040d for instance d67c3413-be58-4542-935e-625a9653c64c on n-h2-851028-12 Sep 14 09:28:34.448937 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-afef1949-59bd-467e-b4a3-2d03cffe1da6 req-25ee3ccf-b4a2-4745-8adb-abdce32ecba1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102687 Sep 14 09:28:34.453910 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1618/2294] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:34.466499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Action: 'create', calling method: .version_select at 0x7f693e3315e0>, body: {"keypair": {"name": "tempest-keypair-984796190", "type": "x509"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:34.522163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:34.535438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:34.609342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.processutils [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpa0alprx8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpa0alprx8/temp.key -subj /CN=5b7f38e24bbc45c1a8a75a421ab849a5 -extensions v3_req_client {{(pid=122444) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 14 09:28:35.360552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.processutils [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpa0alprx8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpa0alprx8/temp.key -subj /CN=5b7f38e24bbc45c1a8a75a421ab849a5 -extensions v3_req_client" returned: 0 in 0.750s {{(pid=122444) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 14 09:28:35.364754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.processutils [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpa0alprx8/temp.key -password pass: {{(pid=122444) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 14 09:28:35.456006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.processutils [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpa0alprx8/temp.key -password pass:" returned: 0 in 0.090s {{(pid=122444) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 14 09:28:35.607358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:35.625188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Getting quotas for user 5b7f38e24bbc45c1a8a75a421ab849a5 and project d220114fea634e94b8878e6f9ccd5e47. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:35.681398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-162b8d0d-65a7-4953-93ba-260e2389fa2f tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.225466 Sep 14 09:28:35.690429 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1619/2295] 10.222.0.90 () {62 vars in 1198 bytes} [Wed Sep 14 09:28:34 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1236 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:35.724422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:35.741319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:35.775439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:35.776497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:35.777393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:35.778450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:35.779728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:35.780438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:35.793378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:36.398855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:36.413712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd7fdcb3-6fc9-4123-a688-75e988c0f01a tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1184 microversion: 2.1 time: 0.718220 Sep 14 09:28:36.428696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1620/2296] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:35 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1184 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:36.445310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:36.446706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:36.476590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:36.482316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:36.483092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:36.486172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:36.486835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:36.493622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:36.535253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c HTTP/1.1 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd67c3413-be58-4542-935e-625a9653c64c'} Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:36.555096 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:28:36.562407 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:36.563789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:36.564890 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0ee2d08-b465-4e41-b91d-42cfbf9b8d1f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 404 len: 111 microversion: 2.1 time: 0.134256 Sep 14 09:28:36.572658 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1621/2297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:36 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:36.583788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:36.584702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:36.607734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:36.609483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:36.610554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:36.611508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:36.613895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:36.614506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:36.788265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:36.797356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-462e74f5-4668-417b-a9f2-dec38dda27e8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1299 microversion: 2.1 time: 0.223284 Sep 14 09:28:36.806307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1622/2298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:36 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:36.820953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdecde8c-cfca-4341-b158-5217a00fcc89 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e3319d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:36.851475 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdecde8c-cfca-4341-b158-5217a00fcc89 tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs/tempest-keypair-984796190" status: 200 len: 1533 microversion: 2.2 time: 0.042967 Sep 14 09:28:36.853439 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1623/2299] 10.222.0.90 () {60 vars in 1255 bytes} [Wed Sep 14 09:28:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-984796190 => generated 1533 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:37.255167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-653112484", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "68352bce-742a-4447-9ced-b226be801507"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:37.363748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] validate_networks() for [('68352bce-742a-4447-9ced-b226be801507', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:28:38.864333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:28:38.867979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:28:38.868584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:28:38.872487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:28:38.875292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:28:38.927861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:38.937251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:38.938669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:38.945864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:38.976849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:38.987011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:39.074179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Getting quotas for project 796c5dd63d0a40b6941adf6a13dab29d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:39.086828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Getting quotas for user 8b9297c7e49246baa6fb2a5c0ebe8b76 and project 796c5dd63d0a40b6941adf6a13dab29d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:39.155307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:28:39.157926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:28:39.314154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7657fc36-c00e-424f-ba01-435d413564d5 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.459636 Sep 14 09:28:39.327464 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1624/2300] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:28:39.348121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1690818654", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ca9473d1-8a75-4a0e-bfd5-b132e3685d3b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:39.463977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] validate_networks() for [('ca9473d1-8a75-4a0e-bfd5-b132e3685d3b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:28:41.742241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:28:41.743612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:28:41.743949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:28:41.744409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:28:41.746645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:28:41.765762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:41.766596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:41.767347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:41.769372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:41.770162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:41.770716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:41.794240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:28:41.799447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Getting quotas for user e023c82f88a348868ef9aa9003dc37fc and project c047ee69710043a38039f33fadec4a86. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:28:41.814152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:28:41.817498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:28:41.897275 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e15db6c-fc69-48d9-83bb-c0c4fb633b2b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.568177 Sep 14 09:28:41.898706 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1625/2301] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:28:41.905700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6fe1085-3ef7-4c69-aef9-8cba0ff98fda tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e331160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:41.913117 n-d-851028-12 devstack@n-api.service[122444]: WARNING oslo_db.sqlalchemy.utils [None req-c6fe1085-3ef7-4c69-aef9-8cba0ff98fda tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 14 09:28:41.920711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6fe1085-3ef7-4c69-aef9-8cba0ff98fda tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.020588 Sep 14 09:28:41.924418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1626/2302] 10.222.0.90 () {60 vars in 1177 bytes} [Wed Sep 14 09:28:41 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:41.934219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:41.935750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:41.977042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:41.980267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:41.982745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:41.983729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:41.984467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:41.986287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:42.105847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:42.122189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40cb6083-339c-4cca-9aba-64852efa4f1c tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 200 len: 1184 microversion: 2.1 time: 0.194775 Sep 14 09:28:42.123305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1627/2303] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:41 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 1184 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:42.140556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:42.141466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:42.163466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:42.164036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:42.164434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:42.165156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:42.165612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:42.166040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.009712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:43.027660 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41bc3d66-a72c-4489-ac36-fca918f3d8f2 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1367 microversion: 2.1 time: 0.899946 Sep 14 09:28:43.027660 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1628/2304] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:42 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1367 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:43.048672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:43.060525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:43.076580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.083929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.085151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.087757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.091446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.094568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.420838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:43.436785 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ec5483e3-36a5-49a5-89f1-25cb1ab77de4 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1285 microversion: 2.1 time: 0.405311 Sep 14 09:28:43.437811 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1629/2305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:43 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1285 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:43.452825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:43.456635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:43.484064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.484573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.485017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.485748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.486208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.486635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.734436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:43.751025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-faaaf45b-d710-4030-bd17-bf93bc4cdf12 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1261 microversion: 2.1 time: 0.310601 Sep 14 09:28:43.752051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1630/2306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:43 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:43.762464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5196aef1-d1ba-4384-9252-dc761321fccc tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] Calling method '.version_select at 0x7f693e331820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:43.807403 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5196aef1-d1ba-4384-9252-dc761321fccc tempest-KeyPairsV22TestJSON-298882833 tempest-KeyPairsV22TestJSON-298882833-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984796190" status: 204 len: 0 microversion: 2.2 time: 0.050706 Sep 14 09:28:43.808011 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1631/2307] 10.222.0.90 () {60 vars in 1258 bytes} [Wed Sep 14 09:28:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984796190 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:43.823661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:43.827305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 6937c32d-b9f3-45c4-a000-428cbd5eeafb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:43.883298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.888636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.891282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.895826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:43.897676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:43.898371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:43.929307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] HTTP exception thrown: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Request method failure captured: Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb HTTP/1.1 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ1ExajHjjmYa4y5B_-cL5ahYlnxkoh9h--s7iqdR1BXDfs-1xmlTBmVc2f_GHisJ97Tgj66yt19Mek0Vu7H9FhQU42Ltxr6ruSxs8p-Bi3LQBF9RCS_0ZCd1ZNdi5gZhTzeuLYxu8-rs45h1iSZoXlGMpTlTcjSDZBMMTLI9ZJKZWs Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a70cfdb4e44723b3900decc2ec03a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a70cfdb4e44723b3900decc2ec03a3"}]}] Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationTest-1699522038 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationTest-1699522038-project Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: acf0e1a651e34682923f8eb74872adb1 Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationTest-1699522038-project Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6937c32d-b9f3-45c4-a000-428cbd5eeafb'} Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:43.934802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. Sep 14 09:28:43.947374 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:43.955586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Returning 404 to user: Instance 6937c32d-b9f3-45c4-a000-428cbd5eeafb could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:43.957361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22dfca2d-a2c0-40ac-9619-a2effd420f81 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb" status: 404 len: 111 microversion: 2.1 time: 0.147169 Sep 14 09:28:43.959969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1632/2308] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:43 2022] GET /compute/v2.1/servers/6937c32d-b9f3-45c4-a000-428cbd5eeafb => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:43.975138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5d5bfd-da1f-46a8-a9d4-1663aedea595", "tag": "fec64cdc-70ad-4eff-b13e-c72974466fc9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:44.005608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:44.007241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:44.008618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:44.038695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] Creating event network-changed:fec64cdc-70ad-4eff-b13e-c72974466fc9 for instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 on n-h1-851028-12 Sep 14 09:28:44.052290 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cc148540-aedd-4181-bd32-a2eb63df45a0 req-ef4cdebd-eea1-46c4-b287-bdaba66316c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090820 Sep 14 09:28:44.053807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1633/2309] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:44.880271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d3ebd53-c99f-4b52-a5ad-bf96933aa28f tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-704566882", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:44.885019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2d3ebd53-c99f-4b52-a5ad-bf96933aa28f tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] HTTP exception thrown: min_count must be <= max_count Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d3ebd53-c99f-4b52-a5ad-bf96933aa28f tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Request method failure captured: Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 183 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7KgDmyFo8IZu6mESwOdic6GVCACGnNvaMNjAC92KOGqdOfdYKc3j8LzFoEKifusYy0FyNzDbo5zBRPDvbg7oJDqRtmxrKOWhG92bkyGdbyW1LBSn_Dv1SKY68XTK72z33YIzO1hovq6-c3lqvAjz9lAuND_NGBxelqAO6cZObkw_g Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_66535affc4e4432f90209e3489b5327b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/66535affc4e4432f90209e3489b5327b"}]}] Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b90a956ac14f4c3e997e8c086f1f9488 Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-704566882", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: exception: min_count must be <= max_count Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-704566882', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 14 09:28:44.887211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:44.896081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d3ebd53-c99f-4b52-a5ad-bf96933aa28f tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Returning 400 to user: min_count must be <= max_count {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:44.898746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d3ebd53-c99f-4b52-a5ad-bf96933aa28f tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.839974 Sep 14 09:28:44.901120 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1634/2310] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 844 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:28:44.907831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:44.909901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:44.922789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:44.939538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:44.946322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:44.952067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:44.955027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:44.957677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:45.583129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:45.596456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75190f55-01ad-4642-ac13-c95938c14e0e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1367 microversion: 2.1 time: 0.693610 Sep 14 09:28:45.607940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1635/2311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:44 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1367 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:45.615374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:45.616289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:45.630067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:45.630864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:45.633699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:45.634677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:45.635314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:45.639978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:46.181895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:46.196766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7a98c75-9756-4006-ab4d-fb24cedc08db tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.598303 Sep 14 09:28:46.197659 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1636/2312] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:45 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:46.212157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:46.213055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:46.215354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:46.230425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:46.231419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:46.241503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:46.243012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:46.243936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:46.244770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:46.797485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:46.822209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ab42907-3e6b-41de-b3e4-ee55233b3263 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1267 microversion: 2.1 time: 0.622874 Sep 14 09:28:46.825948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1637/2313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:46 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1267 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:46.855609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e121ec8d-080d-4dbe-b727-8b71812d86ce tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1202433681", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "max_count": 0}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e121ec8d-080d-4dbe-b727-8b71812d86ce tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Request method failure captured: Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 168 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7KgDmyFo8IZu6mESwOdic6GVCACGnNvaMNjAC92KOGqdOfdYKc3j8LzFoEKifusYy0FyNzDbo5zBRPDvbg7oJDqRtmxrKOWhG92bkyGdbyW1LBSn_Dv1SKY68XTK72z33YIzO1hovq6-c3lqvAjz9lAuND_NGBxelqAO6cZObkw_g Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_66535affc4e4432f90209e3489b5327b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/66535affc4e4432f90209e3489b5327b"}]}] Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b90a956ac14f4c3e997e8c086f1f9488 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1202433681", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "max_count": 0}} Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1202433681', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'max_count': 0}}} Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 0 Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:28:46.884822 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:46.889412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:46.891739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e121ec8d-080d-4dbe-b727-8b71812d86ce tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:46.896594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e121ec8d-080d-4dbe-b727-8b71812d86ce tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.069505 Sep 14 09:28:46.897824 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1638/2314] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:46 2022] POST /compute/v2.1/servers => generated 130 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:28:46.919710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:46.921233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:46.937627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:46.940752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:46.943687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:46.944831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:46.945496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:46.950900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:50.185667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:50.204454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d3c316a-885b-4b92-bd36-ab303b1da7e3 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1367 microversion: 2.1 time: 3.305279 Sep 14 09:28:50.227183 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1639/2315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:46 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1367 bytes in 3328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:50.256759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:50.257945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:50.286608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.296732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.297359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:50.309160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:50.309951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:50.311018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:51.782396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:51.809943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=35 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:52.429802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:52.449683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4002a03b-0112-464b-ba7c-e0bd6db83848 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 2.220991 Sep 14 09:28:52.464200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1640/2316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:50 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:52.498967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f29e4672-db24-4136-983b-77aaffb259c6 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1482672792", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "max_count": 2.5}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f29e4672-db24-4136-983b-77aaffb259c6 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Request method failure captured: Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 170 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7KgDmyFo8IZu6mESwOdic6GVCACGnNvaMNjAC92KOGqdOfdYKc3j8LzFoEKifusYy0FyNzDbo5zBRPDvbg7oJDqRtmxrKOWhG92bkyGdbyW1LBSn_Dv1SKY68XTK72z33YIzO1hovq6-c3lqvAjz9lAuND_NGBxelqAO6cZObkw_g Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_66535affc4e4432f90209e3489b5327b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/66535affc4e4432f90209e3489b5327b"}]}] Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b90a956ac14f4c3e997e8c086f1f9488 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1482672792", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "max_count": 2.5}} Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1482672792', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'max_count': 2.5}}} Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 2.5 Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:28:52.523845 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:52.530897 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:52.537610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f29e4672-db24-4136-983b-77aaffb259c6 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:52.538894 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f29e4672-db24-4136-983b-77aaffb259c6 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.071405 Sep 14 09:28:52.540782 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1641/2317] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:52 2022] POST /compute/v2.1/servers => generated 139 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:28:52.573406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:52.575955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:52.632020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:52.632777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:52.633358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:52.646540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:52.648414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:52.652813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:54.525575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:54.539538 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-580e520c-b338-4e12-94f3-09b352f2841f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 1.997348 Sep 14 09:28:54.545801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1642/2318] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:52 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:54.593322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:54.593964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:54.624488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:54.625235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:54.627817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:54.633564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:54.634424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:54.635062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:55.483711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:55.518821 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8b699673-e050-46c2-8f7e-b5c55a7db871 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1367 microversion: 2.1 time: 0.965715 Sep 14 09:28:55.520040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1643/2319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:54 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1367 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:55.539595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb9126b-5103-42c8-87ed-ac865625bb87 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1386300275", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 0}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb9126b-5103-42c8-87ed-ac865625bb87 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Request method failure captured: Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 168 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7KgDmyFo8IZu6mESwOdic6GVCACGnNvaMNjAC92KOGqdOfdYKc3j8LzFoEKifusYy0FyNzDbo5zBRPDvbg7oJDqRtmxrKOWhG92bkyGdbyW1LBSn_Dv1SKY68XTK72z33YIzO1hovq6-c3lqvAjz9lAuND_NGBxelqAO6cZObkw_g Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_66535affc4e4432f90209e3489b5327b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/66535affc4e4432f90209e3489b5327b"}]}] Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b90a956ac14f4c3e997e8c086f1f9488 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1386300275", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 0}} Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1386300275', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'min_count': 0}}} Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 0 Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:28:55.551284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb9126b-5103-42c8-87ed-ac865625bb87 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:55.561381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-beb9126b-5103-42c8-87ed-ac865625bb87 tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034884 Sep 14 09:28:55.577602 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1644/2320] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:55 2022] POST /compute/v2.1/servers => generated 130 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:28:55.590661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece90b06-0ca7-45a7-8a41-2bed70eee33b", "tag": "624ca065-c011-4b4e-bb5b-32d743373bac"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:55.633822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:55.634358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:55.635971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:55.703043 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] Creating event network-changed:624ca065-c011-4b4e-bb5b-32d743373bac for instance ece90b06-0ca7-45a7-8a41-2bed70eee33b on n-h2-851028-12 Sep 14 09:28:55.744857 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-86665d2c-b747-4aa6-a56f-5ad6a9cf0349 req-f3ad9296-6f0c-4333-9a76-2767c8d5aa09 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165504 Sep 14 09:28:55.752125 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1645/2321] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:55.785048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:55.790879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:55.836191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:55.837715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:55.842357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:55.850829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:55.852045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:55.852814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.291101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:56.309028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0bd35ee3-7610-4504-999a-43be0ee0d6ff tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.551737 Sep 14 09:28:56.309667 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1646/2322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:55 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:56.334759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5d5bfd-da1f-46a8-a9d4-1663aedea595", "name": "network-vif-plugged", "status": "completed", "tag": "fec64cdc-70ad-4eff-b13e-c72974466fc9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:56.368299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.368817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.369203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.395076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] Creating event network-vif-plugged:fec64cdc-70ad-4eff-b13e-c72974466fc9 for instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 on n-h1-851028-12 Sep 14 09:28:56.410916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-98c603c9-d432-4a13-a003-42466fc3c0a0 req-182231fe-3afe-4193-8763-a435de2d1a4f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099537 Sep 14 09:28:56.411566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1647/2323] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:28:56.428114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:56.428869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:56.440785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.441318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.441765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.442493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:56.448225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:56.448866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:56.506273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:28:56.530946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:28:56.679824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47e3e1da-45dc-4492-9823-279ec0f9652f tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 204 len: 0 microversion: 2.1 time: 0.262411 Sep 14 09:28:56.682476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1648/2324] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:28:56 2022] DELETE /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:28:56.916270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] Calling method '.version_select at 0x7f693e35d670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:56.968944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 could not be found", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:28:56.969670 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] HTTP exception thrown: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] Request method failure captured: Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-floating-ips/b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 HTTP/1.1 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7WeZRU-EAYrnLfnIAR2mpE0liAO1PuT-Jm6rIGfjDyxJxrxXmyb3FPpOuT9lL88BqosgUA_6p3g-sZ-XC4vLBVSNzKK4dRKHwxNIbgZsb21MkA4qoIkfAfZkiO9DiPqOMMLCjy9powPpqYLbGjkGvbgRLaquSFFhvllCS8q2Ab2Ro Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c2d8a6cb354f6eb10627f6f4268808 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1401462881 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c2d8a6cb354f6eb10627f6f4268808", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c2d8a6cb354f6eb10627f6f4268808"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c2d8a6cb354f6eb10627f6f4268808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c2d8a6cb354f6eb10627f6f4268808"}]}] Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1401462881 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c2d8a6cb354f6eb10627f6f4268808 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1401462881 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 76c7e12ea9cb4de1a1060d8e2c09c845 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: exception: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b99f8a35-8678-4ca0-be17-c19bc1c6b1d1'} Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:28:56.974837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 could not be found Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1d176022-38c3-49ad-b951-5603d2fedf85'] Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1. Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] Returning 404 to user: Floating IP not found for ID b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-293fb7bc-1b68-4a02-a3a9-c6e4269a062c tempest-FloatingIPDetailsNegativeTestJSON-1401462881 tempest-FloatingIPDetailsNegativeTestJSON-1401462881-project] 10.222.0.90 "GET /compute/v2.1/os-floating-ips/b99f8a35-8678-4ca0-be17-c19bc1c6b1d1" status: 404 len: 111 microversion: 2.1 time: 0.293024 Sep 14 09:28:56.984671 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1649/2325] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:28:56 2022] GET /compute/v2.1/os-floating-ips/b99f8a35-8678-4ca0-be17-c19bc1c6b1d1 => generated 111 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:28:57.013072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:57.021606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:57.036072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:57.036587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:57.037270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:57.038569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:57.039043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:57.039486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:57.747317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:57.798865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21703b74-b9fd-4ce9-91a1-71a144c6c8a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 0.819060 Sep 14 09:28:57.838383 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1650/2326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:56 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:57.848515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-465d53bd-2f86-4544-b4c8-0dc2f18bd0ab tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1189635357", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 2.5}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-465d53bd-2f86-4544-b4c8-0dc2f18bd0ab tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Request method failure captured: Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 170 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7KgDmyFo8IZu6mESwOdic6GVCACGnNvaMNjAC92KOGqdOfdYKc3j8LzFoEKifusYy0FyNzDbo5zBRPDvbg7oJDqRtmxrKOWhG92bkyGdbyW1LBSn_Dv1SKY68XTK72z33YIzO1hovq6-c3lqvAjz9lAuND_NGBxelqAO6cZObkw_g Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_66535affc4e4432f90209e3489b5327b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/66535affc4e4432f90209e3489b5327b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/66535affc4e4432f90209e3489b5327b"}]}] Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 66535affc4e4432f90209e3489b5327b Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1961141437 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b90a956ac14f4c3e997e8c086f1f9488 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1961141437-project Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1189635357", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 2.5}} Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1189635357', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'min_count': 2.5}}} Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 2.5 Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:28:57.855466 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 14 09:28:57.867360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:28:57.879971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-465d53bd-2f86-4544-b4c8-0dc2f18bd0ab tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:28:57.887216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-465d53bd-2f86-4544-b4c8-0dc2f18bd0ab tempest-MultipleCreateNegativeTestJSON-1961141437 tempest-MultipleCreateNegativeTestJSON-1961141437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041659 Sep 14 09:28:57.893284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1651/2327] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:28:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:28:57.910358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:57.911954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:57.927375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:57.930001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:57.931109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:57.932989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:57.935070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:57.936198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:59.547608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:28:59.565417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2164101-889d-4abb-9b5c-8cd7709f0283 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1367 microversion: 2.1 time: 1.669399 Sep 14 09:28:59.565941 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1652/2328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:57 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1367 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:28:59.574234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:28:59.574941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:28:59.587635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:59.588176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:59.588616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:59.589334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:28:59.589789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:28:59.597701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:28:59.989336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:00.004105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de127eef-e311-4e61-94ed-1866c81017ed tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1665 microversion: 2.1 time: 0.436741 Sep 14 09:29:00.006711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1653/2329] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:28:59 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1665 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:00.018177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:00.022796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:00.048036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:00.052398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:00.056376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:00.059836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:00.061468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:00.063922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:00.464866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:00.479173 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81c77053-b7b3-4cb3-bd7d-119371fa141f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.471117 Sep 14 09:29:00.506642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1654/2330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:00 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:00.512684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090dffcf-1e3e-4edb-9146-1cfba01bc1c9", "tag": "3a1fb631-0b5f-4912-9af8-75db4a4896eb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:00.542364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:00.543019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:00.544766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:00.575278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] Creating event network-changed:3a1fb631-0b5f-4912-9af8-75db4a4896eb for instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 on n-h1-851028-12 Sep 14 09:29:00.594105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-57164dff-81a1-4ce3-b4fd-a0677c0818d8 req-db8a8e58-830b-4e37-967f-cdadc7dccdf0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085809 Sep 14 09:29:00.595159 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1655/2331] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:00.610145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:00.613792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:00.630409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:00.632948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:00.639028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:00.640313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:00.641010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:00.645729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:01.107349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:01.120200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d59ca07d-9958-4c63-ab96-067e06f8f1a1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 0.521515 Sep 14 09:29:01.122141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1656/2332] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:00 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:01.132078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:01.134985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:01.148504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:01.156182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:01.157035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:01.157966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:01.159260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:01.159947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:01.556560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:01.565222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cb864862-6f94-4d1f-8e96-86934375603a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1557 microversion: 2.1 time: 0.436405 Sep 14 09:29:01.573967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1657/2333] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:01 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1557 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:01.579825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:01.586231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:01.600749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:01.604757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:01.605433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:01.608013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:01.608494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:01.608937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:01.980755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:01.994017 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ebc5c2e-b902-4582-9126-9c99ad415b40 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 200 len: 1598 microversion: 2.1 time: 0.418747 Sep 14 09:29:01.997679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1658/2334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:01 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 1598 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:02.024997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:02.042621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:02.069173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:02.072916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:02.081376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:02.082499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:02.083156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:02.083919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:02.837273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:02.876216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c673d42-631b-40a2-8562-3ed5dff9b4cb tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.876556 Sep 14 09:29:02.891933 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1659/2335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:01 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:02.901458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:02.901984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:02.911804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:02.912464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:02.912917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:02.917002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:02.917509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:02.917958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:03.494520 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48b59b76-d716-4b68-ba01-bd30c2c592d8 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.613002 Sep 14 09:29:03.498792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1660/2336] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:29:02 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-interface => generated 284 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:03.532706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:03.541244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:03.560857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:03.561362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:03.561801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:03.562525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:03.571434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:03.572164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:05.291327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:05.306447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c7ee445-cad3-4c4d-b5e1-c1fad23eac46 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 1.804177 Sep 14 09:29:05.311162 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1661/2337] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:03 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:05.324968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17c776d0-62a5-40bf-ab8c-1b76c058b9a7", "name": "network-vif-deleted", "tag": "ffe9435d-b618-4ab8-9d84-4eb2345db57b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:05.378111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:05.378981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:05.381355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:05.444459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] Creating event network-vif-deleted:ffe9435d-b618-4ab8-9d84-4eb2345db57b for instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 on n-h2-851028-12 Sep 14 09:29:05.453724 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e03b0ffb-39d9-45c8-a5a3-1003966a82a5 req-185008a3-8ef7-40a2-baa4-ea69585e641e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135509 Sep 14 09:29:05.454964 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1662/2338] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:05.488977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:05.490758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: 17c776d0-62a5-40bf-ab8c-1b76c058b9a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:05.507860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:05.510020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:05.532714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:05.534150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:05.535001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:05.535869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:05.556363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] HTTP exception thrown: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Request method failure captured: Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 HTTP/1.1 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ1ExajHjjmYa4y5B_-cL5ahYlnxkoh9h--s7iqdR1BXDfs-1xmlTBmVc2f_GHisJ97Tgj66yt19Mek0Vu7H9FhQU42Ltxr6ruSxs8p-Bi3LQBF9RCS_0ZCd1ZNdi5gZhTzeuLYxu8-rs45h1iSZoXlGMpTlTcjSDZBMMTLI9ZJKZWs Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a70cfdb4e44723b3900decc2ec03a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a70cfdb4e44723b3900decc2ec03a3"}]}] Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: acf0e1a651e34682923f8eb74872adb1 Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '17c776d0-62a5-40bf-ab8c-1b76c058b9a7'} Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:05.558591 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. Sep 14 09:29:05.563471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:05.565986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Returning 404 to user: Instance 17c776d0-62a5-40bf-ab8c-1b76c058b9a7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:05.567264 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-119c1ddd-865d-4ea2-9c33-108c200c7732 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7" status: 404 len: 111 microversion: 2.1 time: 0.100421 Sep 14 09:29:05.568128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1663/2339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:05 2022] GET /compute/v2.1/servers/17c776d0-62a5-40bf-ab8c-1b76c058b9a7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:05.577650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:05.579425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:05.587425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:05.588458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:05.589428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:05.591024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:05.591975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:05.592745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:06.249438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:06.266378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88814a3e-ca25-4bbb-8252-39537dd3c0a7 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.696931 Sep 14 09:29:06.276757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1664/2340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:05 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:06.575029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5566376a-6835-4b8f-8797-3c622471e8d3 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693e473a60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2041031779", "description": "tempest-description-1245091273"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:07.394581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5566376a-6835-4b8f-8797-3c622471e8d3 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.115036 Sep 14 09:29:07.395790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1665/2341] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:07.420841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a21bdef1-1a32-4f2d-92ed-016a48fb4309 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '.version_select at 0x7f693e473280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:07.487940 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a21bdef1-1a32-4f2d-92ed-016a48fb4309 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000038869" status: 202 len: 0 microversion: 2.1 time: 0.090229 Sep 14 09:29:07.489901 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1666/2342] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:29:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000038869 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:07.504463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:07.510546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:07.529414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:07.529934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:07.530454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:07.531204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:07.531746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:07.532226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:08.133696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:08.155469 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3eed7801-0846-4050-8c21-459d7caee7b3 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 0.659389 Sep 14 09:29:08.156378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1667/2343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:07 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:08.181521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece90b06-0ca7-45a7-8a41-2bed70eee33b", "name": "network-vif-plugged", "status": "completed", "tag": "624ca065-c011-4b4e-bb5b-32d743373bac"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:08.203370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:08.203858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:08.204318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:08.245202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] Creating event network-vif-plugged:624ca065-c011-4b4e-bb5b-32d743373bac for instance ece90b06-0ca7-45a7-8a41-2bed70eee33b on n-h2-851028-12 Sep 14 09:29:08.256742 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e21b1e09-54d5-49f7-ba71-21b5d3c51867 req-33e60e13-5753-4c07-a15b-b1a19fdc2fc6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098345 Sep 14 09:29:08.258010 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1668/2344] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:08.272576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:08.278681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:08.291921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:08.292694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:08.296291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:08.297662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:08.298414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:08.300800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:09.078999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:09.091554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4984fc82-ab6d-41f5-966a-8c50d84f7220 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1327 microversion: 2.1 time: 0.828760 Sep 14 09:29:09.130427 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1669/2345] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:08 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1327 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:09.150255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce9311c5-6d96-42bb-ada3-ff0db3a108b6 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693efa0af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-522549139", "description": "tempest-description-2109847701"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:09.442936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce9311c5-6d96-42bb-ada3-ff0db3a108b6 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.310941 Sep 14 09:29:09.443759 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1670/2346] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:09 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:09.474486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5d5bfd-da1f-46a8-a9d4-1663aedea595", "tag": "fec64cdc-70ad-4eff-b13e-c72974466fc9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:09.505294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:09.505948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:09.507629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:09.542522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] Creating event network-changed:fec64cdc-70ad-4eff-b13e-c72974466fc9 for instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 on n-h1-851028-12 Sep 14 09:29:09.559234 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e8409d6b-6e1d-42bc-9fe1-1f72921396df req-6d53dd33-0eab-479b-9787-0a97765cb00a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107620 Sep 14 09:29:09.559234 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1671/2347] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:09.577582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:09.578605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:09.586363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:09.587089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:09.589310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:09.590248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:09.591389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:09.592065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:09.598218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:10.150740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:10.180461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a759b37a-9444-4467-a73a-a7bf47aa4ad9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 0.606657 Sep 14 09:29:10.181099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1672/2348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:09 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:10.186331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:10.187023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:10.204404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:10.205760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:10.206662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:10.208769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:10.209454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:10.210636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:10.255292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:10.507773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f38fc6ec-91de-46dd-a6aa-c22429d1629d tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 204 len: 0 microversion: 2.1 time: 0.325148 Sep 14 09:29:10.508717 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1673/2349] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:10 2022] DELETE /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:10.516584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2124896960", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "42f746b5-21d1-4833-aebe-cf0f7efc6b91"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:10.677919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] validate_networks() for [('42f746b5-21d1-4833-aebe-cf0f7efc6b91', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:12.036777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:12.038163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:12.038882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:12.039555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:12.040254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:12.055267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.056360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.057455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.058994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.060162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.061125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.132288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Getting quotas for project c4741b9fcd214ebab758c2effdf6b09a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:12.155063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Getting quotas for user 5820e680ab554514ace9c0619d913a47 and project c4741b9fcd214ebab758c2effdf6b09a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:12.194333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:12.198220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:12.287409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-755fd77a-ff31-4bbd-8a2b-1791279d53e2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776891 Sep 14 09:29:12.288546 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1674/2350] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:29:12.294440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:12.295603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:12.303983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.305211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.306200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.308433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.309582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.310772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.619791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:12.654916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94915d2d-941b-4df1-a6a4-96a7cb88ada9 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1526 microversion: 2.1 time: 0.361937 Sep 14 09:29:12.655743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1675/2351] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:12 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:12.669534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090dffcf-1e3e-4edb-9146-1cfba01bc1c9", "name": "network-vif-plugged", "status": "completed", "tag": "3a1fb631-0b5f-4912-9af8-75db4a4896eb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:12.697838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.699284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.701462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.761269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] Creating event network-vif-plugged:3a1fb631-0b5f-4912-9af8-75db4a4896eb for instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 on n-h1-851028-12 Sep 14 09:29:12.767120 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:29:12.767831 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:29:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:29:12.788837 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b7abb606-5659-4907-b99c-b448b5d105f0 req-9b7e25d4-64fb-4c95-976b-7de7313ad0a1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131076 Sep 14 09:29:12.809259 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1676/2352] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:12.827036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:12.828341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:12.857461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.858369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.859393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.860875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.862198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.863219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:12.988761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:12.989451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:12.990240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.004815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lazy-loading 'fault' on Instance uuid f49a8a67-e1eb-4c51-a859-6c2708bdaf7b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:29:13.034774 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:29:13.035811 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:29:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:29:13.142164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:13.184441 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-865c97ed-8b35-4dda-a14f-87886305ec88 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 200 len: 1301 microversion: 2.1 time: 0.371383 Sep 14 09:29:13.192588 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1677/2353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:12 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 1301 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:13.200708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:13.201764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:13.210202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.211443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.212119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.213195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.213804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.214387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.602247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:13.617449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e294243-1b33-4b10-ab80-b62cce7c735f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1309 microversion: 2.1 time: 0.423036 Sep 14 09:29:13.618299 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1678/2354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:13 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1309 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:13.629438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:13.630329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:13.632618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:13.641824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.643423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.644569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.646055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.646777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.647477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.762692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:13.776032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc7f6b93-2c7e-4bff-abfd-14b1574b9b97 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1220 microversion: 2.1 time: 0.155899 Sep 14 09:29:13.776892 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1679/2355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:13 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:13.782878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f49a8a67-e1eb-4c51-a859-6c2708bdaf7b", "name": "network-vif-deleted", "tag": "4732d1fe-9f69-44d5-a8ec-54ae09320d5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:13.795756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.796633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.797235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.811164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] Creating event network-vif-deleted:4732d1fe-9f69-44d5-a8ec-54ae09320d5e for instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b on n-h2-851028-12 Sep 14 09:29:13.820281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f8389a94-b9ee-40ed-a846-6cf744e81134 req-c6c8af2d-9396-41c2-8176-2912b069a238 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041798 Sep 14 09:29:13.821660 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1680/2356] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:13.831027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:13.833505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:13.847680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.848517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.849256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:13.851060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:13.851758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:13.852519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.302833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:14.346273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ecce22e-4811-4a0a-a30f-17ddd9a62a4e tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1526 microversion: 2.1 time: 0.522556 Sep 14 09:29:14.346924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1681/2357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:13 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1526 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:14.364232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:14.364857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: f49a8a67-e1eb-4c51-a859-6c2708bdaf7b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:14.384317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.388094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.388814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.394105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.395382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.396502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.430748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] HTTP exception thrown: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Request method failure captured: Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b HTTP/1.1 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ1ExajHjjmYa4y5B_-cL5ahYlnxkoh9h--s7iqdR1BXDfs-1xmlTBmVc2f_GHisJ97Tgj66yt19Mek0Vu7H9FhQU42Ltxr6ruSxs8p-Bi3LQBF9RCS_0ZCd1ZNdi5gZhTzeuLYxu8-rs45h1iSZoXlGMpTlTcjSDZBMMTLI9ZJKZWs Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a70cfdb4e44723b3900decc2ec03a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a70cfdb4e44723b3900decc2ec03a3"}]}] Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: acf0e1a651e34682923f8eb74872adb1 Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f49a8a67-e1eb-4c51-a859-6c2708bdaf7b'} Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:14.432732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Returning 404 to user: Instance f49a8a67-e1eb-4c51-a859-6c2708bdaf7b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cb92e9a2-ab6f-4bf4-9fd2-7a01ba721467 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b" status: 404 len: 111 microversion: 2.1 time: 0.085464 Sep 14 09:29:14.438920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1682/2358] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:14 2022] GET /compute/v2.1/servers/f49a8a67-e1eb-4c51-a859-6c2708bdaf7b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:14.774915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:14.776686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:14.790246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.791439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.792240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.803234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.805392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.806178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.837065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] HTTP exception thrown: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Request method failure captured: Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b HTTP/1.1 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7Eh7wEf7KRPe0uzyPIib40s_JIdtDaLCIl1aDyslGeMU32ZpWkzJdly5MGL7lw8RPHdYXOippE3BPOWcO2A6AKFAMOfgNrGDhUYw2vsM3Pn1I0pLtk0QZUW52WaH3UwzV5wKHP6Pp4ZWymB3wlGoZTi9pbsKudZo0ptJc_WYl9Kv4 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 54ea5e47d90a4bb29e45f808fdd2b4e8 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_54ea5e47d90a4bb29e45f808fdd2b4e8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}] Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 54ea5e47d90a4bb29e45f808fdd2b4e8 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestMultiTenantJSON-676330988-project Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 44216d112d734596b39f449734a06745 Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988-project Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ece90b06-0ca7-45a7-8a41-2bed70eee33b'} Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:14.840131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Returning 404 to user: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:14.844954 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e237171b-caca-4717-bbd4-978faf7c0793 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 404 len: 111 microversion: 2.1 time: 0.407152 Sep 14 09:29:14.851486 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1683/2359] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:14 2022] DELETE /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 111 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:14.857688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:14.858564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:14.867802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.868873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.869555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.870825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:14.871680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:14.872591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:14.913424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:15.062123 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-103b204c-0cd7-4888-ba3c-8dd339c0c581 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 204 len: 0 microversion: 2.1 time: 0.207149 Sep 14 09:29:15.067999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1684/2360] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:14 2022] DELETE /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:15.078458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:15.080187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:15.090651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.092029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.093143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.094972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.096539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.097270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.321814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:15.353581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-515d00d2-4218-41a5-bb41-2c2fe0726f80 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1489 microversion: 2.1 time: 0.279671 Sep 14 09:29:15.360149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1685/2361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:15 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1489 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:15.368374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:15.369531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:15.388646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.389710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.390835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.392667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.398248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.399528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.570015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:15.585108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-421db88b-45c9-4352-a69c-4ba457d60d08 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1274 microversion: 2.1 time: 0.222340 Sep 14 09:29:15.602616 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1686/2362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:15 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:15.620250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:15.621122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:15.634272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.634902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.635439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:15.636381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:15.636944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:15.637611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:16.146823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:16.177605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30699905-5880-4c4f-b56b-37f3cb01598f tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1526 microversion: 2.1 time: 0.569691 Sep 14 09:29:16.185179 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1687/2363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:15 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1526 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:16.196015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:16.197243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:16.235573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:16.237299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:16.237299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:16.237910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:16.238383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:16.238814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:16.274366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:16.779328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acf0e1a651e34682923f8eb74872adb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a70cfdb4e44723b3900decc2ec03a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:16.788344 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-358d7e72-e326-4189-ae75-b70740efe4ee tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 200 len: 1499 microversion: 2.1 time: 0.600497 Sep 14 09:29:16.788965 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1688/2364] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:16 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 1499 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:16.806169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-987812931"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:16.816786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:16.833599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:16.834164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:16.834718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:16.835779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:16.836391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:16.836970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.066151 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca425192-def5-408d-bfd2-754c27bacf07 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "PUT /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1073 microversion: 2.1 time: 0.271826 Sep 14 09:29:17.071366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1689/2365] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:29:16 2022] PUT /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1073 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:17.090609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Action: 'update', calling method: >, body: {"server": {"name": "ece90b06-0ca7-45a7-8a41-2bed70eee33b_new"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:17.096808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:17.109498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.111803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.113418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.114946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.116904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.118248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.155192 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] HTTP exception thrown: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Request method failure captured: Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b HTTP/1.1 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 64 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7Eh7wEf7KRPe0uzyPIib40s_JIdtDaLCIl1aDyslGeMU32ZpWkzJdly5MGL7lw8RPHdYXOippE3BPOWcO2A6AKFAMOfgNrGDhUYw2vsM3Pn1I0pLtk0QZUW52WaH3UwzV5wKHP6Pp4ZWymB3wlGoZTi9pbsKudZo0ptJc_WYl9Kv4 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 54ea5e47d90a4bb29e45f808fdd2b4e8 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_54ea5e47d90a4bb29e45f808fdd2b4e8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/54ea5e47d90a4bb29e45f808fdd2b4e8"}]}] Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 54ea5e47d90a4bb29e45f808fdd2b4e8 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestMultiTenantJSON-676330988-project Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 44216d112d734596b39f449734a06745 Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-676330988-project Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "ece90b06-0ca7-45a7-8a41-2bed70eee33b_new"}} Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ece90b06-0ca7-45a7-8a41-2bed70eee33b', 'body': {'server': {'name': 'ece90b06-0ca7-45a7-8a41-2bed70eee33b_new'}}} Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:29:17.174431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] Returning 404 to user: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:17.178470 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a7cb1c7-32e5-4c39-a967-2e06b4cb08c2 tempest-ServersNegativeTestMultiTenantJSON-676330988 tempest-ServersNegativeTestMultiTenantJSON-676330988-project] 10.222.0.90 "PUT /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 404 len: 111 microversion: 2.1 time: 0.092381 Sep 14 09:29:17.184236 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1690/2366] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:29:17 2022] PUT /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:17.204265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:17.207135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:17.233570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.234855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.235820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.237616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.238837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.240759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.843376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:17.855094 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2dd9cb0-ee84-42d4-b75c-957730208f3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 0.667635 Sep 14 09:29:17.856219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1691/2367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:17 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:17.862295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9", "name": "network-vif-deleted", "tag": "224a52f7-20e7-4342-be9f-f5cfa2c2f723"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:17.879621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.881734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.882454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.901381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] Creating event network-vif-deleted:224a52f7-20e7-4342-be9f-f5cfa2c2f723 for instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 on n-h2-851028-12 Sep 14 09:29:17.918606 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f2a81a0e-182b-4f7b-8144-24833932b9a1 req-f7574bf6-5b81-407f-8976-f627927b85b0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060731 Sep 14 09:29:17.929736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1692/2368] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:17.953533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:17.955423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:17.969954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.973906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.975466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:17.977186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:17.979445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:17.980232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.574804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:18.594588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2044e459-f775-4d07-b321-8bf3eb413ecc tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1499 microversion: 2.1 time: 0.662651 Sep 14 09:29:18.598602 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1693/2369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:17 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1499 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:18.607591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:18.608308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:18.649344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.650250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.651101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.652313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.652937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.656501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.705146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:18.864744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5542eeee-5022-4724-a84b-d8a4dba55e9b tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 204 len: 0 microversion: 2.1 time: 0.264134 Sep 14 09:29:18.870360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1694/2370] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:18 2022] DELETE /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:18.877041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:18.882687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] [instance: e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:18.925824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.926731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.927395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.928496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:18.929214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:18.929978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:18.964935 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] HTTP exception thrown: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Request method failure captured: Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 HTTP/1.1 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ1ExajHjjmYa4y5B_-cL5ahYlnxkoh9h--s7iqdR1BXDfs-1xmlTBmVc2f_GHisJ97Tgj66yt19Mek0Vu7H9FhQU42Ltxr6ruSxs8p-Bi3LQBF9RCS_0ZCd1ZNdi5gZhTzeuLYxu8-rs45h1iSZoXlGMpTlTcjSDZBMMTLI9ZJKZWs Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a70cfdb4e44723b3900decc2ec03a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a70cfdb4e44723b3900decc2ec03a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a70cfdb4e44723b3900decc2ec03a3"}]}] Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a70cfdb4e44723b3900decc2ec03a3 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-LiveMigrationTest-1699522038 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: acf0e1a651e34682923f8eb74872adb1 Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-LiveMigrationTest-1699522038-project Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9'} Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:18.969168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. Sep 14 09:29:18.979743 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:18.986983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] Returning 404 to user: Instance e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:18.988278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d24bdd8d-fa34-40cb-9b8b-6fbd5293f275 tempest-LiveMigrationTest-1699522038 tempest-LiveMigrationTest-1699522038-project] 10.222.0.90 "GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9" status: 404 len: 111 microversion: 2.1 time: 0.121205 Sep 14 09:29:18.989940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1695/2371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:18 2022] GET /compute/v2.1/servers/e975af9f-e997-4b7c-9b5e-b2bbd1d3bcb9 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:18.998430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:18.999401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:19.011563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.012527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.013205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:19.015443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.016319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.017654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:19.371127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:19.384683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c99de020-7f7c-4ebf-ae6c-ae68e17d7e3b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1499 microversion: 2.1 time: 0.393355 Sep 14 09:29:19.388593 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1696/2372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:18 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1499 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:19.396072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:19.400445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:19.420756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.421409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.423084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:19.426626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:19.427275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:19.427844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.195779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:20.213362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df2350f1-946c-4da9-9a75-e4eb5e9b4df2 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1532 microversion: 2.1 time: 0.823297 Sep 14 09:29:20.217556 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1697/2373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:19 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1532 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:20.232440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:20.234242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:20.246792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.247810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.248977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.250054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.250759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.252944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.680685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:20.693829 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7b772c6-41cc-47f1-bb3a-2f7c45f54313 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 0.472364 Sep 14 09:29:20.694449 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1698/2374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:20 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:20.714974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b4e507-56b5-4a31-855d-ff62a361bd92", "tag": "ca8c130a-5b65-49f3-816d-9a0992114c0a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:20.739835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.740642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.741250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.766156 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] Creating event network-changed:ca8c130a-5b65-49f3-816d-9a0992114c0a for instance d2b4e507-56b5-4a31-855d-ff62a361bd92 on n-h2-851028-12 Sep 14 09:29:20.773860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f489b8a3-b4d2-4a71-9841-21d37b499513 req-7d751423-bbd1-4103-82e8-ac28c99b3b6b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078059 Sep 14 09:29:20.776404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1699/2375] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:20.784259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:20.800103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:20.800864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:20.801752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:20.839479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:29:20.917779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-046c2ed9-2ea3-47b7-a22c-f4e24ebccb7a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "POST /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9/action" status: 202 len: 0 microversion: 2.1 time: 0.139453 Sep 14 09:29:20.919304 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1700/2376] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:20 2022] POST /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:21.064646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-408754806", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "a1ad1ac6-b26a-4d66-9a4f-1cd11dc290a9"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:21.197184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] validate_networks() for [('a1ad1ac6-b26a-4d66-9a4f-1cd11dc290a9', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:22.073880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:22.186019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:22.886393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:22.887385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:22.887385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:22.888010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:22.888539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:22.917490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:22.922160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:22.923029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:22.924679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:22.926512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:22.929375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:22.977450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Getting quotas for project 9aa0ab418f8a47ad8234ea3cb1f60daf. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:22.986464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Getting quotas for user b3abcaaf96da4efc816ba0b72df2680e and project 9aa0ab418f8a47ad8234ea3cb1f60daf. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:23.030362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:23.034284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:23.157653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f5ffe52-d7eb-4211-917c-5aae9f45a9fa tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235935 Sep 14 09:29:23.167353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1701/2377] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:29:23.183305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:23.184251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:23.202349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.202789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.205321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:23.206411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.206901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.207371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:23.768901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:23.783234 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d28a061-94e7-412f-b0c1-33f990de09ed tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1509 microversion: 2.1 time: 0.612814 Sep 14 09:29:23.796409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1702/2378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:23 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1509 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:23.825868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:23.827018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:23.904597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.911066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.912408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:23.913952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:23.916722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:23.927673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:24.044060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:24.044060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:24.051723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:24.052561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lazy-loading 'fault' on Instance uuid ece90b06-0ca7-45a7-8a41-2bed70eee33b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:29:24.120732 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:29:24.121418 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:29:24.241967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9297c7e49246baa6fb2a5c0ebe8b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796c5dd63d0a40b6941adf6a13dab29d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:24.255605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be70793f-2582-48ac-8b9c-836532e64dba tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 200 len: 1317 microversion: 2.1 time: 0.454732 Sep 14 09:29:24.256285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1703/2379] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:23 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:24.287824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:24.288529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:24.307449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:24.310021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:24.310892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:24.313398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:24.314791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:24.317605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:25.432403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:25.438438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:25.454664 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18f86be0-26fd-4a15-b50c-3ea39c10bbdb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 1.197088 Sep 14 09:29:25.458957 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1704/2380] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:24 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:25.507939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece90b06-0ca7-45a7-8a41-2bed70eee33b", "name": "network-vif-deleted", "tag": "624ca065-c011-4b4e-bb5b-32d743373bac"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:25.535763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:25.540775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:25.544445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:25.574883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] Creating event network-vif-deleted:624ca065-c011-4b4e-bb5b-32d743373bac for instance ece90b06-0ca7-45a7-8a41-2bed70eee33b on n-h2-851028-12 Sep 14 09:29:25.589616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-601f497e-5675-4a66-a80b-cd2184f15a66 req-23e41a5d-5878-4485-91cb-b19fb2b8c0cc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125999 Sep 14 09:29:25.591462 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1705/2381] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:25.603806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:25.608704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:25.625132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:25.625748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:25.635360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:25.637067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:25.638190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:25.647180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:25.829076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:25.845172 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67c80aad-56c3-4856-b8c5-2145fd414b3f tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1276 microversion: 2.1 time: 0.251013 Sep 14 09:29:25.847637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1706/2382] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:25 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1276 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:25.878309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:25.880266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:25.904003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:25.909099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:25.909646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:25.914508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:25.915015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:25.919932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:26.301996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:26.312720 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3993a8b-a92e-40fd-b070-6a8d87cf8cfe tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1509 microversion: 2.1 time: 0.463514 Sep 14 09:29:26.328347 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1707/2383] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:25 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1509 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:26.337529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:26.338556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] [instance: ece90b06-0ca7-45a7-8a41-2bed70eee33b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:26.347871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:26.348768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:26.350264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:26.351339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:26.355445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:26.356272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:26.384157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] HTTP exception thrown: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Request method failure captured: Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b HTTP/1.1 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ63zwb2YSaBBz928Zs6rthIRFxeMztUyTFTPoIGV2DmnUutp7Xr7R0v2phch_UUVLqeDjlnX1_JaCGw9C_g7Y92HfI7Jf_wXziy17lMsMLosHiVIGordQGoGZRxxmDZ0Jdtd07QPwV-A-TtTB2k1TVdWugdeuR21PPAj5FYasMmDnQ Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 796c5dd63d0a40b6941adf6a13dab29d Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1763446637 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_796c5dd63d0a40b6941adf6a13dab29d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/796c5dd63d0a40b6941adf6a13dab29d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/796c5dd63d0a40b6941adf6a13dab29d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/796c5dd63d0a40b6941adf6a13dab29d"}]}] Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1763446637 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 796c5dd63d0a40b6941adf6a13dab29d Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1763446637 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1763446637-project Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 8b9297c7e49246baa6fb2a5c0ebe8b76 Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1763446637-project Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ece90b06-0ca7-45a7-8a41-2bed70eee33b'} Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:26.386821 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. Sep 14 09:29:26.395243 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:26.398011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] Returning 404 to user: Instance ece90b06-0ca7-45a7-8a41-2bed70eee33b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:26.399571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2805a9ac-34bc-4707-9a27-07892754bb13 tempest-ServersNegativeTestMultiTenantJSON-1763446637 tempest-ServersNegativeTestMultiTenantJSON-1763446637-project] 10.222.0.90 "GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b" status: 404 len: 111 microversion: 2.1 time: 0.069044 Sep 14 09:29:26.401162 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1708/2384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:26 2022] GET /compute/v2.1/servers/ece90b06-0ca7-45a7-8a41-2bed70eee33b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:26.487784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:26.488861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:26.497351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:26.497940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:26.498519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:26.500208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:26.502338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:26.503332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:27.401312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:27.439632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83257297-dae4-4351-a80c-c95c113783e0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 0.956993 Sep 14 09:29:27.445564 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1709/2385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:26 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:29:27.450989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:27.451691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:27.460734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:27.461665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:27.462452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:27.463978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:27.464806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:27.466002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:27.607948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:27.629091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4765402e-9c24-4de3-aa3c-503781d3fbd5 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1282 microversion: 2.1 time: 0.182043 Sep 14 09:29:27.630599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1710/2386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:27 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:27.638206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:27.639118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:27.656718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:27.658156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:27.659144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:27.660392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:27.661026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:27.661621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:28.378533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:28.403279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc35ca52-e41d-4fb0-9a97-11d49a76355a tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1509 microversion: 2.1 time: 0.770736 Sep 14 09:29:28.417546 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1711/2387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:27 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1509 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:28.573525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1981541187", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "58087536-265f-45db-8384-06754201e344"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:28.746684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] validate_networks() for [('58087536-265f-45db-8384-06754201e344', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:30.009808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:30.010462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:30.010740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:30.011169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:30.011601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:30.036225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:30.036721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:30.037165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:30.037903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:30.038362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:30.038805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:30.060628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:30.069101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:30.070585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for user 4145151290094e15916c574647542ce3 and project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:30.108256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:30.111363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:30.187588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf07fa33-ebee-4c4a-b404-5325e5f06c0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767739 Sep 14 09:29:30.188528 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1712/2388] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:29:30.193784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:30.194705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:30.206089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:30.207754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:30.215830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:30.217766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:30.219480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:30.221288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:30.846606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:30.865633 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8147ae7f-a888-479d-ba3c-5c51c1503480 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 0.675696 Sep 14 09:29:30.870447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1713/2389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:30 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:30.885888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b4e507-56b5-4a31-855d-ff62a361bd92", "name": "network-vif-plugged", "status": "completed", "tag": "ca8c130a-5b65-49f3-816d-9a0992114c0a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:30.940981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:30.945136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:30.945942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:30.982144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] Creating event network-vif-plugged:ca8c130a-5b65-49f3-816d-9a0992114c0a for instance d2b4e507-56b5-4a31-855d-ff62a361bd92 on n-h2-851028-12 Sep 14 09:29:31.002730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-290281ce-b3f3-432e-b12d-5a5035408010 req-21bb941a-4054-4812-ad8e-82feb9de5a91 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130733 Sep 14 09:29:31.006147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1714/2390] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:31.027520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:31.042146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:31.089513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.092948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.095825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:31.097326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.100382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.103878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:31.595412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:31.613104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1361147b-03b3-4834-9a17-b271b49f42cf tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1324 microversion: 2.1 time: 0.600379 Sep 14 09:29:31.618130 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1715/2391] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:31 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:31.633045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:31.635922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:31.653627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.657678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.658341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:31.661103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:31.661674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:31.662186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:32.134658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:32.147532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-192a4e6b-760c-4a31-962b-629ed1cb9c99 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1509 microversion: 2.1 time: 0.527627 Sep 14 09:29:32.160752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1716/2392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:31 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:32.169698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:32.170845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:32.182406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:32.182917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:32.183410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:32.184769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:32.185238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:32.185732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:32.281577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:32.304169 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30a18e6a-3df6-47c9-b9c8-d73535163722 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1260 microversion: 2.1 time: 0.142090 Sep 14 09:29:32.307686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1717/2393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:32 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1260 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:32.319470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e26f470-75ef-425c-8bda-ac19defec10e", "tag": "e3a91d5d-ab66-4df2-a18c-f58edfd1511e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:32.347275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:32.348187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:32.348806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:32.381331 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] Creating event network-changed:e3a91d5d-ab66-4df2-a18c-f58edfd1511e for instance 0e26f470-75ef-425c-8bda-ac19defec10e on n-h2-851028-12 Sep 14 09:29:32.397705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-69543250-eb4e-4c35-8ea9-a49dc1421d9e req-ae0cfdcc-bc97-4511-be9c-ddc82d2835ce service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086343 Sep 14 09:29:32.400616 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1718/2394] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:32.418929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:32.420867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:32.437052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:32.438049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:32.438847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:32.442792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:32.443606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:32.444487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.185942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:33.199368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d94b5cdc-6afa-4906-9397-b9621976cef1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1316 microversion: 2.1 time: 0.793191 Sep 14 09:29:33.201150 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1719/2395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:32 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:33.221480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:33.222526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:33.238003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.239132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.243786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.246283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.246777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.248000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.752740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:33.774714 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96107d09-5f40-4645-8600-ccb3ebeca8f4 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1324 microversion: 2.1 time: 0.571879 Sep 14 09:29:33.775386 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1720/2396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:33 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:33.797478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:33.803280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:33.821591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.824003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.826373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:33.827825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:33.830536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:33.831684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:34.889114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:34.918815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd4445e8-1932-45f1-90ef-5f84c1cf6e93 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1509 microversion: 2.1 time: 1.130566 Sep 14 09:29:34.936746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1721/2397] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:33 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1509 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:34.949306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:34.951558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:34.962640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:34.963624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:34.964555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:34.965765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:34.966638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:34.968842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.572253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:35.603401 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a6b5cfb-2062-4914-a832-9af3e9f1a807 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1308 microversion: 2.1 time: 0.661994 Sep 14 09:29:35.604972 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1722/2398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:34 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:35.626624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:35.632089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:35.656448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.657900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.658638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.659673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.660543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.664827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.740493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8eda2a7a-ed50-4a88-9032-9007e0ecdac9 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/ips" status: 200 len: 150 microversion: 2.1 time: 0.127923 Sep 14 09:29:35.742139 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1723/2399] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:29:35 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/ips => generated 150 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:35.756614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:35.757630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:35.784759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.785633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.786936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:35.788625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:35.789573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:35.794882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:36.225731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:36.281797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11761b56-006b-4187-b37d-0ef8259e063e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1504 microversion: 2.1 time: 0.536522 Sep 14 09:29:36.283839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1724/2400] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:35 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:36.294799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:36.295803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:36.305120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:36.305934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:36.306542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:36.308742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:36.309380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:36.310278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:36.321261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:36.706774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:36.733813 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bf8bb6fd-0684-471f-b1b8-a7f45fdd2153 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1324 microversion: 2.1 time: 0.448319 Sep 14 09:29:36.735026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1725/2401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:36 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:36.750924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:36.755518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:36.776316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:36.778875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:36.779709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:36.781237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:36.784463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:36.785135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:37.247259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:37.259223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d072f53-bb98-434e-829d-d0f56f7a8e35 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1486 microversion: 2.1 time: 0.522120 Sep 14 09:29:37.264541 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1726/2402] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:36 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1486 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:37.276749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2041031779"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:37.277762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:37.293648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:37.294962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:37.298176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:37.299453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:37.301834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:37.303145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:37.827457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.network.security_group_api [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Adding security group 089528d4-e258-450c-b804-01a743160d70 to port ca8c130a-5b65-49f3-816d-9a0992114c0a Sep 14 09:29:39.348833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b16ba991-edbe-440f-84b9-ea607a597b2e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/action" status: 202 len: 0 microversion: 2.1 time: 2.082716 Sep 14 09:29:39.357607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1727/2403] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:37 2022] POST /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/action => generated 0 bytes in 2092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:39.369455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:39.372870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:39.382157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.382957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.383635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:39.384583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.385337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.386226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:39.703662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:39.724920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cc26640-9251-4296-ac3a-8d5da0528470 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1308 microversion: 2.1 time: 0.357304 Sep 14 09:29:39.738528 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1728/2404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:39 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:39.746771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-996900170"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:39.752752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:39.780818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.781308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.786938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:39.787850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:39.788590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:39.789832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.010307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dca58d37-a6ad-4fa4-aa85-35ac3b5fcfa9 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "PUT /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1059 microversion: 2.1 time: 0.265564 Sep 14 09:29:40.012476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1729/2405] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:29:39 2022] PUT /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1059 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:40.026165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b3da54-6896-4d24-af27-264326077136", "tag": "2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:40.044466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.044968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.045718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.053397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:40.072147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] Creating event network-changed:2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941 for instance 98b3da54-6896-4d24-af27-264326077136 on n-h1-851028-12 Sep 14 09:29:40.082363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3de0f6aa-886b-4b61-a943-d7f992526c25 req-21a243b3-1920-4767-96bc-c0a800049120 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067714 Sep 14 09:29:40.083959 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1730/2406] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:40.108549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:40.108549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:40.128142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:40.132441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.133858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.134677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.139271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.141881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.143465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.571557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:40.582040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33b824a2-02a0-48a1-a659-3594fdbee732 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1324 microversion: 2.1 time: 0.496412 Sep 14 09:29:40.603733 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1731/2407] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:40 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:40.610027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce97781d-381b-44f3-9d04-2691064f869b"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:40.613473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:40.620877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.621848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.622448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:40.623695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:40.624355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:40.624973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:41.031279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df5f6552-0afe-47b8-8ad1-8b30a26a0251 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "POST /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.425814 Sep 14 09:29:41.033350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1732/2408] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:29:40 2022] POST /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:41.072417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-522549139"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:41.075038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:41.083508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:41.084409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:41.085131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:41.086221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:41.088078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:41.088740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:41.416554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.network.security_group_api [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Adding security group 4ed2a85e-5a22-4a16-bcce-ae98b3f2d33f to port ca8c130a-5b65-49f3-816d-9a0992114c0a Sep 14 09:29:42.226193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0279e2e6-d00b-49b4-a552-b5abff4c6eed tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/action" status: 202 len: 0 microversion: 2.1 time: 1.190896 Sep 14 09:29:42.227154 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1733/2409] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:41 2022] POST /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/action => generated 0 bytes in 1192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:42.234090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:42.235602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:42.260163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.265028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.266947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.269759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.271306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.273020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.609066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:42.620712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fdd64067-df6e-4b52-af85-adb0f0a8238c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1486 microversion: 2.1 time: 0.392293 Sep 14 09:29:42.634321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1734/2410] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:42 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1486 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:42.662228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e26f470-75ef-425c-8bda-ac19defec10e", "name": "network-vif-plugged", "status": "completed", "tag": "e3a91d5d-ab66-4df2-a18c-f58edfd1511e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:42.676349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.676833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.677617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.701357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] Creating event network-vif-plugged:e3a91d5d-ab66-4df2-a18c-f58edfd1511e for instance 0e26f470-75ef-425c-8bda-ac19defec10e on n-h2-851028-12 Sep 14 09:29:42.709366 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4f0bfc90-c3e5-414a-b55a-55b6397ce4af req-9d6dcfa2-be12-47f8-8c79-31e93240289e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052114 Sep 14 09:29:42.712465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1735/2411] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:42.752462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:42.753705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:42.783960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.784959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.786407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:42.788909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:42.790292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:42.791048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.223205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:43.246829 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a783351-89b4-4a11-8d04-93432db063ac tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1308 microversion: 2.1 time: 0.530774 Sep 14 09:29:43.256120 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1736/2412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:42 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:43.256120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:43.256120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:43.270542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.271474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.272243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.273235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.273962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.275110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.941088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:43.952556 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5fa011f0-1d9f-412b-907e-5a4ba06ffa7e tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1324 microversion: 2.1 time: 0.703492 Sep 14 09:29:43.953869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1737/2413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:43 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:43.968662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:43.969510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:43.981095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.981833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.982433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:43.984470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:43.991222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:43.991775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.217373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-727d56fd-f2da-4e4f-a7c2-debb79aeb623 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.262084 Sep 14 09:29:44.218355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1738/2414] 10.222.0.90 () {58 vars in 1293 bytes} [Wed Sep 14 09:29:43 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92/os-security-groups => generated 1158 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:44.238414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b4e507-56b5-4a31-855d-ff62a361bd92", "tag": "ca8c130a-5b65-49f3-816d-9a0992114c0a"}, {"name": "network-changed", "server_uuid": "d2b4e507-56b5-4a31-855d-ff62a361bd92", "tag": "ca8c130a-5b65-49f3-816d-9a0992114c0a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:44.249810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.251714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.251994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.267098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Creating event network-changed:ca8c130a-5b65-49f3-816d-9a0992114c0a for instance d2b4e507-56b5-4a31-855d-ff62a361bd92 on n-h2-851028-12 Sep 14 09:29:44.267876 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] Creating event network-changed:ca8c130a-5b65-49f3-816d-9a0992114c0a for instance d2b4e507-56b5-4a31-855d-ff62a361bd92 on n-h2-851028-12 Sep 14 09:29:44.273383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d8dd9a0b-4d6a-4d78-9bba-c903233822f6 req-6ed5ff77-da72-4519-8ddb-f2e441b2ada4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039753 Sep 14 09:29:44.274379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1739/2415] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:44.282759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:44.283772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:44.301492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.303829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.304634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.305558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:44.306238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:44.307820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:44.538628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:44.564859 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4af36a9b-1d97-487c-bd0c-0dde58e63d5e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1486 microversion: 2.1 time: 0.272916 Sep 14 09:29:44.564859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1740/2416] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:44 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1486 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:44.757687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-528665708", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:44.833446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:29:45.246654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:29:45.247355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:29:45.248021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:29:45.248440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:29:45.248856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:29:45.261165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:45.263192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:45.263641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:45.264680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:45.265145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:45.265580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:45.288139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:29:45.293849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:29:45.316426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:29:45.321062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:29:45.406181 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-448ea8ac-6edf-4c48-984a-56342ac69fe5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854865 Sep 14 09:29:45.412461 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1741/2417] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:29:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:29:45.423545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6742b6f-3819-4dee-8bf8-cb41c17a8d4c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693f7b8790>, body: {"security_group": {"name": " tempest-securitygroup -457980917 ", "description": "tempest-description-618034849"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:45.994165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6742b6f-3819-4dee-8bf8-cb41c17a8d4c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.580222 Sep 14 09:29:45.994710 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1742/2418] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:45 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:46.022046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:46.022838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:46.033408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.034090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.035379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.036291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.036907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.037523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.559578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:46.590178 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5fc61e45-94ed-47dc-8a02-0517e8ddfd35 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1308 microversion: 2.1 time: 0.581836 Sep 14 09:29:46.590705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1743/2419] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:45 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:46.613250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:46.613972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:46.620672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.621184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.621628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.622366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.623771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.624627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.655946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:46.682351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:46.858698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d64456b0-2400-4deb-876a-bc9436699e32 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 204 len: 0 microversion: 2.1 time: 0.263286 Sep 14 09:29:46.859489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1744/2420] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:46 2022] DELETE /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:46.870032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:46.870737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:46.878887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.879412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.879846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:46.880656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:46.881152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:46.881582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.074681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:47.086104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-896d9cda-b6d6-4e04-8c1b-30496ab48148 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1520 microversion: 2.1 time: 0.220461 Sep 14 09:29:47.086706 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1745/2421] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:46 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:47.093280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:47.096517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:47.103637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.104484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.106082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.107282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.107999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.108651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.196613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:47.206376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8c9ecf8-cfef-4fa8-a90a-1dd284ed1e05 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1264 microversion: 2.1 time: 0.118300 Sep 14 09:29:47.207081 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1746/2422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:47 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1264 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:47.227860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-413a8aba-60db-4033-840e-e2a1c262c1c8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fce05e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:47.294763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-413a8aba-60db-4033-840e-e2a1c262c1c8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d" status: 200 len: 222 microversion: 2.1 time: 0.073449 Sep 14 09:29:47.295369 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1747/2423] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:47 2022] GET /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d => generated 222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:47.305802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b3da54-6896-4d24-af27-264326077136", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:47.318064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.318664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.319192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.333832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] Creating event network-vif-plugged:2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941 for instance 98b3da54-6896-4d24-af27-264326077136 on n-h1-851028-12 Sep 14 09:29:47.339981 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-21f9c5d1-b601-4229-b9d0-b471c8c1e8f7 req-39e03e48-7452-416b-9a47-483f07786675 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043359 Sep 14 09:29:47.340792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1748/2424] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:47.356939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:47.358177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:47.366485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.367850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.368352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.369078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.369536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.369970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.668262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:47.682538 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01d9311a-721b-4bf2-a81c-40b912303ec4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1492 microversion: 2.1 time: 0.331481 Sep 14 09:29:47.683207 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1749/2425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:47 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1492 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:47.688887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:47.689919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:47.696525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:47.698737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.699503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.700040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.702075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:47.704370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:47.705130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:47.746766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] HTTP exception thrown: Instance is not a member of specified network Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Request method failure captured: Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e/ips/invalid HTTP/1.1 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7vJm_whY6bV4JXwOaYDtu9jErFHScYlK3Bram-tMlDF2JlAv2HpusKLovwE_dA6yo7QyyqgjsdXpAFK7FwMk_T32BOVqzOhCUYGdARAO5aejNQvbYAiZC1q1s6HYNqiwdb3WQSOeNeRca_LWXDqZSUTp63bprwNfFc8JKozDEELTc Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aa0ab418f8a47ad8234ea3cb1f60daf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}] Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b3abcaaf96da4efc816ba0b72df2680e Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance is not a member of specified network Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '0e26f470-75ef-425c-8bda-ac19defec10e', 'id': 'invalid'} Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 14 09:29:47.746983 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:47.751889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:47.751889 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15037d60-3d13-47a6-8334-0bd7f80258f2 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.063829 Sep 14 09:29:47.751889 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1750/2426] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:29:47 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e/ips/invalid => generated 91 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:29:47.758835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c29f727-1827-4c7b-94d0-6c07dad9f204 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e317af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:48.258669 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c29f727-1827-4c7b-94d0-6c07dad9f204 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d" status: 202 len: 0 microversion: 2.1 time: 0.508407 Sep 14 09:29:48.260581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1751/2427] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:29:47 2022] DELETE /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:48.268953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:48.269919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:48.278614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:48.279125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:48.279846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:48.281477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:48.282736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:48.283646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:48.824531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:48.835961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aaaf2b91-2b16-4d68-bdb7-160ab6074735 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1308 microversion: 2.1 time: 0.573785 Sep 14 09:29:48.847933 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1752/2428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:48 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1308 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:49.033833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e7f14a5-885b-4867-9f55-3fa06885d768 tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] Calling method '.version_select at 0x7f693e473c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.109433 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e7f14a5-885b-4867-9f55-3fa06885d768 tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271591 Sep 14 09:29:49.110821 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1753/2429] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:48 2022] GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb/defaults => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:49.124553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.125077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Failed to fetch instance by id 999 {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:29:49.126239 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] HTTP exception thrown: Instance 999 could not be found. Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Request method failure captured: Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7vJm_whY6bV4JXwOaYDtu9jErFHScYlK3Bram-tMlDF2JlAv2HpusKLovwE_dA6yo7QyyqgjsdXpAFK7FwMk_T32BOVqzOhCUYGdARAO5aejNQvbYAiZC1q1s6HYNqiwdb3WQSOeNeRca_LWXDqZSUTp63bprwNfFc8JKozDEELTc Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aa0ab418f8a47ad8234ea3cb1f60daf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}] Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b3abcaaf96da4efc816ba0b72df2680e Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 999 could not be found. Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '999'} Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 14 09:29:49.129378 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.135771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:49.135771 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ac91ee9-108a-4cff-9e2c-46c784b22051 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013299 Sep 14 09:29:49.138947 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1754/2430] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:29:49.145302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.146249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:49.154464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.154966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.155406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.156188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.156689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.157286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.332404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:49.346098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41f56292-c4ea-4d1f-a09c-b9fa37aaad8c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1270 microversion: 2.1 time: 0.205651 Sep 14 09:29:49.346901 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1755/2431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:49.352020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fe01f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.392687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:29:49.393343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:29:49.393897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.393897 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d HTTP/1.1 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '32a6fe5c-5f32-4581-bec1-3f87f1e69f0d'} Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:29:49.395784 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-4be1ee72-c9fb-4aba-b688-307cbec569ac'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5396f67-b71b-49b4-ac2a-111a9f12bd95 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d" status: 404 len: 194 microversion: 2.1 time: 0.049702 Sep 14 09:29:49.399952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1756/2432] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:49.408172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.409262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:49.420714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.421219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.421844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.423167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.423628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.424363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.537390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:49.549906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1c5b6b8-b191-4390-95f5-5d9bb612fc7c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 200 len: 1450 microversion: 2.1 time: 0.150265 Sep 14 09:29:49.550610 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1757/2433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:49.579017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bd58d89-0e54-41c1-ab74-9a46ac811041 tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] Calling method '.version_select at 0x7f693fe019d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.694460 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bd58d89-0e54-41c1-ab74-9a46ac811041 tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb" status: 200 len: 371 microversion: 2.1 time: 0.127941 Sep 14 09:29:49.695501 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1758/2434] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:29:49 2022] GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:49.702590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:49.704214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:49.715435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.716632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.717342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.718400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.719103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.720313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.762729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:29:49.873242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a8f54906-e8a6-4927-8113-68421dcf2902 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 204 len: 0 microversion: 2.1 time: 0.176248 Sep 14 09:29:49.877525 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1759/2435] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:49 2022] DELETE /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:29:49.879436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090dffcf-1e3e-4edb-9146-1cfba01bc1c9", "name": "network-vif-deleted", "tag": "3a1fb631-0b5f-4912-9af8-75db4a4896eb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:49.889760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:49.890250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:49.890687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:49.905834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] Creating event network-vif-deleted:3a1fb631-0b5f-4912-9af8-75db4a4896eb for instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 on n-h1-851028-12 Sep 14 09:29:49.912155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-33ef22c8-c030-4ed5-8a5f-906b1a4fc7f0 req-8461b57a-833f-4c69-9183-89235c434bb3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036721 Sep 14 09:29:49.912792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1760/2436] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:49.918312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd98f4fb-5795-40ca-9732-354cfc309b6d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693fcc85e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1603727473", "description": "tempest-description-2060637196"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:50.248820 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd98f4fb-5795-40ca-9732-354cfc309b6d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.334637 Sep 14 09:29:50.249619 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1761/2437] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:50.263327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87e99191-37b7-4a63-80b6-2b5e1d8cc42a tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] Calling method '.version_select at 0x7f693f890430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:50.336788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87e99191-37b7-4a63-80b6-2b5e1d8cc42a tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb/defaults" status: 200 len: 371 microversion: 2.1 time: 0.084997 Sep 14 09:29:50.337452 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1762/2438] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:50 2022] GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb/defaults => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:50.342697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:50.343449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:50.352483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:50.352751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:50.353101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:50.353935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:50.354405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:50.354848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:50.960004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:50.971428 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6308a6e1-4370-4bd5-bacd-c85c483c4bc2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1487 microversion: 2.1 time: 0.632816 Sep 14 09:29:50.972255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1763/2439] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:50 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1487 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:50.991178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:50.991793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:50.999429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.002249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.003268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.005146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.005587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.006356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.345741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:51.353691 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2569452-e773-475a-aba3-ac105adc402a tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1526 microversion: 2.1 time: 0.366357 Sep 14 09:29:51.354275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1764/2440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:50 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1526 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:51.358861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02988b92-d768-4bbc-b4ee-beb124a4058f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693f119b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1752390021", "description": "tempest-description-985348713"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:51.567760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02988b92-d768-4bbc-b4ee-beb124a4058f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.212357 Sep 14 09:29:51.568713 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1765/2441] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:51.573590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e199a6c-4120-4c10-9a42-69abc0c83faa tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] Calling method '.version_select at 0x7f6944428040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.649992 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e199a6c-4120-4c10-9a42-69abc0c83faa tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb" status: 200 len: 371 microversion: 2.1 time: 0.080156 Sep 14 09:29:51.651127 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1766/2442] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:51.657055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.658077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.664855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.665815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.666271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.667149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.667666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.668342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.927514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:51.936194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69817e22-5d03-4cbc-bada-2cbb02f8441e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1312 microversion: 2.1 time: 0.283582 Sep 14 09:29:51.944371 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1767/2443] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:51.944371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:51.944371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.951635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.952449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.953068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.954461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.955135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.956318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.974381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 HTTP/1.1 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '090dffcf-1e3e-4edb-9146-1cfba01bc1c9'} Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:51.977402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a45808dd-a669-438b-826d-aa01c752fea7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 404 len: 111 microversion: 2.1 time: 0.041357 Sep 14 09:29:51.985159 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1768/2444] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:51 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:51.987915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:51.987915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:51.996547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:51.997132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:51.998458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:51.999162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.000020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.002156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.072385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:52.109283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ef90eb1-7941-433b-bc8f-e632db1e04c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136/action" status: 202 len: 0 microversion: 2.1 time: 0.127151 Sep 14 09:29:52.114226 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1769/2445] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:51 2022] POST /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:52.120670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb2d070e-07b8-443a-b0f6-8b2b36935e99 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693fb5c4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-217252195", "description": "tempest-description-964841871"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:52.352919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cb2d070e-07b8-443a-b0f6-8b2b36935e99 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.240410 Sep 14 09:29:52.353531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1770/2446] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:52.370842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-108f8ed6-82ec-424a-b4fb-375aa60bb13b tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] Calling method '.version_select at 0x7f693e317700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:52.481733 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-108f8ed6-82ec-424a-b4fb-375aa60bb13b tempest-QuotasTestJSON-1191714947 tempest-QuotasTestJSON-1191714947-project] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb?user_id=e855a1a3c1564cac92efbe710b892a20" status: 200 len: 371 microversion: 2.1 time: 0.126927 Sep 14 09:29:52.482326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1771/2447] 10.222.0.90 () {58 vars in 1323 bytes} [Wed Sep 14 09:29:52 2022] GET /compute/v2.1/os-quota-sets/51535392a482455890e409e6b9ab92fb?user_id=e855a1a3c1564cac92efbe710b892a20 => generated 371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:52.487142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:52.498457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.498948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.499392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.511598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] Creating event network-changed:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h2-851028-12 Sep 14 09:29:52.517851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-72d6be29-70e7-47f1-ad40-2e03faa49385 req-9ddd4f0c-2e52-4988-9eb3-89ec932f875d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034227 Sep 14 09:29:52.518781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1772/2448] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:52.525230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:52.526081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:52.533513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.534014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.534455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.535165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.535623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.536107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.551850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 HTTP/1.1 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '090dffcf-1e3e-4edb-9146-1cfba01bc1c9'} Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:52.553578 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf3744a5-967c-4f8e-af88-f1997f165421 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 404 len: 111 microversion: 2.1 time: 0.034926 Sep 14 09:29:52.558802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1773/2449] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:52 2022] DELETE /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:52.560138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:52.560748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:52.568032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.568531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.568970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.569671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:52.570127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:52.570550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:52.724286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:52.733790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0316fe59-fa76-4486-9af4-26560c3058a1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 200 len: 1472 microversion: 2.1 time: 0.177081 Sep 14 09:29:52.734489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1774/2450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:52 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:52.741986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9da3e69-74a0-4173-a3e7-23823062a9aa tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e42c5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:53.194060 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9da3e69-74a0-4173-a3e7-23823062a9aa tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.455332 Sep 14 09:29:53.195191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1775/2451] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:29:52 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:53.206394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:53.207178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:53.215524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.227307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.227934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.229460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.229944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.230459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.519700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:53.535961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e35f5696-0560-4c39-91a4-58ae27101d2d tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1484 microversion: 2.1 time: 0.336509 Sep 14 09:29:53.552981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1776/2452] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:53 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1484 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:53.563794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e26f470-75ef-425c-8bda-ac19defec10e", "name": "network-vif-deleted", "tag": "e3a91d5d-ab66-4df2-a18c-f58edfd1511e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:53.588230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.589154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.591316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.606869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] Creating event network-vif-deleted:e3a91d5d-ab66-4df2-a18c-f58edfd1511e for instance 0e26f470-75ef-425c-8bda-ac19defec10e on n-h2-851028-12 Sep 14 09:29:53.642246 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a8429e5c-ef44-4b5e-bd4c-1267b9e76fa9 req-2426de4e-c3c4-4cb4-a586-271ca4f5a3db service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083603 Sep 14 09:29:53.647692 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1777/2453] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:53.667987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:53.668889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 090dffcf-1e3e-4edb-9146-1cfba01bc1c9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:53.683737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.684479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.685474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.686477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.687167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.688511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.737315 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 HTTP/1.1 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '090dffcf-1e3e-4edb-9146-1cfba01bc1c9'} Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:53.740072 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. Sep 14 09:29:53.744098 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:53.747268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 090dffcf-1e3e-4edb-9146-1cfba01bc1c9 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:53.748804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00de0c51-452e-4f10-9285-3ea52d1eb83b tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9" status: 404 len: 111 microversion: 2.1 time: 0.099513 Sep 14 09:29:53.752307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1778/2454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:53 2022] GET /compute/v2.1/servers/090dffcf-1e3e-4edb-9146-1cfba01bc1c9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:53.761419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1807816571"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:53.767868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:53.790041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.790485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.790941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:53.792206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:53.794980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:53.800592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.096366 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-077219cc-129d-45a2-9faa-cb57ee9387a6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136/action" status: 202 len: 0 microversion: 2.1 time: 0.341852 Sep 14 09:29:54.097000 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1779/2455] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:29:53 2022] POST /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:29:54.102652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.104410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:54.113061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.113569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.114006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.114808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.115270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.115832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.266943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:54.275069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-567450fb-b821-4f8e-b135-72138a01ccb9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1312 microversion: 2.1 time: 0.176623 Sep 14 09:29:54.275650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1780/2456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:54.280655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ddbc044-63b7-40e2-bcc2-c3c119f2f5d9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f890f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.550441 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ddbc044-63b7-40e2-bcc2-c3c119f2f5d9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68" status: 202 len: 0 microversion: 2.1 time: 0.273544 Sep 14 09:29:54.551041 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1781/2457] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:29:54 2022] DELETE /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:54.556157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.556658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:54.565994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.566521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.567808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.568742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.569201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.570194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.590292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c HTTP/1.1 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd67c3413-be58-4542-935e-625a9653c64c'} Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:54.592142 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5d51dad-4204-402f-9195-949fd59bfe1c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 404 len: 111 microversion: 2.1 time: 0.041636 Sep 14 09:29:54.597791 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1782/2458] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:54 2022] DELETE /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:54.600850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01ae7629-37d2-421a-b689-909c902f3409 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fd0de50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.651665 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01ae7629-37d2-421a-b689-909c902f3409 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.055318 Sep 14 09:29:54.652274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1783/2459] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:54.775136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96f4f047-30b5-492d-a1c7-a33a8b8a45f2 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Action: 'create', calling method: .version_select at 0x7f693e42caf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982873143", "metadata": {"Type": "work"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96f4f047-30b5-492d-a1c7-a33a8b8a45f2 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 122 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1982873143", "metadata": {"Type": "work"}}} Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1982873143', 'metadata': {'Type': 'work'}}}} Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '#$%' Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:29:54.779121 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96f4f047-30b5-492d-a1c7-a33a8b8a45f2 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96f4f047-30b5-492d-a1c7-a33a8b8a45f2 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127325 Sep 14 09:29:54.785131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1784/2460] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Sep 14 09:29:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:29:54.787048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fc36820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.809562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:29:54.810168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group cdc698f2-4e20-4464-a0d6-f2015977eb68 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:29:54.810688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.810688 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68 HTTP/1.1 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cdc698f2-4e20-4464-a0d6-f2015977eb68'} Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:29:54.813150 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-98353211-8e24-4b3e-89f2-d7e41ce0cfed'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30ef5251-36e0-4e3c-a95e-f23b6a27177b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68" status: 404 len: 194 microversion: 2.1 time: 0.032802 Sep 14 09:29:54.817895 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1785/2461] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68 => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:54.821396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.821396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:54.827365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.827872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.829026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.829778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.830228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.830645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.863767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.864282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.864713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.865159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lazy-loading 'fault' on Instance uuid 0e26f470-75ef-425c-8bda-ac19defec10e {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:29:54.912653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3abcaaf96da4efc816ba0b72df2680e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aa0ab418f8a47ad8234ea3cb1f60daf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:54.920756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0da85e43-c518-4b25-9b3c-e15140494dea tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 200 len: 1314 microversion: 2.1 time: 0.104236 Sep 14 09:29:54.921349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1786/2462] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:54.928535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:54.929283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: d67c3413-be58-4542-935e-625a9653c64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:54.936070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.936545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.936980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.938337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:54.938867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:54.939290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:54.954015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c HTTP/1.1 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd67c3413-be58-4542-935e-625a9653c64c'} Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.955666 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance d67c3413-be58-4542-935e-625a9653c64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3449c75a-8e29-4a19-8de9-bbd7fdc3920c tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c" status: 404 len: 111 microversion: 2.1 time: 0.032920 Sep 14 09:29:54.961089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1787/2463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:54 2022] GET /compute/v2.1/servers/d67c3413-be58-4542-935e-625a9653c64c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:54.962405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e004c26b-19ff-4931-a94c-c9c5c6740b07 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Action: 'create', calling method: .version_select at 0x7f693efa0790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-961996220", "metadata": {"Type": "work"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e004c26b-19ff-4931-a94c-c9c5c6740b07 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 119 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-961996220", "metadata": {"Type": "work"}}} Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-961996220', 'metadata': {'Type': 'work'}}}} Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '0' Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:29:54.967246 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e004c26b-19ff-4931-a94c-c9c5c6740b07 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e004c26b-19ff-4931-a94c-c9c5c6740b07 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009978 Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1788/2464] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Sep 14 09:29:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:29:54.974380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25d0eac8-9402-482a-9b33-357b91a9f539 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fb00b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.180558 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25d0eac8-9402-482a-9b33-357b91a9f539 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be" status: 202 len: 0 microversion: 2.1 time: 0.209868 Sep 14 09:29:55.181457 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1789/2465] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:29:54 2022] DELETE /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:55.187142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.188772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.195790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.196224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.196670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.197379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.197992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.198465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.215251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f HTTP/1.1 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '22b8f5cf-e732-43a1-bcdd-9355a33f2d0f'} Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:55.217209 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80e1e095-9c4b-4f6e-a89e-31dcfa4a17e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 404 len: 111 microversion: 2.1 time: 0.036496 Sep 14 09:29:55.223564 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1790/2466] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:55 2022] DELETE /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:55.230365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8827c64-2d8e-48fa-b664-86e15768fd5b tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Action: 'create', calling method: .version_select at 0x7f693fb5c5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254459986", "metadata": {"Type": "work"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8827c64-2d8e-48fa-b664-86e15768fd5b tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 118 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-254459986", "metadata": {"Type": "work"}}} Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-254459986', 'metadata': {'Type': 'work'}}}} Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '' Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:29:55.233982 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8827c64-2d8e-48fa-b664-86e15768fd5b tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a8827c64-2d8e-48fa-b664-86e15768fd5b tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009999 Sep 14 09:29:55.239759 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1791/2467] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Sep 14 09:29:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:29:55.241130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fe28040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.264645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:29:55.265260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group a553be81-9169-4c39-b6be-ff036589c7be not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:29:55.265863 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.265863 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be HTTP/1.1 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a553be81-9169-4c39-b6be-ff036589c7be'} Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:29:55.268724 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-10a557e2-a832-4ecc-bfbf-5ba9f9435bbd'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4af2572-5eb8-4864-aaa4-4883abe08e46 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be" status: 404 len: 194 microversion: 2.1 time: 0.032621 Sep 14 09:29:55.274050 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1792/2468] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:55.277250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.277250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.278308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:55.284245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.284748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.285157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.285874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.286321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.286739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.301552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f HTTP/1.1 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '22b8f5cf-e732-43a1-bcdd-9355a33f2d0f'} Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.303194 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 22b8f5cf-e732-43a1-bcdd-9355a33f2d0f could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcddf4d3-02ff-44d3-9ed9-643c0f9b15e8 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f" status: 404 len: 111 microversion: 2.1 time: 0.032975 Sep 14 09:29:55.307694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1793/2469] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/servers/22b8f5cf-e732-43a1-bcdd-9355a33f2d0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:55.309916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bcd2538-e845-4bd0-b14b-e5789459053e tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Calling method '.version_select at 0x7f693e4730d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.340207 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1bcd2538-e845-4bd0-b14b-e5789459053e tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] HTTP exception thrown: Volume tempest-invalid-1651314931 could not be found. Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bcd2538-e845-4bd0-b14b-e5789459053e tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1651314931 HTTP/1.1 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume tempest-invalid-1651314931 could not be found. Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'tempest-invalid-1651314931'} Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1651314931 could not be found. (HTTP 404) (Request-ID: req-be2c18c3-57f6-4125-a427-c94d0dce66a6) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:29:55.373217 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1651314931 could not be found. Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1651314931 could not be found. Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1651314931 could not be found. Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bcd2538-e845-4bd0-b14b-e5789459053e tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 404 to user: Volume tempest-invalid-1651314931 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bcd2538-e845-4bd0-b14b-e5789459053e tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1651314931" status: 404 len: 99 microversion: 2.1 time: 0.068480 Sep 14 09:29:55.379022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1794/2470] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:29:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1651314931 => generated 99 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:29:55.382624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94200779-14fe-4a8e-80d0-58b0e79f6d71 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fa191f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.617381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94200779-14fe-4a8e-80d0-58b0e79f6d71 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d" status: 202 len: 0 microversion: 2.1 time: 0.239859 Sep 14 09:29:55.618696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1795/2471] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:29:55 2022] DELETE /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:55.627359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.628489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.639215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.640024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.640700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.642684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.643497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.644275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.856942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:55.868739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26eb0870-4e40-4d9f-91ef-109e5bf1e0d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1312 microversion: 2.1 time: 0.248809 Sep 14 09:29:55.869701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1796/2472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:55.874885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.875654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:55.882706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.883475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.884120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.885030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:55.885654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:55.886244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:55.904145 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 HTTP/1.1 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b2c7def9-4769-4c28-8aaa-b15e960ea346'} Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:55.905607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9768c436-306a-4271-b632-39b7432e4e74 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 404 len: 111 microversion: 2.1 time: 0.040101 Sep 14 09:29:55.913667 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1797/2473] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:55 2022] DELETE /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:55.919934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b551111-d36d-4254-8b87-7e97bd5f384c tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003963 Sep 14 09:29:55.920615 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1798/2474] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Sep 14 09:29:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:29:55.926380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693fd91550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:55.950893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d HTTP/1.1 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d'} Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:29:55.955745 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-d6ca353e-1be8-426b-a921-ec361511a9d4'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afffc6e1-eff4-449f-bb29-7ef52a4054fc tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d" status: 404 len: 194 microversion: 2.1 time: 0.034983 Sep 14 09:29:55.961826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1799/2475] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:55.969265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64717793-904d-4eba-845c-56239be61a85 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e4730d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.022785 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64717793-904d-4eba-845c-56239be61a85 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.063503 Sep 14 09:29:56.023931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1800/2476] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:29:55 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:56.037158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.037834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.044641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.045501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.046164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.047855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.048846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.049486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.183431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lazy-loading 'services' on Instance uuid 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:29:56.275354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95415829-3c5d-4e22-9494-251a5d2b8f96 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments/ce97781d-381b-44f3-9d04-2691064f869b" status: 202 len: 0 microversion: 2.1 time: 0.250085 Sep 14 09:29:56.276292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1801/2477] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:29:56 2022] DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments/ce97781d-381b-44f3-9d04-2691064f869b => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:29:56.284050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.284769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: b2c7def9-4769-4c28-8aaa-b15e960ea346] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.292752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.293855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.294453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.295419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.296161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.296665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.317155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 HTTP/1.1 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b2c7def9-4769-4c28-8aaa-b15e960ea346'} Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.318843 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance b2c7def9-4769-4c28-8aaa-b15e960ea346 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45283f8e-d065-4f6b-811a-67422cf9f777 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346" status: 404 len: 111 microversion: 2.1 time: 0.042806 Sep 14 09:29:56.323802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1802/2478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/servers/b2c7def9-4769-4c28-8aaa-b15e960ea346 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:56.328194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03b5f566-9a24-4adb-af33-ec32e8a01911 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005778 Sep 14 09:29:56.329273 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1803/2479] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 14 09:29:56.337485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.338124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] [instance: 0e26f470-75ef-425c-8bda-ac19defec10e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.348625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.349219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.349766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.350752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.351381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.351817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.368132 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] HTTP exception thrown: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Request method failure captured: Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e HTTP/1.1 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7vJm_whY6bV4JXwOaYDtu9jErFHScYlK3Bram-tMlDF2JlAv2HpusKLovwE_dA6yo7QyyqgjsdXpAFK7FwMk_T32BOVqzOhCUYGdARAO5aejNQvbYAiZC1q1s6HYNqiwdb3WQSOeNeRca_LWXDqZSUTp63bprwNfFc8JKozDEELTc Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9aa0ab418f8a47ad8234ea3cb1f60daf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9aa0ab418f8a47ad8234ea3cb1f60daf"}]}] Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9aa0ab418f8a47ad8234ea3cb1f60daf Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1342324535 Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b3abcaaf96da4efc816ba0b72df2680e Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1342324535-project Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '0e26f470-75ef-425c-8bda-ac19defec10e'} Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.373168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] Returning 404 to user: Instance 0e26f470-75ef-425c-8bda-ac19defec10e could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9cc7131f-3a42-43fd-8fbb-7f366a40ed29 tempest-ServerAddressesNegativeTestJSON-1342324535 tempest-ServerAddressesNegativeTestJSON-1342324535-project] 10.222.0.90 "GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e" status: 404 len: 111 microversion: 2.1 time: 0.044712 Sep 14 09:29:56.379819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1804/2480] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/servers/0e26f470-75ef-425c-8bda-ac19defec10e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:56.382606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fdfe20a9-019c-4578-9b69-1836ad53e362 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f7449d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.795133 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fdfe20a9-019c-4578-9b69-1836ad53e362 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.417094 Sep 14 09:29:56.795810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1805/2481] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:56.803480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.810554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.822485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.823274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.824030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.825591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.826655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.827430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.875764 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aff975e4-2e66-4276-bac4-0b2fc1419230 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077944 Sep 14 09:29:56.877129 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1806/2482] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:29:56 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:56.883325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.883533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:56.895950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.896934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.897583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.898497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:56.899053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:56.899479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:56.915004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c HTTP/1.1 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'af26482e-96cd-4f2e-b7ee-54c507a2055c'} Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:56.919123 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a8bea16-412e-488c-b90b-674e3122a0bd tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 404 len: 111 microversion: 2.1 time: 0.042512 Sep 14 09:29:56.924873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1807/2483] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:56 2022] DELETE /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:56.930736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a99a609-6a0c-4fe3-a9bb-a37e8b0a1060 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Calling method '.version_select at 0x7f693f790ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:56.989463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4a99a609-6a0c-4fe3-a9bb-a37e8b0a1060 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] HTTP exception thrown: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a99a609-6a0c-4fe3-a9bb-a37e8b0a1060 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-volumes/7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 HTTP/1.1 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7b9cbdc2-2120-4dbd-852c-ffc9f116dd66'} Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. (HTTP 404) (Request-ID: req-6f8feeab-ec9f-4035-b639-ede852047b26) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:29:56.991439 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a99a609-6a0c-4fe3-a9bb-a37e8b0a1060 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 404 to user: Volume 7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a99a609-6a0c-4fe3-a9bb-a37e8b0a1060 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/7b9cbdc2-2120-4dbd-852c-ffc9f116dd66" status: 404 len: 109 microversion: 2.1 time: 0.070959 Sep 14 09:29:56.996473 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1808/2484] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:29:56 2022] DELETE /compute/v2.1/os-volumes/7b9cbdc2-2120-4dbd-852c-ffc9f116dd66 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:57.007771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-176868c2-26c1-4645-a0b6-b0d11118c3c9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693e473670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-264184489", "description": "tempest-description-750612975"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:57.408784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-176868c2-26c1-4645-a0b6-b0d11118c3c9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.409564 Sep 14 09:29:57.411207 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1809/2485] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:56 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:57.425502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:57.426677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:57.443026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:57.443969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:57.444647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:57.445608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:57.446286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:57.446940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:57.886138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:29:57.904524 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e7fd02c-300b-461c-9903-63ec2c4724b6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1312 microversion: 2.1 time: 0.491450 Sep 14 09:29:57.905423 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1810/2486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:57 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:57.930682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:57.936254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: af26482e-96cd-4f2e-b7ee-54c507a2055c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:57.959239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:57.960014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:57.960470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:57.961224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:57.962326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:57.962758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:57.991493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c HTTP/1.1 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'af26482e-96cd-4f2e-b7ee-54c507a2055c'} Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:57.993402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. Sep 14 09:29:57.998922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.001109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance af26482e-96cd-4f2e-b7ee-54c507a2055c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:58.002558 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-363485ca-52fd-40a8-ae17-d3638fa4f2d7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c" status: 404 len: 111 microversion: 2.1 time: 0.083876 Sep 14 09:29:58.003731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1811/2487] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:57 2022] GET /compute/v2.1/servers/af26482e-96cd-4f2e-b7ee-54c507a2055c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:58.009250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7a953a5-47ea-49e7-8e70-443808367dd6 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Calling method '.version_select at 0x7f693ff00160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:58.054674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a7a953a5-47ea-49e7-8e70-443808367dd6 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] HTTP exception thrown: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7a953a5-47ea-49e7-8e70-443808367dd6 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Request method failure captured: Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-volumes/3a239402-5bfc-4016-ae62-51d638418d4b HTTP/1.1 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8SzHh7tQpGjcux0_y6wsFa9Sg4MJyYRmzJTy6AFK19TyMJkNjmXMks70e3ZJxonyx-YJuBPOR5PNf__R_io_e5OLF9HoxkpCOxqY8pCai0qlQ9Xml_XEnwNmjGoBJpOAs06XifvX2tAVNt6UbhyHc_pE_UgDYbCuL0NhD3HlAx8kM Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_335e5772b9e347a7a7dcb427cda50ba4", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/335e5772b9e347a7a7dcb427cda50ba4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/335e5772b9e347a7a7dcb427cda50ba4"}]}] Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 335e5772b9e347a7a7dcb427cda50ba4 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesNegativeTest-753917199 Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 28657736272f40dd908658b17c0a67ac Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesNegativeTest-753917199-project Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3a239402-5bfc-4016-ae62-51d638418d4b'} Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. (HTTP 404) (Request-ID: req-3d01fc8e-1cbe-40ee-8bb0-9c656248b77e) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:29:58.057017 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7a953a5-47ea-49e7-8e70-443808367dd6 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] Returning 404 to user: Volume 3a239402-5bfc-4016-ae62-51d638418d4b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7a953a5-47ea-49e7-8e70-443808367dd6 tempest-VolumesNegativeTest-753917199 tempest-VolumesNegativeTest-753917199-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/3a239402-5bfc-4016-ae62-51d638418d4b" status: 404 len: 109 microversion: 2.1 time: 0.053609 Sep 14 09:29:58.061256 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1812/2488] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:29:58 2022] GET /compute/v2.1/os-volumes/3a239402-5bfc-4016-ae62-51d638418d4b => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:58.070663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-694ae967-9a12-4b6a-bef9-d181ad13d114 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e42c430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:58.182997 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-694ae967-9a12-4b6a-bef9-d181ad13d114 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.122384 Sep 14 09:29:58.186433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1813/2489] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:29:58 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:29:58.208828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-326e9a0e-9776-44fd-ae80-529dcf581f7f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f693fa190d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1405338536", "description": "tempest-description-376984763"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:58.941028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-326e9a0e-9776-44fd-ae80-529dcf581f7f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.749495 Sep 14 09:29:58.942543 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1814/2490] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:29:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:58.949443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:58.958805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:58.982372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.988962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.992262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:58.995712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:58.996279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:58.999379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.021744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:29:59.160101 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6e8a484-b5a3-40c2-a758-881e54b31009 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215870 Sep 14 09:29:59.171333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1815/2491] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:29:58 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:59.209497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:59.215688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:59.237628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.245294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.248403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.255331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.262692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.263468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.321683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 HTTP/1.1 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'daa678f2-8587-42b3-bf92-f25b7d248eb1'} Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:29:59.338660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:29:59.343307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1b97da2-0e64-44ab-97d5-651fd2f7a77e tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 404 len: 111 microversion: 2.1 time: 0.166024 Sep 14 09:29:59.346262 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1816/2492] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:29:59 2022] DELETE /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:29:59.362241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "name": "network-vif-plugged", "status": "completed", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:29:59.392365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.393463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.401365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.422514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] Creating event network-vif-plugged:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h2-851028-12 Sep 14 09:29:59.442221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-34658d09-650e-4d03-95b4-237f55fa1819 req-69ee232a-ba78-4b16-84f3-18e796655f99 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084263 Sep 14 09:29:59.445372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1817/2493] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:29:59.487631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:29:59.493658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:29:59.530285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.533685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.534470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:29:59.535433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:29:59.538667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:29:59.540342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:00.365472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:00.373654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-768b61c7-e1fd-476a-af4c-86ba6da13d67 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1312 microversion: 2.1 time: 0.905000 Sep 14 09:30:00.374438 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1818/2494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:29:59 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:00.381015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e30a74e2-b7ec-430e-9b75-e5acf75df4b2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa03820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:00.472915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e30a74e2-b7ec-430e-9b75-e5acf75df4b2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.096723 Sep 14 09:30:00.480936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1819/2495] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:00 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:00.492536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-567561711", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "42f746b5-21d1-4833-aebe-cf0f7efc6b91"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:00.517119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:00.580866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] validate_networks() for [('42f746b5-21d1-4833-aebe-cf0f7efc6b91', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:30:01.791436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:30:01.792029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:30:01.792355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:30:01.792765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:30:01.793177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:30:01.815014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:01.815747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:01.816706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:01.817620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:01.818240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:01.818955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:01.865498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Getting quotas for project c4741b9fcd214ebab758c2effdf6b09a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:01.884285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Getting quotas for user 5820e680ab554514ace9c0619d913a47 and project c4741b9fcd214ebab758c2effdf6b09a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:01.920968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:30:01.926122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:30:02.034920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40909114-837e-4da6-97c3-acd5f663522e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552477 Sep 14 09:30:02.038453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1820/2496] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:30:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:30:02.051373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:02.053644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: daa678f2-8587-42b3-bf92-f25b7d248eb1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:02.072343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.074707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.076487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.079524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.080833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.082400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.139436 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 HTTP/1.1 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'daa678f2-8587-42b3-bf92-f25b7d248eb1'} Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:02.142084 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance daa678f2-8587-42b3-bf92-f25b7d248eb1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6213d257-1e27-46d0-98a1-6f4f20faa0c7 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1" status: 404 len: 111 microversion: 2.1 time: 0.103434 Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1821/2497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:02 2022] GET /compute/v2.1/servers/daa678f2-8587-42b3-bf92-f25b7d248eb1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:02.149922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:02.152219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:02.177600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.178115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.178799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.179542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.180195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.180708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.252385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ebbeb774-0145-4074-a3bd-b98779d45421 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104388 Sep 14 09:30:02.253887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1822/2498] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:30:02 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:02.259336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:02.260193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:02.271522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.272229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.272824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.273696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.274505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.275092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.723827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:02.746650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7112c0e1-99b9-49f7-807f-ededd6b042d1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1462 microversion: 2.1 time: 0.491379 Sep 14 09:30:02.748725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1823/2499] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:02 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1462 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:02.771715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a78d96d2-5a0d-4c5e-a60c-a7c3f83748e4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693f7449d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:02.904943 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a78d96d2-5a0d-4c5e-a60c-a7c3f83748e4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.136979 Sep 14 09:30:02.906480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1824/2500] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:02 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:02.916967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b3da54-6896-4d24-af27-264326077136", "name": "network-vif-plugged", "status": "completed", "tag": "2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:02.956832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:02.957415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:02.957841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:02.990955 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] Creating event network-vif-plugged:2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941 for instance 98b3da54-6896-4d24-af27-264326077136 on n-h1-851028-12 Sep 14 09:30:03.003697 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d47d7377-5a9a-4937-9e9a-e6807448f3b3 req-09b2f748-828d-4abc-894d-ce5795f58fb3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092522 Sep 14 09:30:03.006213 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1825/2501] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:03.014804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3e2a715-a890-436f-bbaf-6d93ed48273e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:03.016097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3e2a715-a890-436f-bbaf-6d93ed48273e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:03.113924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3e2a715-a890-436f-bbaf-6d93ed48273e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:03.125175 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3e2a715-a890-436f-bbaf-6d93ed48273e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1215 microversion: 2.1 time: 0.114453 Sep 14 09:30:03.126116 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1826/2502] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:03 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:03.134236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:03.135771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:03.158255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.158956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.160350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:03.163024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.164237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.165768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:03.204602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda HTTP/1.1 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '421a8ad3-2bce-4dd4-bdd6-8d98a6760eda'} Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:03.207479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:03.211536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab556a5c-b995-4f80-94e6-cd353346d404 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda" status: 404 len: 111 microversion: 2.1 time: 0.082434 Sep 14 09:30:03.215467 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1827/2503] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:03 2022] DELETE /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:03.694482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:03.695225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:03.739583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.744667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.745491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:03.746688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:03.747372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:03.748259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:04.993783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-98476bc2-2eea-4528-b493-4b7a0d9a2141 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1615 microversion: 2.1 time: 1.775728 Sep 14 09:30:05.008839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1828/2504] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:03 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1615 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:05.030293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:05.033123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:05.040510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.041924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.042623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.044019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.044668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.045261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.066546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda HTTP/1.1 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '421a8ad3-2bce-4dd4-bdd6-8d98a6760eda'} Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:05.068605 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. Sep 14 09:30:05.073611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:05.075732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 421a8ad3-2bce-4dd4-bdd6-8d98a6760eda could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:05.077023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27f93432-6d82-4e97-b263-6a9612e6773f tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda" status: 404 len: 111 microversion: 2.1 time: 0.066577 Sep 14 09:30:05.078216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1829/2505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:05 2022] GET /compute/v2.1/servers/421a8ad3-2bce-4dd4-bdd6-8d98a6760eda => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:05.085887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:05.089209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:05.100207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.101002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.101614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.102529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.103143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.103744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.148584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-428f1360-8f36-470d-b054-a15d2604f4d4 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069079 Sep 14 09:30:05.149551 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1830/2506] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:30:05 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:05.155775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16210c8d-e749-41e6-a3b6-e06223887e69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693f790b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:05.218240 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16210c8d-e749-41e6-a3b6-e06223887e69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.067469 Sep 14 09:30:05.220643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1831/2507] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:05 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:05.250682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:05.251746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:05.264341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.266937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.267648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.271358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.273150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.273812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.464606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:05.486689 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62868274-99c9-4820-8ae0-e3bd356b9d3e tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1273 microversion: 2.1 time: 0.264066 Sep 14 09:30:05.516274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1832/2508] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:05 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:05.530407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:05.532335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:05.552128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.552889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.553493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.554464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:05.555084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:05.555679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:05.596650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8e42cc26c64d422ebaf4c62f202d77d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699e23d9de424998fcf7416274b5e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:05.598285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] flavor_id is None. Assuming migration. {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 09:30:05.599565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:30:06.232056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18372ae8-d633-41c7-8ed3-ad898b5d6017 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff/action" status: 202 len: 0 microversion: 2.1 time: 0.712270 Sep 14 09:30:06.237830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1833/2509] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:05 2022] POST /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:06.243712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.244940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:06.254845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.255730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.256500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.257481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.258591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.259748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.295106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:30:06.425597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9c18a0e-1c2a-41d5-bf0b-60359c490073 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 204 len: 0 microversion: 2.1 time: 0.184559 Sep 14 09:30:06.426761 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1834/2510] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:06 2022] DELETE /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:06.437132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.441176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:06.455028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.457053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.457571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.459136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.459647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.463628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.560020 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47b57480-2944-4332-af5a-4190b70eebed tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108327 Sep 14 09:30:06.566603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1835/2511] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:30:06 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:30:06.613011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25d95e88-7e42-47f4-b62f-dd4b2d7599ee tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa75160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.807823 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25d95e88-7e42-47f4-b62f-dd4b2d7599ee tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.245978 Sep 14 09:30:06.808477 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1836/2512] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:06 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:06.845268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:06.848186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:06.889803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.890510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.896221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:06.897623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:06.898118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:06.898560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.165108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:07.181265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d195623-c2f7-4956-899d-60068c07c509 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1471 microversion: 2.1 time: 0.371619 Sep 14 09:30:07.182826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1837/2513] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:06 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:07.188515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:07.189747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:07.203319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.205120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.207859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.207859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.207859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.208175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.216326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:07.761917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:07.773745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8e6c3a8-11ec-469e-b1f3-0eb532709dd5 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1480 microversion: 2.1 time: 0.589827 Sep 14 09:30:07.779748 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1838/2514] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:07 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1480 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:07.798041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:07.801673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:07.816476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.817189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.820897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:07.822201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:07.822536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:07.822968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.364462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:08.378702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a97dc2dc-4af0-47b8-8b54-9e773e460db5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 0.597404 Sep 14 09:30:08.391250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1839/2515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:07 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:08.404797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:08.413985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:08.433855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.434891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.438444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.441859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:08.443294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:08.443996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:08.556964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:30:08.820403 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b725d9f-5529-4b4b-b295-fae4b5f88e3f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 204 len: 0 microversion: 2.1 time: 0.419244 Sep 14 09:30:08.823373 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1840/2516] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:08 2022] DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:08.841762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6e4d08a-0d3a-4f05-98ed-5b0382aff541 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fcfedc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.042737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6e4d08a-0d3a-4f05-98ed-5b0382aff541 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.214083 Sep 14 09:30:09.043674 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1841/2517] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:08 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:09.058602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.059632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:09.074480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.075069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.075775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.076629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.077082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.077709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.446427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:09.464824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ce21a1f-7184-4814-86b8-55d8852cd8ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1471 microversion: 2.1 time: 0.410541 Sep 14 09:30:09.465360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1842/2518] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:09 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:09.471012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.471636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:09.491317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.492137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.492741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.493985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.494617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.495202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.655341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e023c82f88a348868ef9aa9003dc37fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c047ee69710043a38039f33fadec4a86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:09.666623 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c5cd29b-646f-4d7b-809a-8ba53e7a2bb1 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 200 len: 1438 microversion: 2.1 time: 0.199983 Sep 14 09:30:09.667226 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1843/2519] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:09 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 1438 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:09.688028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:09.692436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:09.725414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.726689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.727305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:09.728281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:09.728916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:09.729543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.225310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:10.244457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5303dce7-81c7-42f5-839f-4b75cac5ebee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1682 microversion: 2.1 time: 0.575142 Sep 14 09:30:10.251445 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1844/2520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:09 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1682 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:10.264566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6451f43a-0e55-47d2-95a2-120bac6a767c", "name": "network-vif-deleted", "tag": "7a3abbcb-0688-45c8-86c0-d0a92af48961"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:10.315066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.315924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.316546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.357770 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] Creating event network-vif-deleted:7a3abbcb-0688-45c8-86c0-d0a92af48961 for instance 6451f43a-0e55-47d2-95a2-120bac6a767c on n-h1-851028-12 Sep 14 09:30:10.374307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9202bdb3-1500-49aa-8b75-94f20762fb60 req-7cfe603b-3d86-4e36-a530-875fea35bcdb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121268 Sep 14 09:30:10.383267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1845/2521] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:10.407281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:10.408691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:10.436369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.437717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.438437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:10.442498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:10.443078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:10.452385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:11.696036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:11.707991 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe90bac7-edb3-4581-953f-144279b05de9 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 1.320011 Sep 14 09:30:11.714443 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1846/2522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:10 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:11.720466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d9a4c2a-a290-4f3a-9346-f1a3c59f5793 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f694408bee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:11.814307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d9a4c2a-a290-4f3a-9346-f1a3c59f5793 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.098273 Sep 14 09:30:11.821487 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1847/2523] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:11 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:11.831659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:11.832673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:11.840958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:11.846454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:11.847566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:11.848492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:11.849554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:11.850286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:11.850961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.563961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:12.581755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1547852-5d27-47fd-b147-95f4a80544dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.757379 Sep 14 09:30:12.603587 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1848/2524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:11 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:12.613116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:12.614590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] [instance: 6451f43a-0e55-47d2-95a2-120bac6a767c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:12.626720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.627483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.628146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.629871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.632480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.633254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.658650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] HTTP exception thrown: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Request method failure captured: Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c HTTP/1.1 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ4BAYtbvbxjBonLq3O5WT2l9oCJvyp6MuXcmIcJl2j_AQHjXnRKAT0B7uhbfViCnikqJ9SKW3lSeR2rpqLEZ7obt3qKX4A0V7AJtfgilBJWx5-JyeheYM9CIi4-Ciehcx2Y1VxcH3UNLcjfcshw9CnAL6Grf33xPgGsLxMVqx7I45E Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c047ee69710043a38039f33fadec4a86", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c047ee69710043a38039f33fadec4a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c047ee69710043a38039f33fadec4a86"}]}] Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersTestJSON-701793051 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c047ee69710043a38039f33fadec4a86 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersTestJSON-701793051 Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersTestJSON-701793051-project Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e023c82f88a348868ef9aa9003dc37fc Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersTestJSON-701793051-project Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6451f43a-0e55-47d2-95a2-120bac6a767c'} Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:12.661980 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. Sep 14 09:30:12.667248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:12.669164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] Returning 404 to user: Instance 6451f43a-0e55-47d2-95a2-120bac6a767c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:12.670237 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcd935f1-1a27-4494-b146-2675afd9cfd4 tempest-ServersTestJSON-701793051 tempest-ServersTestJSON-701793051-project] 10.222.0.90 "GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c" status: 404 len: 111 microversion: 2.1 time: 0.065337 Sep 14 09:30:12.671124 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1849/2525] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:12 2022] GET /compute/v2.1/servers/6451f43a-0e55-47d2-95a2-120bac6a767c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:12.678216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:12.679635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:12.689512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.691182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.691925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.692899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:12.693991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:12.695265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:12.981597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:12.992995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f8fb15d-1d07-45cf-97b1-27925148c3e0 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1682 microversion: 2.1 time: 0.319030 Sep 14 09:30:12.997106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1850/2526] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:12 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1682 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:13.001576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5d5bfd-da1f-46a8-a9d4-1663aedea595", "name": "network-vif-unplugged", "status": "completed", "tag": "fec64cdc-70ad-4eff-b13e-c72974466fc9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:13.029117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.029615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.030058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.081744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] Creating event network-vif-unplugged:fec64cdc-70ad-4eff-b13e-c72974466fc9 for instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 on n-h1-851028-12 Sep 14 09:30:13.092608 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6b00cc7d-4de0-425c-8809-0a1b4f37d00a req-e8babe88-7764-4f46-a236-85ad38d9c2f2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096583 Sep 14 09:30:13.093809 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1851/2527] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:13.100629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb190708-b6cc-4d65-bfb8-bf93c43dbef1", "tag": "cf29c7a7-fa85-4518-a861-fd82c3b31284"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:13.112105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.112598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.113033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.123580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=22 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:13.148083 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] Creating event network-changed:cf29c7a7-fa85-4518-a861-fd82c3b31284 for instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 on n-h1-851028-12 Sep 14 09:30:13.152376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-473e37a9-5911-424d-b66b-9696d39c4c1b req-640ee16f-4bf9-4840-bb23-aecce48fc302 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056660 Sep 14 09:30:13.153414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1852/2528] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:13.176767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:13.177720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:13.188848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.189709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.190486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.191568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.192216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.193152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.574648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:13.586898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5aaaa4e-7b78-4081-8c27-ecd39e38dab8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 0.431975 Sep 14 09:30:13.598211 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1853/2529] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:13 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:13.612939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c49f8f4f-464a-40c3-b49e-277de3e02d5a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693f7c44c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:13.706545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c49f8f4f-464a-40c3-b49e-277de3e02d5a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.106938 Sep 14 09:30:13.707149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1854/2530] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:13 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:13.725953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:13.726616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:13.755250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.755768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.758169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:13.774991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:13.776343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:13.777591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.399716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:15.427929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32abd81d-b453-40b6-bf61-b5b120ae9a3d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 1.719690 Sep 14 09:30:15.444663 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1855/2531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:13 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:15.450425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:15.461215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:15.489998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.501812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.502537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:15.505256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:15.507372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:15.512676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:16.260529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f4798765d684da993cd6315ea8dbf9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0b16a76f7234e4aa780e76c321aa8a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:16.272699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efb5d8b8-39d3-44ee-83da-3692a735db35 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 200 len: 1614 microversion: 2.1 time: 0.826667 Sep 14 09:30:16.275192 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1856/2532] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:15 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 1614 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:16.287478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:16.290195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:16.323219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:16.328414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:16.330888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:16.332366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:16.352887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:16.356715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.027999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:18.041746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0abd9e74-b14b-44c8-82d7-f78f3950c1c7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 1.764534 Sep 14 09:30:18.042366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1857/2533] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:16 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:18.075768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d1d06de-ca54-41fd-b578-7dd52c21c25a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa03700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:18.174961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d1d06de-ca54-41fd-b578-7dd52c21c25a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.118935 Sep 14 09:30:18.181746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1858/2534] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:18 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:18.186578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5d5bfd-da1f-46a8-a9d4-1663aedea595", "name": "network-vif-deleted", "tag": "fec64cdc-70ad-4eff-b13e-c72974466fc9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:18.241509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:18.252587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:18.253265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.267566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] Creating event network-vif-deleted:fec64cdc-70ad-4eff-b13e-c72974466fc9 for instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 on n-h1-851028-12 Sep 14 09:30:18.282974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f3ddc321-c2a2-4dc4-a450-8cd7c0178155 req-c52c653f-9adb-487d-a9fc-dbfd94f3a4bd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099421 Sep 14 09:30:18.283860 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1859/2535] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:18.289716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:18.290652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:18.300530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:18.301281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:18.301924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.303157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:18.303769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:18.304240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:18.329063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:19.026864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:19.037499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-74fa7d55-7e1b-4e4d-afae-e89051fff76d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.752194 Sep 14 09:30:19.057545 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1860/2536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:18 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:19.072809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.074350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.083005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.083858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.085829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.086886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.087560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.088405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.114543 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 HTTP/1.1 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3f5d5bfd-da1f-46a8-a9d4-1663aedea595'} Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:19.116750 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:19.122448 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:19.125124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:19.126246 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bebba5f6-c8f4-4494-8a26-59280eba4cee tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 404 len: 111 microversion: 2.1 time: 0.067218 Sep 14 09:30:19.130708 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1861/2537] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:19.137472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.138321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:19.145177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:19.147814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.148619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.149903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.151152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:19.151819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:19.152894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:19.717965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:19.730104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cb6bc19-c35a-4f52-8439-682571dc3f4f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 0.597750 Sep 14 09:30:19.732856 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1862/2538] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:19.739012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0055960d-f49c-4fc4-be9a-dfdf3db0dc78 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '.version_select at 0x7f693f899160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.797129 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0055960d-f49c-4fc4-be9a-dfdf3db0dc78 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-516161777" status: 202 len: 0 microversion: 2.1 time: 0.062841 Sep 14 09:30:19.800500 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1863/2539] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-516161777 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:19.812669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b857c94-2ee2-461b-811f-5f031bae18c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa27f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:19.892406 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b857c94-2ee2-461b-811f-5f031bae18c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.090103 Sep 14 09:30:19.895182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1864/2540] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:19 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:20.068956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:20.073008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:20.084621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.085123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.089666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.090630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.096314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.096997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.482038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:20.497906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3c0170e-186e-47f0-931d-4de34a89eafd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.433602 Sep 14 09:30:20.499089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1865/2541] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:20 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:20.755044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:20.756816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:20.769393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.775493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.778552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:20.781292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:20.792088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:20.792989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:21.883072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:21.893686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2378df28-f152-4dba-a1c7-49aa90a97817 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 1.142834 Sep 14 09:30:21.908221 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1866/2542] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:20 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:21.924339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-962ec28f-f72d-4b5e-956d-1630b3e9f199 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693f9de790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:22.045450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-962ec28f-f72d-4b5e-956d-1630b3e9f199 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.135749 Sep 14 09:30:22.049410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1867/2543] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:21 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:22.071826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb190708-b6cc-4d65-bfb8-bf93c43dbef1", "name": "network-vif-plugged", "status": "completed", "tag": "cf29c7a7-fa85-4518-a861-fd82c3b31284"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:22.120438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.148493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.149047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.182939 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] Creating event network-vif-plugged:cf29c7a7-fa85-4518-a861-fd82c3b31284 for instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 on n-h1-851028-12 Sep 14 09:30:22.200058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f9890a01-54a5-4f79-a676-6c2abe5bbcc9 req-06bb6c9e-d88c-4083-936c-8d9826760872 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146956 Sep 14 09:30:22.202915 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1868/2544] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:22.231165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:22.232393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:22.266905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.267822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.268618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:22.269527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:22.270792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:22.271379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.252153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:23.262221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85f34b18-ddf3-4632-a847-604fab3d4a5d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 1.056848 Sep 14 09:30:23.282771 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1869/2545] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:22 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:23.307467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:23.309354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:23.327125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:23.328841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:23.329485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.332891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:23.333565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:23.334529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:23.673774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:23.699215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3f61232-7da5-4f28-88df-f085806648c1 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1315 microversion: 2.1 time: 0.405899 Sep 14 09:30:23.719079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1870/2546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:23 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:23.729955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16603c67-ef2a-4dac-82f0-ed4cf4c32d06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa27a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:23.832611 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16603c67-ef2a-4dac-82f0-ed4cf4c32d06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1412 microversion: 2.1 time: 0.109066 Sep 14 09:30:23.833205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1871/2547] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:23 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:24.287136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:24.287824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:24.301852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:24.305757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:24.306397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:24.307340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:24.307824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:24.308287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.055141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:25.070343 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-026880c1-67f4-48d9-8dda-01008043237c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.786279 Sep 14 09:30:25.072492 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1872/2548] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:24 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:30:25.082220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:25.082882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:25.113625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.114209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.114582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.115313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:25.115773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:25.116213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:25.855121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:25.885068 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82975cac-2e6e-4528-a929-b1d384c76a03 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1503 microversion: 2.1 time: 0.810837 Sep 14 09:30:25.885722 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1873/2549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:25 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1503 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:25.907015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-55f560f4-6f38-4ca6-8981-0c6c0a4e255f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693ea2a040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:25.998656 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-55f560f4-6f38-4ca6-8981-0c6c0a4e255f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1421 microversion: 2.1 time: 0.109519 Sep 14 09:30:26.004727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1874/2550] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:25 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:26.010791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-264184489"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:26.012686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:26.032238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.032841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.034689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.035651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:26.036176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:26.036682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:26.316666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.network.security_group_api [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Adding security group 1216a3c2-833d-450f-8c86-c28a22bb3833 to port cf29c7a7-fa85-4518-a861-fd82c3b31284 Sep 14 09:30:27.331625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1474ffd8-dc7e-494c-84f1-73f0a1c0b741 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action" status: 202 len: 0 microversion: 2.1 time: 1.325403 Sep 14 09:30:27.332627 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1875/2551] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:26 2022] POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action => generated 0 bytes in 1327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:27.337239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3fe6f3e-6a15-4d21-8653-41f6edb3c5f9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693ea8b280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:27.429250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3fe6f3e-6a15-4d21-8653-41f6edb3c5f9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 200 len: 1421 microversion: 2.1 time: 0.095489 Sep 14 09:30:27.430612 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1876/2552] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:30:27 2022] GET /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:27.436348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:27.437661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:27.445463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:27.446284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:27.447050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:27.448022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:27.448837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:27.449470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:27.647541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:27.658001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.225963 Sep 14 09:30:27.662195 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1877/2553] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:27 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:27.664668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:27.667909 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9dd81dff-562d-4307-b87d-4f453ad0f222 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003494 Sep 14 09:30:27.668531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1878/2554] 10.222.0.90 () {56 vars in 886 bytes} [Wed Sep 14 09:30:27 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:30:28.018690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d693a3c-f124-4b5e-9fbe-d66d440d2121 tempest-ComputeTenantNetworksTest-953601571 tempest-ComputeTenantNetworksTest-953601571-project] Calling method '.version_select at 0x7f693e939dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:28.473120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d693a3c-f124-4b5e-9fbe-d66d440d2121 tempest-ComputeTenantNetworksTest-953601571 tempest-ComputeTenantNetworksTest-953601571-project] 10.222.0.90 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.803272 Sep 14 09:30:28.474050 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1879/2555] 10.222.0.90 () {58 vars in 1158 bytes} [Wed Sep 14 09:30:27 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:28.478756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693efa0790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:28.674715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use.", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:30:28.676026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.676026 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833 HTTP/1.1 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: exception: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1216a3c2-833d-450f-8c86-c28a22bb3833'} Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:30:28.678950 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] Sep 14 09:30:28.683360 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:28.687846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 400 to user: Security Group 1216a3c2-833d-450f-8c86-c28a22bb3833 in use. Sep 14 09:30:28.687846 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-0969b321-289a-421d-a322-e2910af59aca'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:28.689701 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c58c48d-c790-4498-8da8-67170485ac7c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833" status: 400 len: 185 microversion: 2.1 time: 0.214713 Sep 14 09:30:28.695374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1880/2556] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:30:28 2022] DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833 => generated 185 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:30:28.713380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb190708-b6cc-4d65-bfb8-bf93c43dbef1", "tag": "cf29c7a7-fa85-4518-a861-fd82c3b31284"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:28.737769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:28.738927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:28.747005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:28.766170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] Creating event network-changed:cf29c7a7-fa85-4518-a861-fd82c3b31284 for instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 on n-h1-851028-12 Sep 14 09:30:28.781126 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-34f731a7-11d7-4851-889e-8a75129a36db req-c133dd74-2f2f-4569-a848-3d994d636e0b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083362 Sep 14 09:30:28.781900 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1881/2557] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:28.787820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb8f94b2-ddd2-4a56-a088-b828fa1efc0c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa27160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:30.196281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb8f94b2-ddd2-4a56-a088-b828fa1efc0c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 204 len: 0 microversion: 2.1 time: 1.412568 Sep 14 09:30:30.198171 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1882/2558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:28 2022] DELETE /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 0 bytes in 1416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:30.206445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58a14af3-2c2f-4bbe-9902-4737a3085e1e tempest-ComputeTenantNetworksTest-953601571 tempest-ComputeTenantNetworksTest-953601571-project] Calling method '.version_select at 0x7f693f9de160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:30.544159 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58a14af3-2c2f-4bbe-9902-4737a3085e1e tempest-ComputeTenantNetworksTest-953601571 tempest-ComputeTenantNetworksTest-953601571-project] 10.222.0.90 "GET /compute/v2.1/os-tenant-networks/2f990940-481b-48ae-b53a-45a584cf2184" status: 200 len: 140 microversion: 2.1 time: 0.344613 Sep 14 09:30:30.554645 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1883/2559] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:30:30 2022] GET /compute/v2.1/os-tenant-networks/2f990940-481b-48ae-b53a-45a584cf2184 => generated 140 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:30.560245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:30.562064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:30.571438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:30.572441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:30.573152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:30.574092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:30.574773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:30.575799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.143391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:31.163513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7567c64b-426b-464d-a14e-17dc359c78bb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.607353 Sep 14 09:30:31.165149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1884/2560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:30 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:31.171790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:31.174486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:31.198691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.200028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.201156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.202811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.205830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.207094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.343597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3dec891d-9abd-4fed-9bfb-d3e9f10524ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action" status: 202 len: 0 microversion: 2.1 time: 0.173589 Sep 14 09:30:31.343597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1885/2561] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:31 2022] POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:31.351360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:31.351980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:31.365633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.366649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.367247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.369883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.370544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.371328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.424803 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 HTTP/1.1 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3f5d5bfd-da1f-46a8-a9d4-1663aedea595'} Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:31.427500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:31.433597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:31.436157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:31.438242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4db786c2-4589-4bd0-84c6-3476a35cf05f tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 404 len: 111 microversion: 2.1 time: 0.093136 Sep 14 09:30:31.452873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1886/2562] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:31 2022] DELETE /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:31.467056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:31.470151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:31.490617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.494880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.495729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.497031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.497541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.497970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.588232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:30:31.759773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2f3f947-270f-476c-a6a6-4a4672614b48 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 204 len: 0 microversion: 2.1 time: 0.304693 Sep 14 09:30:31.762078 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1887/2563] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:31 2022] DELETE /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:31.772931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b3da54-6896-4d24-af27-264326077136", "name": "network-vif-unplugged", "status": "completed", "tag": "2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:31.804278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.806470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.807426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.826103 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] Creating event network-vif-unplugged:2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941 for instance 98b3da54-6896-4d24-af27-264326077136 on n-h1-851028-12 Sep 14 09:30:31.837562 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c7254d2a-2c39-4e41-b048-149781e6273c req-57e2218e-3c18-4348-a564-8a6d9716e370 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071939 Sep 14 09:30:31.838847 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1888/2564] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:31.849706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:31.850885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:31.860805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.862920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.863541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.865854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:31.866513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:31.867444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:31.901691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:32.267621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:32.280569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-285aec3e-6f37-4791-9f91-d47e5199320c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1573 microversion: 2.1 time: 0.438844 Sep 14 09:30:32.281464 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1889/2565] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:31 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1573 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:32.296355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:32.296992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 3f5d5bfd-da1f-46a8-a9d4-1663aedea595] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:32.307239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:32.312306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:32.312951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:32.313544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:32.314021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:32.314456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:32.362567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 HTTP/1.1 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3f5d5bfd-da1f-46a8-a9d4-1663aedea595'} Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:32.371184 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:32.376755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 3f5d5bfd-da1f-46a8-a9d4-1663aedea595 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:32.378225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af9695e2-87be-402f-a1ea-c7135e66d6be tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595" status: 404 len: 111 microversion: 2.1 time: 0.095704 Sep 14 09:30:32.383969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1890/2566] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:32 2022] GET /compute/v2.1/servers/3f5d5bfd-da1f-46a8-a9d4-1663aedea595 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:32.410543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1287126648", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "58087536-265f-45db-8384-06754201e344"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:32.565456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] validate_networks() for [('58087536-265f-45db-8384-06754201e344', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:30:34.483980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:30:34.484585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:30:34.485773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:30:34.485773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:30:34.485773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:30:34.512675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:34.513170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:34.513615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:34.514923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:34.523298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:34.525590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:34.601773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:34.617696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for user 4145151290094e15916c574647542ce3 and project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:34.664155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:30:34.669377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:30:34.826791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c2950e7-feb6-45df-a089-1b3dc5637fd7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440807 Sep 14 09:30:34.831550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1891/2567] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:30:34.851402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:34.852100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:34.891796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:34.901338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:34.908002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:34.911058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:34.911766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:34.913146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:35.903739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:35.914046 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac1eb3fe-8156-44ea-baf6-2f44de1a33ab tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 1.080762 Sep 14 09:30:35.925047 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1892/2568] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:34 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:35.942210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:35.944106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:35.974254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:35.975179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:35.977104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:36.002983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:36.006523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:36.010440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:37.972245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:37.988634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-571f0b3d-c81a-4ac5-a9b7-2a673f056fb5 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1578 microversion: 2.1 time: 2.061806 Sep 14 09:30:37.991089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1893/2569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:35 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1578 bytes in 2065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:38.008953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:38.012321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:38.029151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:38.036508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:38.037136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:38.038046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:38.038842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:38.039418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:38.309968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:38.327874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17dd4f22-673b-4dd1-a1a0-f103f5b87bb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1266 microversion: 2.1 time: 0.331689 Sep 14 09:30:38.334893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1894/2570] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:37 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1266 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:38.352042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:38.354777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:38.379126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:38.379840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:38.383538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:38.387692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:38.388794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:38.395772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:39.036402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:39.051327 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3bedb6fc-e966-4106-afff-c996846b0b6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.714997 Sep 14 09:30:39.076813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1895/2571] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:38 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:39.086720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b3da54-6896-4d24-af27-264326077136", "name": "network-vif-deleted", "tag": "2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:39.123204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:39.124834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:39.128318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:39.189260 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] Creating event network-vif-deleted:2bcc9c9b-4c1c-4b14-a5a9-9f7ba3003941 for instance 98b3da54-6896-4d24-af27-264326077136 on n-h1-851028-12 Sep 14 09:30:39.204936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-802f734f-a265-4059-b46a-4498158738ce req-1b4543e1-3fde-4e43-b64a-fc90c94e47d0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126665 Sep 14 09:30:39.206646 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1896/2572] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:39.220082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:39.223500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:39.231506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:39.232972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:39.234274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:39.235372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:39.236172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:39.236834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:39.735574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:39.760636 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72dcba5d-f3fa-46ed-8538-4870fa7c6056 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1571 microversion: 2.1 time: 0.549712 Sep 14 09:30:39.784682 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1897/2573] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:39 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1571 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:39.796534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:39.800488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:39.809433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:39.810293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:39.811111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:39.814870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:39.815709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:39.816490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:40.079150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:40.120931 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cfb269f-cc66-4ee3-aabb-166b349fcff1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1266 microversion: 2.1 time: 0.333451 Sep 14 09:30:40.123360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1898/2574] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:39 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1266 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:40.134329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:40.135242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:40.145645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:40.146771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:40.147356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:40.148939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:40.150273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:40.150946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:40.176319 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 HTTP/1.1 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8e5a9435-f248-4f27-a4f8-a5b98ebdaf31'} Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:40.180799 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:40.185202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:40.187359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f61f7623-2879-489c-a877-d2abd8a4f740 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 404 len: 111 microversion: 2.1 time: 0.062544 Sep 14 09:30:40.188974 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1899/2575] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:40 2022] DELETE /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:40.201379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1405338536"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:40.202278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:40.216598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:41.109458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.network.security_group_api [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Adding security group f5fff488-56d7-41db-95f7-0509411164eb to port cf29c7a7-fa85-4518-a861-fd82c3b31284 Sep 14 09:30:42.087757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-917c6e58-901f-4667-9f0f-ebee4047a95f tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action" status: 202 len: 0 microversion: 2.1 time: 1.893260 Sep 14 09:30:42.090735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1900/2576] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:40 2022] POST /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1/action => generated 0 bytes in 1901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:42.099090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:42.103221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:42.136861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.140331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.141079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:42.141993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.142640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.143295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:42.766132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:42.785359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef249974-a204-4e68-904f-ed627c91abe7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.691749 Sep 14 09:30:42.801807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1901/2577] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:42 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:42.810097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:42.811030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:42.818059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.818998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.819767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:42.820699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.822256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.822993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:42.879088 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 HTTP/1.1 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8e5a9435-f248-4f27-a4f8-a5b98ebdaf31'} Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:42.882211 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. Sep 14 09:30:42.890471 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:42.893708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:42.897285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31" status: 404 len: 111 microversion: 2.1 time: 0.094343 Sep 14 09:30:42.898160 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1902/2578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:42 2022] GET /compute/v2.1/servers/8e5a9435-f248-4f27-a4f8-a5b98ebdaf31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:42.904540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:42.907828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1aec160a-a512-46d5-b665-aca741974dff tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007672 Sep 14 09:30:42.921330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1903/2579] 10.222.0.90 () {56 vars in 886 bytes} [Wed Sep 14 09:30:42 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:30:42.933415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:42.934288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:42.942965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.943793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.944496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:42.945435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:42.946119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:42.946910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:44.206590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:44.226370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ac5ef28-d32f-42e5-b5be-c5197507a40f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1308 microversion: 2.1 time: 1.303533 Sep 14 09:30:44.226967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1904/2580] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:42 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1308 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:44.249605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d045f7-b5e7-4952-be1b-6d5db05308a0", "tag": "210417ba-40dc-4f25-87a9-c7ddb21269f9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:44.273515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:44.278222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:44.278864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:44.309159 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] Creating event network-changed:210417ba-40dc-4f25-87a9-c7ddb21269f9 for instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 on n-h2-851028-12 Sep 14 09:30:44.332552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cae5e57f-5a90-46be-8db6-e217efb2d845 req-e52a573d-6700-4a8b-9bc5-63c5103ccde8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087140 Sep 14 09:30:44.334004 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1905/2581] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:44.352643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f850790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:44.560411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:44.648867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:44.804567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f5fff488-56d7-41db-95f7-0509411164eb in use.", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:30:44.805214 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.805214 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb HTTP/1.1 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: exception: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f5fff488-56d7-41db-95f7-0509411164eb'} Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:30:44.807372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 400 to user: Security Group f5fff488-56d7-41db-95f7-0509411164eb in use. Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84266199-7e52-4a40-aa2b-492ea3c5d231'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:44.812033 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b187320-251f-4421-afb9-7b5c0b02dda0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb" status: 400 len: 185 microversion: 2.1 time: 0.473718 Sep 14 09:30:44.814531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1906/2582] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:30:44 2022] DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb => generated 185 bytes in 479 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:30:44.818450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb190708-b6cc-4d65-bfb8-bf93c43dbef1", "tag": "cf29c7a7-fa85-4518-a861-fd82c3b31284"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:44.855087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:44.855574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:44.856038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:44.890801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] Creating event network-changed:cf29c7a7-fa85-4518-a861-fd82c3b31284 for instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 on n-h1-851028-12 Sep 14 09:30:44.904795 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e5262b3b-2c42-404e-9d5e-e0af2d2b3d5a req-29a2cacb-eaa8-46fb-9061-3bc35402ceee service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089454 Sep 14 09:30:44.912290 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1907/2583] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:44.937759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:44.941213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:44.958386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:44.961789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:44.971318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:44.972354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:44.973014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:44.973600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:45.024818 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 HTTP/1.1 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7f946211-7fae-4e31-a023-f38a84f0eba0'} Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:45.029566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:45.034385 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:45.037654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:45.039163 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7027b67c-a144-426a-be61-28c46317700e tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 404 len: 111 microversion: 2.1 time: 0.125364 Sep 14 09:30:45.040239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1908/2584] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:44 2022] DELETE /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:45.065095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:45.066111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:45.083613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:45.084780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:45.085338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:45.088064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:45.088806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:45.090459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:45.903202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:45.916633 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0bcba400-3502-43ac-a975-4bf71778c7b7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1476 microversion: 2.1 time: 0.871460 Sep 14 09:30:45.923476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1909/2585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:45 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1476 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:45.931505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:45.933409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:45.955509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:45.956481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:45.958166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:45.960527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:45.961867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:45.963620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:46.050282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:30:46.217497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:46.261040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d516d62-da5c-46e0-b806-a8727f2b963d tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 204 len: 0 microversion: 2.1 time: 0.337739 Sep 14 09:30:46.270354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1910/2586] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:45 2022] DELETE /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:46.289574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:46.293174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 7f946211-7fae-4e31-a023-f38a84f0eba0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:46.310887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:46.314625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:46.316870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:46.319167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:46.322371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:46.324851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:46.393276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 HTTP/1.1 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7f946211-7fae-4e31-a023-f38a84f0eba0'} Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:46.403503 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 7f946211-7fae-4e31-a023-f38a84f0eba0 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:46.410088 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bba2804f-8385-49e2-a190-882d3bbd1c54 tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0" status: 404 len: 111 microversion: 2.1 time: 0.134434 Sep 14 09:30:46.410680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1911/2587] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:46 2022] GET /compute/v2.1/servers/7f946211-7fae-4e31-a023-f38a84f0eba0 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:46.449074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:46.454362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:46.488239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:46.490273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:46.495029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:46.500627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:46.503683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:46.505292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:46.587234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:30:47.241283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:47.256754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f70841ec-4578-4a11-a5d3-e6f05d9721fb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1308 microversion: 2.1 time: 0.845376 Sep 14 09:30:47.267951 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1912/2588] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:46 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1308 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:47.267951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:47.267951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:47.292419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:47.292838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:47.293286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:47.294020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:47.302433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:47.303011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:48.256192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:48.268031 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac477a6b-b364-41c1-8932-bb49b3af92da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1646 microversion: 2.1 time: 1.009149 Sep 14 09:30:48.269953 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1913/2589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:47 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1646 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:48.280827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:48.284272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:48.298815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:48.300903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:48.305624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:48.306640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:48.309862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:48.310601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:48.722496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:48.730554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f99d653-9d4e-41cd-8da5-109a008dc2f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1475 microversion: 2.1 time: 0.459552 Sep 14 09:30:48.731151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1914/2590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:48 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1475 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:48.747693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "name": "network-vif-unplugged", "status": "completed", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:48.791926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:48.792415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:48.792852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:48.832225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Creating event network-vif-unplugged:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h1-851028-12 Sep 14 09:30:48.872569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] Instance c481f44e-658d-472e-b40d-5fd7907281ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:30:48.902000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2057c26c-b065-41a6-abd6-5040d986af9e req-7c8434a4-11b9-46c9-9762-6fad0ee10cd7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169557 Sep 14 09:30:48.907971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1915/2591] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:48.933841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:48.934691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:48.948164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:48.948678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:48.958719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:48.959673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:48.960200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:48.960649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:49.725505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:49.743650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2018087f-a8e8-4561-a5d4-80643b87b5c5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1308 microversion: 2.1 time: 0.834164 Sep 14 09:30:49.750035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1916/2592] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:48 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:49.755630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:49.756724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:49.777443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:49.777952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:49.778397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:49.779108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:49.789281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:49.789996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:49.941132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:49.953933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14b73996-ddba-471a-8bbb-ddd00062bd57 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 200 len: 1467 microversion: 2.1 time: 0.200724 Sep 14 09:30:49.969503 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1917/2593] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:49 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 1467 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:49.989490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:49.990304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:50.001347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:50.003722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:50.010615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:50.011630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:50.012300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:50.012924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:51.050146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:51.059222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d48cf26a-c8cc-418a-bf84-e5d5730fb63a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1475 microversion: 2.1 time: 1.088368 Sep 14 09:30:51.065584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1918/2594] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:49 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1475 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:51.080671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb190708-b6cc-4d65-bfb8-bf93c43dbef1", "name": "network-vif-deleted", "tag": "cf29c7a7-fa85-4518-a861-fd82c3b31284"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:51.103165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:51.106557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:51.107313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:51.141002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] Creating event network-vif-deleted:cf29c7a7-fa85-4518-a861-fd82c3b31284 for instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 on n-h1-851028-12 Sep 14 09:30:51.154654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-168795ef-cb08-4b42-88d9-c06cc0fa1949 req-c038b70b-4473-492d-84af-18c8535f3caa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084745 Sep 14 09:30:51.155537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1919/2595] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:51.620065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-904bd741-8eb3-4258-ade2-044a97082718 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: .version_select at 0x7f693e9075e0>, body: {"keypair": {"name": "tempest-keypair-1797466476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIohcaxs+ARKUuN6VvaoUW3pGhyDzoIV3C3zUCT576QULuW/bM12xVT0z/CFR+debLI7VDCom7EuQUak7MWvnCj9rq/9x4QkCdcQzednxd8cYzDdP4UgIOXAcrhPD1iEgw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:51.647457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-904bd741-8eb3-4258-ade2-044a97082718 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:51.654440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-904bd741-8eb3-4258-ade2-044a97082718 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for user 116e4c7e83ce4e62b00dd7ce80aab5a2 and project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:51.723399 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-904bd741-8eb3-4258-ade2-044a97082718 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.566381 Sep 14 09:30:51.724865 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1920/2596] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:30:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 568 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:30:51.746329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:51.752751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:51.770222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:51.771668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:51.776018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:51.777655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:51.797989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:51.799103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.052007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:52.063291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efd60e36-296e-4e1a-83f0-757fc71a5821 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1308 microversion: 2.1 time: 0.337333 Sep 14 09:30:52.082915 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1921/2597] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:51 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:52.090199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:52.091276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:52.109972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.116282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.116821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.122040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.122613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.123069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.151535 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 HTTP/1.1 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cb190708-b6cc-4d65-bfb8-bf93c43dbef1'} Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:52.153255 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:52.158987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:52.159528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cc0316e-4f80-41e1-ac11-19eb45000431 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 404 len: 111 microversion: 2.1 time: 0.075226 Sep 14 09:30:52.159978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1922/2598] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:52 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:52.178229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:52.195497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.196011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.196449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.248119 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Creating event network-changed:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h1-851028-12 Sep 14 09:30:52.257476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] Instance c481f44e-658d-472e-b40d-5fd7907281ff is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:30:52.286230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-74b99482-85e2-41c2-b8de-33f20cdf8dbf req-a1446ac3-0de3-4d5a-83e3-8360aec71155 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123623 Sep 14 09:30:52.292114 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1923/2599] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:52.314657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:52.315194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:52.322970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.323472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.329712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.334526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:52.336061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:52.337707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:52.919875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:52.935867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8b52971d-8d9f-4f38-9afc-4d530ca83588 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1473 microversion: 2.1 time: 0.641558 Sep 14 09:30:52.954897 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1924/2600] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:52 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1473 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:52.962290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25e89d87-7e9d-48e4-9b68-8c5413a8c867 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f701310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:54.664939 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25e89d87-7e9d-48e4-9b68-8c5413a8c867 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833" status: 202 len: 0 microversion: 2.1 time: 1.711354 Sep 14 09:30:54.665655 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1925/2601] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:30:52 2022] DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833 => generated 0 bytes in 1713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:54.674491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:54.675321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:54.709411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:54.709932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:54.710383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:54.711112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:54.711576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:54.712132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.162630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:55.178569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a57188a-b87f-4a16-8e43-14ef3946c5cd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1308 microversion: 2.1 time: 0.510510 Sep 14 09:30:55.182179 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1926/2602] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:54 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1308 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:55.197992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:55.202399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:55.218948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:55.219694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:55.220351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.225516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:55.226235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:55.226862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.258630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 HTTP/1.1 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6f2949a7-438a-435e-a3f8-154fb1188e15'} Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:55.263486 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:55.269165 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:55.274031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:55.275187 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca1ca23e-746d-43cf-b552-960f1840424a tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 404 len: 111 microversion: 2.1 time: 0.090984 Sep 14 09:30:55.278468 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1927/2603] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:30:55 2022] DELETE /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:55.284217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d045f7-b5e7-4952-be1b-6d5db05308a0", "name": "network-vif-plugged", "status": "completed", "tag": "210417ba-40dc-4f25-87a9-c7ddb21269f9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:55.315818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:55.317016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:55.317736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.337756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] Creating event network-vif-plugged:210417ba-40dc-4f25-87a9-c7ddb21269f9 for instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 on n-h2-851028-12 Sep 14 09:30:55.349639 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ee147770-b7b9-42be-87f8-109a8a774a50 req-6a0dd702-a5fc-493b-8cb4-33c1f5f8e35f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069435 Sep 14 09:30:55.354003 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1928/2604] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:30:55.366265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:55.370197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:55.384162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:55.388578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:55.390077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.391128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:55.391793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:55.394063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:55.998843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:56.014497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-50755423-8ea9-4540-9566-e922b7b77ef5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1470 microversion: 2.1 time: 0.657513 Sep 14 09:30:56.015121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1929/2605] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:55 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1470 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:56.022743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e05e5041-4ee4-41ea-9c25-0b2ae4612380 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f8fe1f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:56.966908 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e05e5041-4ee4-41ea-9c25-0b2ae4612380 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb" status: 202 len: 0 microversion: 2.1 time: 0.949881 Sep 14 09:30:56.973626 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1930/2606] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:30:56 2022] DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:30:56.980155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:56.981323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] [instance: 6f2949a7-438a-435e-a3f8-154fb1188e15] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:57.008086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.013399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.013973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.016499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.016954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.019383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.054431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] HTTP exception thrown: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Request method failure captured: Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 HTTP/1.1 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ2DLQq4gR8nD1lVIGhy__A9DjdMMBkB4nDWXNyCacxzkw4a0NpG9PlUIRSNNyP_wRhuOsZ1f0Yzu1rqepsZzo_lnGoTnNMEfuzvo_qLyz9IFwrbwLwgA3BI28r36UnfPuY_J5Va3DEkgbVOdqwvyHpSxWfcLbl8SbhUZ1pBMeqlc9o Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c0b16a76f7234e4aa780e76c321aa8a3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c0b16a76f7234e4aa780e76c321aa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c0b16a76f7234e4aa780e76c321aa8a3"}]}] Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c0b16a76f7234e4aa780e76c321aa8a3 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-161273219 Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0f4798765d684da993cd6315ea8dbf9f Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeNegativeTest-161273219-project Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6f2949a7-438a-435e-a3f8-154fb1188e15'} Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:30:57.057047 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. Sep 14 09:30:57.062483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:30:57.064283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] Returning 404 to user: Instance 6f2949a7-438a-435e-a3f8-154fb1188e15 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:30:57.065837 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d36457ee-8b2d-48ff-88b3-459bbbba99fd tempest-AttachVolumeNegativeTest-161273219 tempest-AttachVolumeNegativeTest-161273219-project] 10.222.0.90 "GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15" status: 404 len: 111 microversion: 2.1 time: 0.090947 Sep 14 09:30:57.071207 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1931/2607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:56 2022] GET /compute/v2.1/servers/6f2949a7-438a-435e-a3f8-154fb1188e15 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:30:57.078473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:57.078473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:57.089748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.091431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.092909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.094805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.096287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.096753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.257698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78a7c849-55fd-4773-912d-7b75f4ecf045 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff/action" status: 204 len: 0 microversion: 2.1 time: 0.185062 Sep 14 09:30:57.259058 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1932/2608] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:30:57 2022] POST /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff/action => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:30:57.276044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:30:57.278034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:30:57.289046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.290048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.291030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:57.292189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:57.293824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:57.295459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:58.369088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:30:58.392009 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3de191dc-d8de-4c36-b128-f2071d1ff48d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1487 microversion: 2.1 time: 1.131619 Sep 14 09:30:58.408028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1933/2609] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:30:57 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1487 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:30:58.430118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-691269522", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc3713a2-3955-4c6d-8194-3c354d4a86d3"}], "security_groups": [{"name": "tempest-securitygroup--1373082056"}], "key_name": "tempest-keypair-1797466476", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:30:58.697801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] validate_networks() for [('fc3713a2-3955-4c6d-8194-3c354d4a86d3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:30:59.566637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:30:59.567212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:30:59.567805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:30:59.568281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:30:59.568701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:30:59.581546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:59.582389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:59.583225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:59.584457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:30:59.585001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:30:59.585509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:30:59.606563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:30:59.612852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for user 116e4c7e83ce4e62b00dd7ce80aab5a2 and project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:30:59.627559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:30:59.629949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:30:59.733481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4952e13a-330a-493d-9d23-280e670294b4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.323335 Sep 14 09:30:59.734555 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1934/2610] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:30:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:30:59.746618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d92768e6-625d-4e0f-b603-cef6420f98bb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'create', calling method: .version_select at 0x7f694408b550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1272596081", "description": "tempest-description-688627934"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:00.423370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d92768e6-625d-4e0f-b603-cef6420f98bb tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.686403 Sep 14 09:31:00.424596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1935/2611] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 09:30:59 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:00.431279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:00.434285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:00.456103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:00.458641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:00.459193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:00.460352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:00.462168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:00.463579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.333608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:01.336996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:01.354948 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a37b0b8a-1313-4f99-8f49-c55ad85273db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1462 microversion: 2.1 time: 0.928958 Sep 14 09:31:01.355693 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1936/2612] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:00 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1462 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:01.362745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "name": "network-vif-plugged", "status": "completed", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:01.384402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.387407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.389913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.422487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] Creating event network-vif-plugged:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h1-851028-12 Sep 14 09:31:01.430082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-62f609a3-60ad-47e5-9c91-c377c3ac06f0 req-9ca99bf0-b9b6-4241-af68-e8ba70d05466 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073328 Sep 14 09:31:01.435013 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1937/2613] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:01.442719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:01.453268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.454041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.454681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.490997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:31:01.572906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a436f978-ed87-48b5-b9a9-c4b36d23ff31 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0/action" status: 202 len: 0 microversion: 2.1 time: 0.131098 Sep 14 09:31:01.574200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1938/2614] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:31:01 2022] POST /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:31:01.600151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:01.603313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:01.622036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.622561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.623058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.623788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:01.624281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:01.624733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:01.866924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:01.897543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:01.908964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:01.911196 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1a5a9e3-658f-4c8c-a1ef-5695294fc4ad tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1341 microversion: 2.20 time: 0.335734 Sep 14 09:31:01.912083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1939/2615] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:01 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1341 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:01.918511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c0f7d2f-1c78-48a6-9ae2-1082845dc0ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Action: 'update', calling method: .version_select at 0x7f693e5a6700>, body: {"security_group": {"name": "tempest-sg-hth-1108612752", "description": "tempest-description-hth-1847111692"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:02.390429 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c0f7d2f-1c78-48a6-9ae2-1082845dc0ba tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "PUT /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb" status: 200 len: 218 microversion: 2.1 time: 0.476485 Sep 14 09:31:02.391247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1940/2616] 10.222.0.90 () {60 vars in 1290 bytes} [Wed Sep 14 09:31:01 2022] PUT /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb => generated 218 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:02.395756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:02.396541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:02.416862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.417743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.418421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:02.419361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.420509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.421179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:02.904317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb9b7794-b1d6-42e0-9ebd-0ef8f990e3d2 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1615 microversion: 2.1 time: 0.511808 Sep 14 09:31:02.905103 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1941/2617] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:02 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1615 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:02.924164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:02.930481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:02.945108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.949715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.950486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:02.954396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:02.954964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:02.955461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:03.529843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:03.544077 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-34f62c4c-7701-4a86-b524-fac104998a6c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.637458 Sep 14 09:31:03.567267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1942/2618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:02 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:03.573069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85f9b412-2e07-4f28-990b-4dcc83574b76 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e8cea60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:04.274991 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85f9b412-2e07-4f28-990b-4dcc83574b76 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb" status: 200 len: 218 microversion: 2.1 time: 0.706278 Sep 14 09:31:04.275844 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1943/2619] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:31:03 2022] GET /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb => generated 218 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:04.280494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ffeab4d0-f1df-4985-9e80-a604d222ff05 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '.version_select at 0x7f693e8ce700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:04.285288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffeab4d0-f1df-4985-9e80-a604d222ff05 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:04.290057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffeab4d0-f1df-4985-9e80-a604d222ff05 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:04.290730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffeab4d0-f1df-4985-9e80-a604d222ff05 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:04.300135 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ffeab4d0-f1df-4985-9e80-a604d222ff05 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.022910 Sep 14 09:31:04.314087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1944/2620] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:31:04 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:04.322952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:04.325753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:04.333279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:04.333844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:04.334439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:04.335148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:04.335602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:04.336052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:04.457306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:04.476177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:04.478699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:04.481004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b2deec8-9dbe-4330-b5d0-cce3a7b4aa6d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1339 microversion: 2.20 time: 0.165107 Sep 14 09:31:04.489220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1945/2621] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:04 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:04.494618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-037ed90e-256e-4b6c-bafe-0676b936fc2b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e8cee50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:05.194111 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-037ed90e-256e-4b6c-bafe-0676b936fc2b tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb" status: 202 len: 0 microversion: 2.1 time: 0.703550 Sep 14 09:31:05.195119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1946/2622] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:04 2022] DELETE /compute/v2.1/os-security-groups/0eafa9af-a773-4d65-9f68-f835b916ebdb => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:31:05.202939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:05.208015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:05.221484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:05.233628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:05.234226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:05.235214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:05.236375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:05.247057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:05.527334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:05.548499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f93cbdb0-0802-42a9-a4cb-b17c8309a59f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.351797 Sep 14 09:31:05.558725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1947/2623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:05 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:05.577842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1249464986", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:05.657796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:31:06.181240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:06.182610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:06.183309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:06.183959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:06.184584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:06.199733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.201341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.202606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.203739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.205383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.206216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.228948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:06.237988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:06.256882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:31:06.262454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:31:06.320617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:06.365131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86ac50d4-38eb-4a72-a7d6-a8e4db1e7268 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803364 Sep 14 09:31:06.367390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1948/2624] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:31:06.382074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:06.383052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:06.391057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.391799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.392485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.393577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.394204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.394793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.412104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 HTTP/1.1 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cb190708-b6cc-4d65-bfb8-bf93c43dbef1'} Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:06.414483 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:06.419311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:06.421793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:06.422709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d76ac7e-3495-47d3-875e-71fa26b77557 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 404 len: 111 microversion: 2.1 time: 0.054021 Sep 14 09:31:06.423497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1949/2625] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:06 2022] DELETE /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:06.428354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:06.429181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:06.436371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.437256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.437867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.438748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.439371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.440051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.827311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:06.845255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:06.846255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:06.853745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7534061-5632-44c3-a61d-cc653020889c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.429022 Sep 14 09:31:06.854845 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1950/2626] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:06 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:06.862174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:06.889715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:06.892482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:06.893296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:06.907757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] Creating event network-changed:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:31:06.917894 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-351a518b-33c8-4511-bdd3-aac1a01244db req-7f2082df-3529-43d5-8f4e-167a40355013 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061638 Sep 14 09:31:06.919173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1951/2627] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:06.925880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bf502e4-3ee3-47dc-b845-ea19e40b0c25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:06.927719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bf502e4-3ee3-47dc-b845-ea19e40b0c25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.037208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bf502e4-3ee3-47dc-b845-ea19e40b0c25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:07.045298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bf502e4-3ee3-47dc-b845-ea19e40b0c25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1213 microversion: 2.1 time: 0.123930 Sep 14 09:31:07.061352 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1952/2628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:06 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:07.068423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.069107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: cb190708-b6cc-4d65-bfb8-bf93c43dbef1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.076800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.077309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.077752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.078471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.079002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.079439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.097359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 HTTP/1.1 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cb190708-b6cc-4d65-bfb8-bf93c43dbef1'} Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.099023 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Instance cb190708-b6cc-4d65-bfb8-bf93c43dbef1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ef455a2-af25-4df1-a7ab-59fb66483f87 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1" status: 404 len: 111 microversion: 2.1 time: 0.037962 Sep 14 09:31:07.103148 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1953/2629] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:07 2022] GET /compute/v2.1/servers/cb190708-b6cc-4d65-bfb8-bf93c43dbef1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.106461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.107387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.130094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.130853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.131483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.132660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.133307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.133948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.380088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:07.392312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef48abb4-5097-4836-ba89-1852b2f504e3 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.290069 Sep 14 09:31:07.393643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1954/2630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:07 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:07.410754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f694408bee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.440520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.441429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group f5fff488-56d7-41db-95f7-0509411164eb not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.442069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.442069 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb HTTP/1.1 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f5fff488-56d7-41db-95f7-0509411164eb'} Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.444693 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group f5fff488-56d7-41db-95f7-0509411164eb does not exist Sep 14 09:31:07.449669 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-84bf9c45-7960-42c8-93f0-11670ed1e9d4'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.455924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1194b4b4-85ac-406a-b9a8-00dfd7e843da tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb" status: 404 len: 194 microversion: 2.1 time: 0.056283 Sep 14 09:31:07.455924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1955/2631] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/f5fff488-56d7-41db-95f7-0509411164eb => generated 194 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.465180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e35aca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.492729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.493896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group 1216a3c2-833d-450f-8c86-c28a22bb3833 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.494903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.494903 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833 HTTP/1.1 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1216a3c2-833d-450f-8c86-c28a22bb3833'} Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.500867 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group 1216a3c2-833d-450f-8c86-c28a22bb3833 does not exist Sep 14 09:31:07.505879 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-61b58fed-c5ce-4cf6-bddc-8e13590c108b'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.508828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e9f4749-32da-4c0e-a94a-5612bf966764 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833" status: 404 len: 194 microversion: 2.1 time: 0.045388 Sep 14 09:31:07.511047 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1956/2632] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/1216a3c2-833d-450f-8c86-c28a22bb3833 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.516920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693f9de9d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.541510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.542107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.542659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.542659 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d HTTP/1.1 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d'} Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.544515 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d does not exist Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-70aa8bf5-e4fd-47f2-a720-cd36d321282f'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11d88d8b-06b7-418a-bdc6-d21436adefaf tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d" status: 404 len: 194 microversion: 2.1 time: 0.033915 Sep 14 09:31:07.549579 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1957/2633] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/d9fe5d7b-48f6-4fe4-95f7-4aa2cb16c08d => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.556303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e946af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.582793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.583952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group a553be81-9169-4c39-b6be-ff036589c7be not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.585000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.585000 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be HTTP/1.1 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a553be81-9169-4c39-b6be-ff036589c7be'} Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.587208 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group a553be81-9169-4c39-b6be-ff036589c7be does not exist Sep 14 09:31:07.592358 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-88edeb9a-b399-4dd2-a1e1-8febbc780d7e'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.595499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-beb40f2c-f19b-4b48-ba7b-25d21db543e8 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be" status: 404 len: 194 microversion: 2.1 time: 0.039557 Sep 14 09:31:07.596399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1958/2634] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/a553be81-9169-4c39-b6be-ff036589c7be => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.602328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f694408bee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.635209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.635976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group cdc698f2-4e20-4464-a0d6-f2015977eb68 not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.636599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.636599 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68 HTTP/1.1 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cdc698f2-4e20-4464-a0d6-f2015977eb68'} Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.639679 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group cdc698f2-4e20-4464-a0d6-f2015977eb68 does not exist Sep 14 09:31:07.644346 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-b658701d-5fe4-4927-8f20-ac66dd4f4bb4'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.647879 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e41ad345-cc66-46cb-b058-e9bc199cb8f7 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68" status: 404 len: 194 microversion: 2.1 time: 0.049631 Sep 14 09:31:07.648755 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1959/2635] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/cdc698f2-4e20-4464-a0d6-f2015977eb68 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:31:07.661858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e5a6670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.696356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG neutronclient.v2_0.client [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist", "detail": ""}} {{(pid=122444) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:31:07.696956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.security_group_api [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Neutron security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d not found {{(pid=122444) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 14 09:31:07.697483 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.697483 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d HTTP/1.1 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: exception: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '32a6fe5c-5f32-4581-bec1-3f87f1e69f0d'} Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 14 09:31:07.699619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Security group 32a6fe5c-5f32-4581-bec1-3f87f1e69f0d does not exist Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: Neutron server returns request_ids: ['req-3f84a8cd-dee3-43c1-acd5-d52974e24c9e'] {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:07.705992 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8566e7d-8aa4-4ce1-939b-0d7a36fbb930 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d" status: 404 len: 194 microversion: 2.1 time: 0.047722 Sep 14 09:31:07.712656 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1960/2636] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/os-security-groups/32a6fe5c-5f32-4581-bec1-3f87f1e69f0d => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:07.712656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.713164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.719991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.720486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.720920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.721687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.722074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.722494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.752164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:31:07.846916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d21bbc10-c9dd-4b91-a9f2-762580294a17 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 204 len: 0 microversion: 2.1 time: 0.138261 Sep 14 09:31:07.847618 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1961/2637] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:07 2022] DELETE /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:07.860092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:07.860921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:07.868173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.868675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.869114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:07.869959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:07.870865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:07.871465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.058065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.069559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f16679cb-d3f6-4a76-a36b-04419ef44f15 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1647 microversion: 2.1 time: 0.215579 Sep 14 09:31:08.070581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1962/2638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:07 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1647 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:08.077473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:08.078214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:08.084617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.085683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.086571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.088465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.089018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.089659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.359591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.390531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.397693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.400851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b91f3c6-e50e-48a2-a566-88e87c208ddb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.328466 Sep 14 09:31:08.401590 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1963/2639] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:08 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:08.409221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:08.410237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:08.420112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.421124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.421810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.422765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.424034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.425018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.519603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.526092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:08.534487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a02ff678-5997-47e7-8a07-2deb896c607d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1265 microversion: 2.1 time: 0.131171 Sep 14 09:31:08.547927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1964/2640] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:08 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:08.547927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:08.547927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:08.560263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.564243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.564782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.565734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:08.566308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:08.566839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:08.959985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:08.978166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a985632-9745-4c3a-b422-b8f16097aafa tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.438022 Sep 14 09:31:08.980514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1965/2641] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:08 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:09.096188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:09.096816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:09.105226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.108536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.109110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.109887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.110289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.110774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.390337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:09.402822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2610d4a-ee90-45b5-b52d-2f8163dd0ed0 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1647 microversion: 2.1 time: 0.311905 Sep 14 09:31:09.403496 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1966/2642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:09 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1647 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:09.442124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:09.442888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:09.449560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.450762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.452957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.453906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.454553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.455170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.836988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:09.855109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:09.865396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:09.868822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e53eb26f-4fd6-4329-ad43-1634c139abbd tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.430777 Sep 14 09:31:09.873078 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1967/2643] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:09 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:09.892046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:09.892917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:09.913296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.914299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.915776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:09.917192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:09.921323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:09.922109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.454803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:10.469817 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f79b96dc-2688-4160-9471-ae3a20c4d36b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.592884 Sep 14 09:31:10.470693 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1968/2644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:09 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:10.481125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:10.483004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:10.501206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.501738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.503259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.505307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.505972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.508501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.863389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:10.880474 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5de7b601-bed9-4042-a91b-7c8fdb149790 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.405818 Sep 14 09:31:10.884260 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1969/2645] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:10 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:10.896349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:10.901691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:10.938491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.941734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.942365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:10.945675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:10.947543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:10.948775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.061261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.061767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.062662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.070062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lazy-loading 'fault' on Instance uuid d2b4e507-56b5-4a31-855d-ff62a361bd92 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:31:11.157918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5820e680ab554514ace9c0619d913a47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4741b9fcd214ebab758c2effdf6b09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:11.173789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cf2e8f5-d3d6-49a7-8bf1-89177a44ad09 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 200 len: 1306 microversion: 2.1 time: 0.285286 Sep 14 09:31:11.199909 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1970/2646] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:10 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 1306 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:11.207250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b4e507-56b5-4a31-855d-ff62a361bd92", "name": "network-vif-deleted", "tag": "ca8c130a-5b65-49f3-816d-9a0992114c0a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:11.223104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.223922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.224555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.241948 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] Creating event network-vif-deleted:ca8c130a-5b65-49f3-816d-9a0992114c0a for instance d2b4e507-56b5-4a31-855d-ff62a361bd92 on n-h2-851028-12 Sep 14 09:31:11.247278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-eac92b9e-c775-4e80-a76d-b2f16b4af6c2 req-f367c923-bd64-4ac3-85de-8de6d984a88e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Sep 14 09:31:11.248909 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1971/2647] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:11.255985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:11.257014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:11.264767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.265270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.265711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.266439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.266883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.267797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.642687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:11.654722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:11.657221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:11.658645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08f22ff5-4f93-4c43-b001-3ffbf6cca704 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.407532 Sep 14 09:31:11.659529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1972/2648] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:11 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:11.664361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:11.665365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:11.674256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.675202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.675861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.677345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.678024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.679046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.896220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:11.907755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-902c3a92-8a10-46fa-8975-27b0de34a9f6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.246904 Sep 14 09:31:11.908398 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1973/2649] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:11 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:11.915690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:11.925945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.926409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.926989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.942365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] Creating event network-changed:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h1-851028-12 Sep 14 09:31:11.947457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4527f8f1-26be-4023-a22d-8642cdfd180d req-99927ef9-0b85-4612-8a9a-4c03f8cba473 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037752 Sep 14 09:31:11.948442 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1974/2650] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:11.954481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:11.955259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:11.962152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.962643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.963072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:11.964005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:11.964465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:11.965067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:12.163720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:12.169916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f0c187b-0d6c-4e45-8b27-9775fceb2466 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.220210 Sep 14 09:31:12.170741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1975/2651] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:11 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:12.225952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:12.226573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] [instance: d2b4e507-56b5-4a31-855d-ff62a361bd92] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:12.237269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:12.237767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:12.238202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:12.238912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:12.239354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:12.239780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:12.255055 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] HTTP exception thrown: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Request method failure captured: Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 HTTP/1.1 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ7gXehp8PijbBdnp3mBzMBNDU3tByYsJVAY9dalHKJlcFWl1_Ljyi69DVFD_36NiD22ztECg7VQCGa7L-iFvCtKPasjUTC7nQ58oDuMYELt1BseI8Hr7pZojTmjGZAfNNGQEnaX-9HOgQWwLsKy5c7ms0ESw-u9I74FhPcQqgYrqAY Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c4741b9fcd214ebab758c2effdf6b09a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c4741b9fcd214ebab758c2effdf6b09a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c4741b9fcd214ebab758c2effdf6b09a"}]}] Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c4741b9fcd214ebab758c2effdf6b09a Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1344697220 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5820e680ab554514ace9c0619d913a47 Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-SecurityGroupsTestJSON-1344697220-project Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd2b4e507-56b5-4a31-855d-ff62a361bd92'} Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:31:12.257060 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Returning 404 to user: Instance d2b4e507-56b5-4a31-855d-ff62a361bd92 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3aa9e345-650c-45cb-b7ff-8be436b3b373 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92" status: 404 len: 111 microversion: 2.1 time: 0.043961 Sep 14 09:31:12.261731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1976/2652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:12 2022] GET /compute/v2.1/servers/d2b4e507-56b5-4a31-855d-ff62a361bd92 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:31:12.267614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3cbee987-6460-4c2c-b6ce-6c655e5d431c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e5a6310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:12.552601 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3cbee987-6460-4c2c-b6ce-6c655e5d431c tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/4ed2a85e-5a22-4a16-bcce-ae98b3f2d33f" status: 202 len: 0 microversion: 2.1 time: 0.289378 Sep 14 09:31:12.553631 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1977/2653] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:12 2022] DELETE /compute/v2.1/os-security-groups/4ed2a85e-5a22-4a16-bcce-ae98b3f2d33f => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:31:12.564165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b20c90c-2685-46c5-a246-645ac5ffe3d2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] Calling method '.version_select at 0x7f693e35a280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:12.940499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b20c90c-2685-46c5-a246-645ac5ffe3d2 tempest-SecurityGroupsTestJSON-1344697220 tempest-SecurityGroupsTestJSON-1344697220-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/089528d4-e258-450c-b804-01a743160d70" status: 202 len: 0 microversion: 2.1 time: 0.382523 Sep 14 09:31:12.941196 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1978/2654] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 09:31:12 2022] DELETE /compute/v2.1/os-security-groups/089528d4-e258-450c-b804-01a743160d70 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:31:12.949391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "name": "network-vif-plugged", "status": "completed", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:12.975515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:12.976442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:12.977908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.015970 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] Creating event network-vif-plugged:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:31:13.024068 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f7bbc404-e798-4ffd-a42f-4d7b87802f06 req-e4f5a43b-417e-4dc1-bee2-f0a50213217c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078435 Sep 14 09:31:13.026318 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1979/2655] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:13.033545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:13.034501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:13.042372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.042976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.043517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.044351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.046118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.046781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.250005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.262729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.269137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.273050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4b24bf7-27b3-4ea2-b52b-a02c0f310126 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.245133 Sep 14 09:31:13.275808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1980/2656] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:13 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:31:13.298509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:13.298509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:13.311885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.312711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.313173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.315914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.316998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.317467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.605846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.618060 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22f0f3f8-2007-4a13-b340-78362b0c8c7c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.341020 Sep 14 09:31:13.618670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1981/2657] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:13 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:13.625082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:13.626524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:13.634268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.635010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.636359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.638854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:13.640059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:13.640800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:13.876144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:13.885545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52f53595-a499-425f-af81-86d8739cdc0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.265407 Sep 14 09:31:13.886370 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1982/2658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:13 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:14.305659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:14.306999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:14.313857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.314568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.315167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.316077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.316711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.317299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.566070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:14.583359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:14.587296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:14.590249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17bdc6dd-db96-4d9b-8119-3a1465c2aefb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1407 microversion: 2.20 time: 0.288511 Sep 14 09:31:14.597276 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1983/2659] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:14 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:31:14.648178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:14.649027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:14.657154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.658056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.658701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.659744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.660425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.661520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.908817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:14.916725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51ee54ca-6181-4670-b5eb-92fb365baf25 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.275233 Sep 14 09:31:14.917284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1984/2660] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:14 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:14.923786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:14.924648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:14.930802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.931503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.932158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:14.933042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:14.933641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:14.934211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.120968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:15.125178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:15.141942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac0fb0d1-3297-456a-9cc1-bb99da199cbe tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.222631 Sep 14 09:31:15.146190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1985/2661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:14 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:15.626563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:15.627264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:15.641227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.642026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.643201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.644286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.644910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.645500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.885350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:15.904540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:15.904540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:15.907884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-716eb931-97ea-48f6-8d89-d4f3349cd5a9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1599 microversion: 2.20 time: 0.284866 Sep 14 09:31:15.921218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1986/2662] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:15 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1599 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:31:15.931317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:15.932068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:15.947307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.948558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.949316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:15.951984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:15.954192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:15.954833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:16.079125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a06cbe3-cb80-442f-bc70-b0fa82cba9cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151862 Sep 14 09:31:16.080291 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1987/2663] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:31:15 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:31:16.094376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:16.095122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:16.105034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:16.109644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:16.110422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:16.111798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:16.112418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:16.112947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:16.220333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:16.988448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:17.002683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3c6dfc8-ea70-4101-8880-fea39d3d8dd7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.920174 Sep 14 09:31:17.004940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1988/2664] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:16 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:17.020950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:17.022829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:17.047246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.056577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:17.567576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:17.579078 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ab1989b-63ce-49d1-aff8-cab791522ce6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.569146 Sep 14 09:31:17.580171 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1989/2665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:17 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:17.595913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "name": "network-vif-plugged", "status": "completed", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:17.607934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:17.608424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:17.608859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:17.622064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] Creating event network-vif-plugged:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h1-851028-12 Sep 14 09:31:17.628150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ad3a82af-8db3-427e-ae5c-76c469ff2db9 req-f1a15995-47fe-41f8-a60a-1f2990604078 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046722 Sep 14 09:31:17.629398 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1990/2666] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:18.031574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:18.032402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:18.062657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.063467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.064262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.065194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.067122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.067856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.637340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:18.649533 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b294c0a3-2a5c-4e90-9d58-169830e174e3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1313 microversion: 2.1 time: 0.622506 Sep 14 09:31:18.656139 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1991/2667] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:18 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:18.670934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:18.671611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:18.682262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.683093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.683624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:18.685163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:18.685698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:18.686894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.081103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:19.089934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8aa0c2ca-5523-435b-837b-e69bbff82acb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.433166 Sep 14 09:31:19.106104 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1992/2668] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:18 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:19.266793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:19.286241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.287044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.290099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.326884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] Creating event network-changed:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:31:19.343317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-75fb703f-1ccd-45e7-960c-f24acb3dc498 req-dc2921ff-6c2c-4af7-a1ab-4fec4ec8e9bf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082036 Sep 14 09:31:19.345422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1993/2669] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:19.677627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:19.678960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:19.695112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.695760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.696934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:19.699236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:19.701081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:19.702450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.194020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:20.208968 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d54d94f5-4335-4886-a811-eadd19b71734 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1463 microversion: 2.1 time: 0.535907 Sep 14 09:31:20.210269 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1994/2670] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:19 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1463 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:20.218494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:20.221063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:20.244393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.244974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.247100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.249497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.252125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.253601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.856419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:20.868375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d299fd9b-fc47-428d-b98e-d7c7ec4ff89f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.655400 Sep 14 09:31:20.868976 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1995/2671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:20 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:20.880730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:20.883283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:20.899553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.901425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.901878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:20.904393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:20.909801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:20.910343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.123979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:21.133873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Old instance type m1.heat2, new instance type m1.heat {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:31:21.148922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:21.149349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:21.155629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:21.156329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:21.158066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:21.348852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c617b3bf-0d39-409d-ad6d-bac36aa842a4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1/action" status: 202 len: 0 microversion: 2.1 time: 0.477329 Sep 14 09:31:21.352837 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1996/2672] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:31:20 2022] POST /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:31:21.358136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:21.358957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:21.375405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.376156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.377313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.378235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.379045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.381149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.566366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:21.580871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-365f1380-d605-471a-82c3-c8d2378982eb tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1472 microversion: 2.1 time: 0.226464 Sep 14 09:31:21.583021 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1997/2673] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:21 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:21.899405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:21.900633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:21.917839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:21.967425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.970190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.972314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:21.977446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:21.978872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:21.981422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:22.218790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:22.230638 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7874fb06-801d-4d23-a1c6-addc33886f69 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.340690 Sep 14 09:31:22.232327 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1998/2674] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:21 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:22.613010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:22.613646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:22.623177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:22.624567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:22.626100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:22.627318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:22.628327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:22.629102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:23.193733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:23.203422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f80b7d6-f0d9-4471-b3b7-25b4feb2f935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1472 microversion: 2.1 time: 0.599852 Sep 14 09:31:23.219653 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 1999/2675] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:22 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1472 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:23.260004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:23.260770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:23.279591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:23.280095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:23.284626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:23.286231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:23.288647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:23.290689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:23.465069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:23.475265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91265d0e-1066-494a-b481-c91fb57d8172 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.219330 Sep 14 09:31:23.485248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2000/2676] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:23 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:24.211877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:24.213719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.214455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.214858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.215750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.216335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.217221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.273546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4845fae6-2c87-43f7-87f9-967bc81972ec tempest-AZV2TestJSON-1226018938 tempest-AZV2TestJSON-1226018938-project] 10.222.0.90 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.304958 Sep 14 09:31:24.274229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2001/2677] 10.222.0.90 () {58 vars in 1164 bytes} [Wed Sep 14 09:31:23 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:31:24.279767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:24.280655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:24.291396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.291930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.293359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.294298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.295318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.297263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.573938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:24.593026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5dfb0f0-3d7d-4fb5-9d66-2bab29a5f0f3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1472 microversion: 2.1 time: 0.316125 Sep 14 09:31:24.593989 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2002/2678] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:24 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:24.599747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:24.600685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:24.608621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.609428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.610091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.611267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:24.612168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:24.613231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:24.635045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:24.858811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:24.871613 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-436682cd-1064-4003-9420-8430e53dd3f8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.275607 Sep 14 09:31:24.872700 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2003/2679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:24 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:25.626766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:25.628314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:25.639979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.640776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.641816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.643529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.644613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.645886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.856427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:25.866337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b327dfe3-eddd-4717-af9c-30270f432904 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.250979 Sep 14 09:31:25.867032 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2004/2680] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:25 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:25.905920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:25.905920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:25.911576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.912098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.912576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:25.913348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:25.914086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:25.914519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.062336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:26.071486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2876fe8-a164-4b3d-9c7d-e86526c70619 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1497 microversion: 2.1 time: 0.175166 Sep 14 09:31:26.072117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2005/2681] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:25 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:26.892887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:26.893679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:26.910072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.911222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.912003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:26.913368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:26.914162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:26.915016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.097099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:27.109941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e88c87fb-73a7-4f8d-84a5-ed94987814ca tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.221751 Sep 14 09:31:27.110539 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2006/2682] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:26 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:27.129613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:27.130980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:27.142524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.143222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.143832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.145087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.146286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.146717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.364671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:27.376105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce2ac76f-222f-49a8-923e-aeb00c19e4bd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 200 len: 1474 microversion: 2.1 time: 0.264468 Sep 14 09:31:27.378701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2007/2683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:27 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 1474 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:27.400929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1134950114"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:27.404936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:27.415630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.416157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.416727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.426833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:27.427642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:27.428338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:27.821766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f89ce37-465f-4b05-84ac-a1f60a9c211f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0/action" status: 202 len: 0 microversion: 2.1 time: 0.424481 Sep 14 09:31:27.823106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2008/2684] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:31:27 2022] POST /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 14 09:31:27.837749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cd9d62a-66aa-40d1-a72e-60ec4c5a537e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2ed670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:27.924580 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cd9d62a-66aa-40d1-a72e-60ec4c5a537e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.091792 Sep 14 09:31:27.927581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2009/2685] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:27 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:28.155934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:28.157773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:28.167152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:28.168099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:28.169147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:28.172138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:28.173499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:28.174486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:28.379137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:28.394244 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f5b4aab-a185-4a82-8b00-53069874783b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.244730 Sep 14 09:31:28.411682 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2010/2686] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:28 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:28.941085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cb0f900-24bd-46e0-a50e-981d61e8a853 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e487280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:29.025064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cb0f900-24bd-46e0-a50e-981d61e8a853 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.087893 Sep 14 09:31:29.025908 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2011/2687] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:28 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:29.779157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Calling method '.version_select at 0x7f693e2f2a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:29.781165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.781656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.782094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.809699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.811066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.811525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.832110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.832985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.833977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.848532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c04453aa-5dc6-47b7-827b-32262c93b39d tempest-PortsAdminExtendedAttrsTestJSON-1990281014 tempest-PortsAdminExtendedAttrsTestJSON-1990281014-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.460790 Sep 14 09:31:29.849619 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2012/2688] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:31:29 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:29.855116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:29.856156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:29.865414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.866342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.866985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:29.867794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:29.868398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:29.869046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:30.136140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:30.146298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3e9301c-42b9-4e91-86a8-ccf3bdb64c6d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.295401 Sep 14 09:31:30.146912 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2013/2689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:29 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:30.153023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2f16a80-994a-4f3a-b5fb-296e0051d599 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e487670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:30.265191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2f16a80-994a-4f3a-b5fb-296e0051d599 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.117170 Sep 14 09:31:30.266115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2014/2690] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:30 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:31.175318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:31.177024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:31.194643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:31.197434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:31.197890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:31.200625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:31.202787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:31.203352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:31.624861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:31.634587 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9299b883-5f57-47de-894c-9069783c202b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.464019 Sep 14 09:31:31.659029 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2015/2691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:31 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:31.664090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5959c7a-d633-43be-b841-98ea1efc82a7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e5a6d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:31.823976 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5959c7a-d633-43be-b841-98ea1efc82a7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.163673 Sep 14 09:31:31.824873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2016/2692] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:31 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:32.667573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:32.668247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:32.680309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:32.695774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:32.696733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:32.697928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:32.698574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:32.699175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:33.368231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:33.387462 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d80b31e-e301-4531-8885-11e0dca05e5b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.721571 Sep 14 09:31:33.388863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2017/2693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:32 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:33.399166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-212c6eb6-c020-4212-8de5-3219a71a2c97 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e4984c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:33.502965 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-212c6eb6-c020-4212-8de5-3219a71a2c97 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.111624 Sep 14 09:31:33.503322 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2018/2694] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:33 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:34.420155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:34.421057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:34.439501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:34.447515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.451231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.457461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:34.459205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:34.464721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:34.465843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:36.142483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:36.175265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-124ee5a4-57c7-44ab-adac-6a9823c16f6c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 1.748209 Sep 14 09:31:36.175607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2019/2695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:34 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:36.204985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-12e55dda-acf6-4b2d-8586-94df38930b0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e4afc10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:36.319329 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-12e55dda-acf6-4b2d-8586-94df38930b0e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.141996 Sep 14 09:31:36.326370 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2020/2696] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:36 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:36.387373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d045f7-b5e7-4952-be1b-6d5db05308a0", "name": "network-vif-plugged", "status": "completed", "tag": "210417ba-40dc-4f25-87a9-c7ddb21269f9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:36.416074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:36.416475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:36.417097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:36.446261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] Creating event network-vif-plugged:210417ba-40dc-4f25-87a9-c7ddb21269f9 for instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 on n-h2-851028-12 Sep 14 09:31:36.461667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b9ea4cdb-9cbe-4ccd-8a44-7ae2f2757808 req-ae0bf673-c948-4428-9f03-da8cdd84e26e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133501 Sep 14 09:31:36.465121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2021/2697] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:37.632090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-946919742", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:37.754066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:31:38.440307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:38.441405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:38.443847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:38.444426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:38.447188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:38.473128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.474345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.476010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.480400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.484197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.486246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.536894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:38.556335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:38.603594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:31:38.607341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:31:38.704799 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a2c682e-97e0-44af-835e-f6f80b62774d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.690309 Sep 14 09:31:38.712134 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2022/2698] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:31:38.723178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:38.725577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:38.748155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.748679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.749122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:38.752303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:38.752863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:38.753282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:39.033984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:39.043324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4623699b-b3d0-45ff-a37d-bab9ac2255c8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.329958 Sep 14 09:31:39.045256 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2023/2699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:38 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:39.050603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82e320a8-b19c-4378-beb8-a0eed2e98e3b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e293b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:39.129985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82e320a8-b19c-4378-beb8-a0eed2e98e3b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.083416 Sep 14 09:31:39.132474 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2024/2700] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:39 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:39.145689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b0997fe-49f6-4199-9240-b2918af53f17 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:39.146487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b0997fe-49f6-4199-9240-b2918af53f17 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:39.251030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b0997fe-49f6-4199-9240-b2918af53f17 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:39.273483 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b0997fe-49f6-4199-9240-b2918af53f17 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1214 microversion: 2.1 time: 0.137585 Sep 14 09:31:39.275455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2025/2701] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:39 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:40.083073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:40.083754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:40.107437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.108694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.115123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:40.116253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.116938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.117797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:40.448578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:40.469514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a084722-9ba1-4c64-9daa-262685243a3e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.383203 Sep 14 09:31:40.469514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2026/2702] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:40 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:40.478176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b97adc6d-e625-4b43-ad50-abe4fa83bf17 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2abaf0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:40.579221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b97adc6d-e625-4b43-ad50-abe4fa83bf17 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.114226 Sep 14 09:31:40.579831 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2027/2703] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:40 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:40.602792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:40.604372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:40.626147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.628010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.628724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:40.631333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:40.636884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:40.638963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:41.125759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:41.155965 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa6f3ad0-6232-4c9a-96d3-533f6d14b4c4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1266 microversion: 2.1 time: 0.574948 Sep 14 09:31:41.169740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2028/2704] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:40 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1266 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:41.495694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:41.496572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:41.510104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:41.512697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:41.513262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:41.516885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:41.517494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:41.517948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:41.590924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:42.003551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:42.018339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8cb3c6f-fd5f-44b0-98b6-97ec2c707fe1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.524956 Sep 14 09:31:42.018997 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2029/2705] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:41 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:42.037184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81b5b8fd-8cf9-4701-ba88-a19cb322c6e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2edaf0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:42.117280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81b5b8fd-8cf9-4701-ba88-a19cb322c6e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.097166 Sep 14 09:31:42.119679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2030/2706] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:42 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:42.186890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:42.188260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:42.219664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:42.223088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:42.225650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:42.237532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:42.238173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:42.238633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:42.431839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:42.445251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9e0b499-0a1a-4961-abce-6d2f9dcadbc9 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1272 microversion: 2.1 time: 0.264963 Sep 14 09:31:42.452301 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2031/2707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:42 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:43.049671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:43.050591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:43.065562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.071992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.083250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:43.085794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.087478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.088647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:43.471022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:43.484138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a5abade-166e-4d7e-a461-b87e5885dedd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.438980 Sep 14 09:31:43.500070 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2032/2708] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:43 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:43.519304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9da65f7-300b-4ecc-83e6-ed0f8f062a86 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2f24c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:43.592150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9da65f7-300b-4ecc-83e6-ed0f8f062a86 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.087905 Sep 14 09:31:43.593005 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2033/2709] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:43 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:43.598874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:43.599750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:43.621165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.621671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.622722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:43.623584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:43.626837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:43.627514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.064309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:44.117712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21fcb354-a8a2-4feb-b4a6-40c556d48892 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.522265 Sep 14 09:31:44.138997 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2034/2710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:43 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:44.496079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6968209c-625c-49f8-abd8-436e9fdede63", "tag": "94c59e09-9b82-4073-94f8-0fc4b454f362"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:44.529504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:44.530007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:44.530443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.567630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] Creating event network-changed:94c59e09-9b82-4073-94f8-0fc4b454f362 for instance 6968209c-625c-49f8-abd8-436e9fdede63 on n-h2-851028-12 Sep 14 09:31:44.583267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-50593b0b-bb75-489b-a4ed-a99acb95d191 req-5b2704a9-c672-4e0b-9677-ee396a3bd888 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099845 Sep 14 09:31:44.584589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2035/2711] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:44.594180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:44.595320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:44.603495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:44.604372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:44.605145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.606104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:44.607466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:44.608820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:44.931944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:44.948014 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca8821f5-5dfc-4aba-a8f7-9f82fcb4dc6b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.359152 Sep 14 09:31:44.959116 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2036/2712] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:44 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:44.977508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f91d2ab3-8248-41e7-ac7d-911b9dd4563b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e5a6d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:45.049281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f91d2ab3-8248-41e7-ac7d-911b9dd4563b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.088845 Sep 14 09:31:45.050168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2037/2713] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:44 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:45.156355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:45.157164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:45.165715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.166924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.167774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:45.168834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.170234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.171846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:45.455997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:45.468299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8631a089-028b-4fc4-9e09-ba27423e0c2d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.321555 Sep 14 09:31:45.484073 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2038/2714] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:45 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:45.987649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:45.988332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:45.994811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.995560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.995728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:45.996481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:45.996968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:45.997741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:46.256800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:46.269321 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a41718cf-61d7-441b-8899-b1c5ab4b90e8 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.285423 Sep 14 09:31:46.270253 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2039/2715] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:45 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:46.276732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8431c5f2-e633-40e3-927b-80186bcb241a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2edee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:46.359378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8431c5f2-e633-40e3-927b-80186bcb241a tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.086150 Sep 14 09:31:46.369147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2040/2716] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:46 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:46.494985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:46.495697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:46.509693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:46.510940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:46.511465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:46.518713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:46.519528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:46.520084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:47.451717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:47.468884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86aba7ee-3b20-4dcc-8be1-5c028f0856da tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.978761 Sep 14 09:31:47.469778 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2041/2717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:46 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:47.474413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:47.475015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:47.495782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:47.496299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:47.497541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:47.498698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:47.499415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:47.500123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:47.780220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:47.800979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-010c5408-b75c-45b9-9ec2-9b371671ea79 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.327987 Sep 14 09:31:47.802591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2042/2718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:47 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:47.812528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dae6d2f8-40ca-4f57-89bd-bc085d5eabb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e23f8b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:47.907449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dae6d2f8-40ca-4f57-89bd-bc085d5eabb0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.102006 Sep 14 09:31:47.912738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2043/2719] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:47 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:48.498808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:48.499538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:48.512456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:48.516793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.517656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.518341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.519285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.520120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.520890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.772104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:48.790501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8dd71980-733f-4ca9-9b8d-f7a0709fafd2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.296498 Sep 14 09:31:48.792537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2044/2720] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:48 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:48.832959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:48.833846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:48.855264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.856931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.858125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:48.860512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:48.861938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:48.864930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:49.270343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:49.691408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:49.717735 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b426b175-a410-4579-ab9b-dfeccd365e98 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.889112 Sep 14 09:31:49.721975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2045/2721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:48 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:49.743654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fcb9180-d792-4ad2-9bae-1ad8afe7f869 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e23faf0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:49.869065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fcb9180-d792-4ad2-9bae-1ad8afe7f869 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.145762 Sep 14 09:31:49.869833 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2046/2722] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:49 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:49.889626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:49.892293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:49.913598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:49.915647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:49.916288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:49.918585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:49.922061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:49.922883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:50.194448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:50.206312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ed17fb5-906e-49dc-99f1-cadce832ffde tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.333925 Sep 14 09:31:50.207355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2047/2723] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:49 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:50.756720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:50.757346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:50.784489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:50.785327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:50.785778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:50.789193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:50.789694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:50.790139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:51.193228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:51.206988 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1e02dac-199e-4f68-9430-dfbf14ed0ab7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.464116 Sep 14 09:31:51.213080 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2048/2724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:50 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:31:51.231880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a57b407c-9fdb-40cb-8043-c29d5db0ecfd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2fd3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:51.298450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a57b407c-9fdb-40cb-8043-c29d5db0ecfd tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1412 microversion: 2.1 time: 0.078215 Sep 14 09:31:51.307701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2049/2725] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:51 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:51.540187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6968209c-625c-49f8-abd8-436e9fdede63", "name": "network-vif-plugged", "status": "completed", "tag": "94c59e09-9b82-4073-94f8-0fc4b454f362"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:51.552161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:51.552652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:51.553077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:51.569814 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] Creating event network-vif-plugged:94c59e09-9b82-4073-94f8-0fc4b454f362 for instance 6968209c-625c-49f8-abd8-436e9fdede63 on n-h2-851028-12 Sep 14 09:31:51.577024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-63daf77a-c270-491d-a501-7fbab31cb16d req-7208c268-1460-4bc7-8e5e-7a517ed73359 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267369 Sep 14 09:31:51.578008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2050/2726] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:51.583701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:51.585645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:51.593726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:51.594306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:51.594846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:51.595639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:51.596196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:51.596694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:51.905346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:51.917537 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-471b8229-8f7e-44e4-bd11-51b07ba30583 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1314 microversion: 2.1 time: 0.338336 Sep 14 09:31:51.918423 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2051/2727] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:51 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:52.240606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:52.242150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:52.250384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:52.260212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:52.262441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:52.263687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:52.264700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:52.265480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:52.266150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:52.461330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:52.472755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c3e8f24-90a1-418e-ad12-e4c776d829f2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.237734 Sep 14 09:31:52.488205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2052/2728] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:52 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:52.504488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b837538-4a5e-4a5b-99a7-75ac2a74adb6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e293c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:52.566265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b837538-4a5e-4a5b-99a7-75ac2a74adb6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1421 microversion: 2.1 time: 0.076343 Sep 14 09:31:52.567410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2053/2729] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:52 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1421 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:52.582751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38e0e29f-166f-41ac-ac72-f926300d4a9c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e8cea60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:52.643037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38e0e29f-166f-41ac-ac72-f926300d4a9c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 200 len: 1421 microversion: 2.1 time: 0.064503 Sep 14 09:31:52.643843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2054/2730] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:31:52 2022] GET /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:52.663924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05439f1d-ac02-4e06-adff-2f82eab5f8a0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e293e50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:53.584622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05439f1d-ac02-4e06-adff-2f82eab5f8a0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 204 len: 0 microversion: 2.1 time: 0.926202 Sep 14 09:31:53.585207 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2055/2731] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:52 2022] DELETE /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:31:53.592666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:53.593286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:53.602708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.605472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.605894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:53.606696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.607162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.611946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:53.842812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:53.852798 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00e3ee18-a29b-4d39-b071-4061d08506ad tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1500 microversion: 2.1 time: 0.266559 Sep 14 09:31:53.854850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2056/2732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:53 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:53.861627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:53.862396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:53.876524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.877199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.877648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:53.878428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.879013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.879441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:53.884119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:31:53.905492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1410ab60-1377-4b9f-9545-6d8574764251 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/ips" status: 200 len: 152 microversion: 2.20 time: 0.049278 Sep 14 09:31:53.906350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2057/2733] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Sep 14 09:31:53 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:31:53.911037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:53.911859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:53.923564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.924097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.924716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:53.925627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:53.926040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:53.926452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:54.142026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:54.152161 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2316bcb3-7a61-4cfe-924e-6ecc82a1ebea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.244573 Sep 14 09:31:54.153524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2058/2734] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:53 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:54.164164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:54.165495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:54.177266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:54.177799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:54.178187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:54.179001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:54.179460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:54.179937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:54.257502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:31:54.387945 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5734785-2405-47c2-a062-81c4b5a36b44 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 204 len: 0 microversion: 2.1 time: 0.232517 Sep 14 09:31:54.395175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2059/2735] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:54 2022] DELETE /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:54.434966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:54.435786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:54.474900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:54.475411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:54.482298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:54.482298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:54.482298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:54.482298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:54.555293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:31:54.715390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-708ee5cb-16e4-4e98-8916-8cfcf5d666f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 204 len: 0 microversion: 2.1 time: 0.316264 Sep 14 09:31:54.717147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2060/2736] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:31:54 2022] DELETE /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:54.742465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1655795588", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "58087536-265f-45db-8384-06754201e344"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:54.846078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] validate_networks() for [('58087536-265f-45db-8384-06754201e344', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:31:55.445309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:31:55.445746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:31:55.446221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:31:55.447076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:31:55.447076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:31:55.459686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:55.460462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:55.461084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:55.462583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:55.463283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:55.464180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:55.487310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:31:55.493096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for user 4145151290094e15916c574647542ce3 and project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:31:55.509848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:31:55.512987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:31:55.586654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4883f6c-5e1b-422f-8309-e59ed64c8220 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868232 Sep 14 09:31:55.588165 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2061/2737] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:31:55.603791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:55.609715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:55.620219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:55.621208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:55.622617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:55.623778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:55.624539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:55.625216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:56.085978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:56.098649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95e3f958-0337-4742-925b-4b668ceaef4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1506 microversion: 2.1 time: 0.507039 Sep 14 09:31:56.100746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2062/2738] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:55 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:56.109951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:56.110875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:56.131627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:56.133564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:56.136042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:56.139112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:56.140882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:56.144550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:56.528977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:56.546754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a42aab7a-684d-465a-90c5-92be4d30d1d0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1477 microversion: 2.1 time: 0.441532 Sep 14 09:31:56.563313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2063/2739] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:56 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1477 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:56.569094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:56.569825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:56.577844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:56.578340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:56.578894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:56.579731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:56.580291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:56.580743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.050783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:57.064201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3da63d92-8ed4-4041-9900-c16077e77a07 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1212 microversion: 2.1 time: 0.515411 Sep 14 09:31:57.064792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2064/2740] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:56 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1212 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:57.071431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d045f7-b5e7-4952-be1b-6d5db05308a0", "name": "network-vif-unplugged", "status": "completed", "tag": "210417ba-40dc-4f25-87a9-c7ddb21269f9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:57.091161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:57.092647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:57.093835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.118944 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] Creating event network-vif-unplugged:210417ba-40dc-4f25-87a9-c7ddb21269f9 for instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 on n-h2-851028-12 Sep 14 09:31:57.126962 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9dafcd6b-26c3-451e-86ed-0f6379f273ae req-825f5baa-8bd3-4672-bf7c-f694796ffe46 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060672 Sep 14 09:31:57.127925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2065/2741] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:31:57.134808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:57.135518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:57.143336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:57.143861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:57.144395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.145181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:57.145621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:57.146038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.436844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:57.450721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f5e817c-c52d-420d-8e25-4ca052d799e2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 200 len: 1506 microversion: 2.1 time: 0.320433 Sep 14 09:31:57.451596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2066/2742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:57 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:57.477405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:31:57.480272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:57.515056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:57.515558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:57.516026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.516738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:57.517503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:57.518240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:57.564185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lazy-loading 'flavor' on Instance uuid f933d22d-e5d8-4d9f-843f-a1edf164822b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:31:58.086939 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fecbcd34-07d2-4adb-a670-97ee5db92523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/action" status: 202 len: 0 microversion: 2.20 time: 0.624505 Sep 14 09:31:58.093248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2067/2743] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:31:57 2022] POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/action => generated 0 bytes in 640 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:31:58.141907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:58.143461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:58.161573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:58.163224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:58.164387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:58.166421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:58.167763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:58.170166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.088603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:59.098706 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce2cded5-b970-4c1d-827f-6b6f0560281a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1476 microversion: 2.1 time: 1.003007 Sep 14 09:31:59.102436 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2068/2744] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:58 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1476 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:59.125924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:59.126693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:59.169075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.176793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.177425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.178255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.178729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.184726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.771756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:31:59.788772 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4ebbfe3-1ad5-4230-9fca-d4cf2d79166b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1266 microversion: 2.1 time: 0.671247 Sep 14 09:31:59.789818 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2069/2745] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:31:59 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1266 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:31:59.803068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:31:59.804001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:31:59.830759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.831467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.836547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.837609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:31:59.838271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:31:59.838883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:31:59.844447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:00.742420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:00.753515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:00.755240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:00.756900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e705e7db-0856-4f13-b545-8e29bd462a85 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 0.965886 Sep 14 09:32:00.771924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2070/2746] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:31:59 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:00.783331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:00.783331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:00.789116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:00.789341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:00.789782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:00.790504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:00.790954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:00.791378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:00.842813 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 HTTP/1.1 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6968209c-625c-49f8-abd8-436e9fdede63'} Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:32:00.847108 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d322b64-1116-4ca5-9003-2e016bde7b84 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 404 len: 111 microversion: 2.1 time: 0.089949 Sep 14 09:32:00.853854 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2071/2747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:00 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:32:01.296818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6968209c-625c-49f8-abd8-436e9fdede63", "name": "network-vif-deleted", "tag": "94c59e09-9b82-4073-94f8-0fc4b454f362"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:01.313939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.320715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.324951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.368081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] Creating event network-vif-deleted:94c59e09-9b82-4073-94f8-0fc4b454f362 for instance 6968209c-625c-49f8-abd8-436e9fdede63 on n-h2-851028-12 Sep 14 09:32:01.383270 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1fd47c90-ea12-4b75-bcfb-2c14017bc2c4 req-95a2b7a5-1a98-4d0d-a640-4ef1e902e7b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.532218 Sep 14 09:32:01.384346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2072/2748] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:01.392225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:01.394619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:01.409923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.410429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.411649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.413408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.413946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.414866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.695665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:01.715531 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ceeed96-411a-4fdc-88b4-0ca7f6337bb3 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1476 microversion: 2.1 time: 0.328706 Sep 14 09:32:01.717220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2073/2749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:01 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:01.724478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d045f7-b5e7-4952-be1b-6d5db05308a0", "name": "network-vif-deleted", "tag": "210417ba-40dc-4f25-87a9-c7ddb21269f9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:01.741879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.742816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.744164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.765073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] Creating event network-vif-deleted:210417ba-40dc-4f25-87a9-c7ddb21269f9 for instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 on n-h2-851028-12 Sep 14 09:32:01.772106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8cfeb9db-8402-4dec-91fd-fe8bc0089c73 req-11d84c61-3c05-4074-ab16-4ff7d9d21602 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052563 Sep 14 09:32:01.773413 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2074/2750] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:01.782565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:01.784211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:01.806256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.807141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.807772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:01.808976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:01.809642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:01.810685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:02.131642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:02.141870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-814aa08c-06ce-4680-b3c5-3bf58440597c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1308 microversion: 2.1 time: 0.366609 Sep 14 09:32:02.142718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2075/2751] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:01 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:02.175128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1542578800", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:02.304681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:32:03.267175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:03.268538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:03.269640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:03.271299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:03.272130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:03.286071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.286787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.287463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.288840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.289511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.290167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.321273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:03.328196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:03.347877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:32:03.351102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:32:03.493427 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-551e69c7-201a-4f58-b837-b74ef42fd072 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331418 Sep 14 09:32:03.497989 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2076/2752] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:32:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:32:03.520733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:03.524630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:03.557324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.558269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.559996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:03.561189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:03.562611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:03.562810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.546093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.561068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.562521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.563783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33a35607-5b18-434c-a122-0d8adac86142 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 1.062850 Sep 14 09:32:04.564316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2077/2753] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:03 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:04.585270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:04.588233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:04.598163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.610106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.610560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.611306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.611764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.612298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.937942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:04.948589 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac65e1ad-764e-4909-b8dd-1826f8e90ebc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1471 microversion: 2.1 time: 0.377837 Sep 14 09:32:04.950793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2078/2754] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:04 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:04.956008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:04.956794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:04.966251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.967002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.967825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:04.968883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:04.971142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:04.973686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.241737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:05.251455 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7d1b350-3b25-40f9-b0b1-3a856389435e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1308 microversion: 2.1 time: 0.299220 Sep 14 09:32:05.256353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2079/2755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:04 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:05.275492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "name": "network-vif-unplugged", "status": "completed", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}, {"name": "network-changed", "server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:05.292887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.294411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.295041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.310736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Creating event network-vif-unplugged:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h2-851028-12 Sep 14 09:32:05.311194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Creating event network-changed:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h2-851028-12 Sep 14 09:32:05.317472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:32:05.361143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7de2b229-b42c-447c-8a37-a9eeb221159b req-d4583717-d151-4a19-ab0b-e1e1ff521c26 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.102746 Sep 14 09:32:05.361798 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2080/2756] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:05.379304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:05.385708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:05.404485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.405623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.406699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.407611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.410826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.411485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.654182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:05.668004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b658cb2b-105d-4566-ab3c-39ca2dd87751 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1267 microversion: 2.1 time: 0.302093 Sep 14 09:32:05.671014 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2081/2757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:05 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:05.684296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7", "tag": "e2bd70bd-780d-4ec7-91d7-6bec64ebc346"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:05.732155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.739503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.740687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.771432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] Creating event network-changed:e2bd70bd-780d-4ec7-91d7-6bec64ebc346 for instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 on n-h1-851028-12 Sep 14 09:32:05.783478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b11f0c64-8458-4a08-9a1c-d813210b795b req-bda25aa1-38d2-4006-8729-1d74da0d9986 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110253 Sep 14 09:32:05.784140 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2082/2758] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:05.803688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:05.804384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:05.813621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.814496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.814951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.815676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.816352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.817127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.905732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a496af3-4546-4b4f-bc9a-37f840a4fec1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1/action" status: 204 len: 0 microversion: 2.1 time: 0.119299 Sep 14 09:32:05.906718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2083/2759] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:05 2022] POST /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1/action => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:05.912696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:05.916757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:05.927286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.927955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.928798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:05.930335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:05.930958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:05.931744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.650094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:06.662672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:06.664966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:06.667072 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2c1f837-f883-4992-9f60-6e49fd10b587 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 0.758932 Sep 14 09:32:06.668118 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2084/2760] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:05 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:06.692908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:06.694063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:06.701533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:06.703723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:06.704428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:06.705093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:06.706115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:06.706752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:06.707330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.339029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:07.358672 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2768f684-c1f5-45cb-adcd-15367721b7c2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1471 microversion: 2.1 time: 0.676960 Sep 14 09:32:07.371930 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2085/2761] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:06 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1471 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:07.376545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:07.377106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:07.383305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.383810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.384284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.385006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.385465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.385896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.725347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:07.736244 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b080c62-044b-4a36-b930-da6309718016 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1308 microversion: 2.1 time: 0.375645 Sep 14 09:32:07.747934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2086/2762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:07 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:07.754228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:07.754228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:07.763071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.763666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.764220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.765433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:07.766060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:07.766488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:07.882415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:07.891712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1daafe2d-074d-440b-b990-503f89ba8b66 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1273 microversion: 2.1 time: 0.148917 Sep 14 09:32:07.892599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2087/2763] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:07 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:08.206871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Calling method '.version_select at 0x7f693fa3d4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:08.208754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.209239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.209675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.226224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.226728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.227181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.242546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.243296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.243972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.251545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0e2fd48f-dd77-4f2c-80db-1d10da8abb96 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1890050203-project-admin] 10.222.0.90 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.357665 Sep 14 09:32:08.252465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2088/2764] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:32:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:08.261635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "name": "network-vif-plugged", "status": "completed", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:08.271768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.272363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.273023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.277480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:08.286621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Creating event network-vif-plugged:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h2-851028-12 Sep 14 09:32:08.294485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:32:08.307179 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6272a9a0-7cf8-421a-bdfb-f6d66c13eee1 req-0bcc4e2c-85fd-4967-af24-d0ddca031c1f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053328 Sep 14 09:32:08.308074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2089/2765] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:08.314646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:08.314646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:08.321993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.322466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.323117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.324031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.324693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.325132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.712664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:08.731443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:08.741932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:08.743972 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5acf8d75-fd08-4f67-a200-d88e844deb60 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 0.434024 Sep 14 09:32:08.744855 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2090/2766] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:08 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:08.751874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:08.753045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:08.762699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.763599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.764288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:08.765361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:08.766297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:08.766956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:09.536071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:09.555460 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8630e51-a561-4bc5-bd0b-65d78349e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1471 microversion: 2.1 time: 0.807540 Sep 14 09:32:09.568720 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2091/2767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:08 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1471 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:09.579706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:09.580369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:09.589464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:09.590747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:09.591249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:09.592037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:09.592509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:09.592946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:09.952703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:09.977942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-357a9f60-ecdd-4d59-b9f7-c6ccff5fa641 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1308 microversion: 2.1 time: 0.406304 Sep 14 09:32:09.981773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2092/2768] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:09 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:10.000716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:10.003740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:10.024821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.025325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.032525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.033301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.034079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.034492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.374821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:10.386806 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6094080b-ca9a-46fd-8e56-5bb3e5a4cdda tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1315 microversion: 2.1 time: 0.402093 Sep 14 09:32:10.387948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2093/2769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:09 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:10.393746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:10.394566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:10.407315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.408269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.408830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.409783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.410556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.411293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.636347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:10.665524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:10.667551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:10.670822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f2e279b-1316-4654-a4e6-8a8569ee114e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1745 microversion: 2.20 time: 0.281507 Sep 14 09:32:10.672334 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2094/2770] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:10 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1745 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:10.677481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7", "name": "network-vif-plugged", "status": "completed", "tag": "e2bd70bd-780d-4ec7-91d7-6bec64ebc346"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:10.693218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.694253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.694923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.741148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] Creating event network-vif-plugged:e2bd70bd-780d-4ec7-91d7-6bec64ebc346 for instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 on n-h1-851028-12 Sep 14 09:32:10.749653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a95fa866-0687-4b7a-9b8d-2921d63b5555 req-183375ae-9483-4e8a-a0ef-2305b0a8f0a1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075909 Sep 14 09:32:10.750288 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2095/2771] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:10.756388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:10.757360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:10.778000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.778844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.779455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:10.780387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:10.781019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:10.781614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.193986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:11.212726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b861516-4c4f-41ab-acc0-82260e09af97 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1463 microversion: 2.1 time: 0.460856 Sep 14 09:32:11.224523 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2096/2772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:10 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1463 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:11.239671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14b366f4-6ae2-453b-9717-bb0b842ef3a6", "tag": "256c058b-86b2-4091-9ee4-706f3ff1ad43"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:11.250875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.251678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.252150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.265100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] Creating event network-changed:256c058b-86b2-4091-9ee4-706f3ff1ad43 for instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 on n-h2-851028-12 Sep 14 09:32:11.270817 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-062d90ed-62c0-4c9d-a5c6-f2c39e855b52 req-ede155c9-bcfe-4599-8cdf-25a9f7b9937a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044861 Sep 14 09:32:11.272053 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2097/2773] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:11.278285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:11.279191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:11.287067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.288441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.289049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.289995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.290661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.291262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.647028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:11.659935 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-960587ca-a57e-4fc5-aca2-8c08ecb71d52 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1308 microversion: 2.1 time: 0.386182 Sep 14 09:32:11.675344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2098/2774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:11 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:11.678232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:11.679353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:11.698221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.698720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.699186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.700272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:11.701031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:11.701465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:11.966124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:11.976377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe011656-4d77-40d2-be69-3823846e7437 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1463 microversion: 2.1 time: 0.305899 Sep 14 09:32:11.978826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2099/2775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:11 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1463 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:12.005355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:12.006553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:12.014418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.015181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.015857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.016896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.017704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.018389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.222124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:12.231833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0cfe78f4-fa40-4b03-814c-7c67dea85639 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1315 microversion: 2.1 time: 0.251409 Sep 14 09:32:12.236132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2100/2776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:11 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:12.240218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:12.241021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:12.249954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.250452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.250892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.251612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.252096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.252721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.656226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:12.686974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:12.689000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:12.691307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9751bce0-a5ed-4004-a842-982a4606342d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 0.456015 Sep 14 09:32:12.704996 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2101/2777] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:12 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:12.734808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4709a76-0337-4182-9112-b7e3c9b2d592 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'create', calling method: .version_select at 0x7f693e23f8b0>, body: {"keypair": {"name": "tempest-keypair-1563174629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcXFwQGEeLej4UNG9wIuDJdRCE291HJY5e6/xRglk2wdEyq2c3HxiiJ4pNyEMhR5VKHNlrLqzHRp9omdXwfuIWf+K1UfuJQMHZy/+iBFoDt8EsCQ5N2JZJj/Q7NY6nU9A=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:12.756711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c4709a76-0337-4182-9112-b7e3c9b2d592 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:12.764875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c4709a76-0337-4182-9112-b7e3c9b2d592 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:12.807607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4709a76-0337-4182-9112-b7e3c9b2d592 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100787 Sep 14 09:32:12.811686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2102/2778] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:32:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:12.827511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:12.830519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:12.847143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.848852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.851162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:12.854772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:12.861801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:12.862677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:13.309576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:13.505749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:13.524004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e78a64d-756b-4a19-b5cf-fcf33cd2e5ce tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1488 microversion: 2.1 time: 0.708460 Sep 14 09:32:13.527790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2103/2779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:12 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1488 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:13.554468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "name": "network-vif-plugged", "status": "completed", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:13.568090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:13.568897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:13.569503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:13.586170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] Creating event network-vif-plugged:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:32:13.592786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-33f3acda-8b15-4686-ae2d-75a4369adc6f req-6cfad7f7-9fe4-4025-b21a-a1ed8cd54a01 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062937 Sep 14 09:32:13.599291 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2104/2780] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:13.605721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:13.606988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:13.614600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:13.615433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:13.617227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:13.618383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:13.619125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:13.619813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:14.672962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:14.682513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58827267-7d6c-4ee5-b38e-8df36b1aea12 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1315 microversion: 2.1 time: 1.081444 Sep 14 09:32:14.705257 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2105/2781] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:13 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:14.705257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:14.705257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:14.716846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.733272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.734899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:14.737280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.738251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.739883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:14.786643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lazy-loading 'flavor' on Instance uuid 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:32:14.930358 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f0c17c0-2c65-44d4-a19f-86f3c63d58e0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7/action" status: 202 len: 0 microversion: 2.1 time: 0.234216 Sep 14 09:32:14.932628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2106/2782] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:14 2022] POST /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:32:14.944036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:14.947333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:14.960876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.961961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.962992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:14.965408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:14.966226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:14.966888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:15.020752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:15.368542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:15.384346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:15.385818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:15.387511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17aaab38-6642-432a-9f7b-ac57eb569f6f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 0.449991 Sep 14 09:32:15.396670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2107/2783] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:14 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:15.402358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:15.408559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:15.422970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:15.423749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:15.424772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:15.426747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:15.428977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:15.429667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.166931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:16.177066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3679a25-eadc-4d20-927a-eac1217a5eb9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1496 microversion: 2.1 time: 0.779159 Sep 14 09:32:16.192116 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2108/2784] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:15 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1496 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:16.218451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:16.219383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:16.226959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.233063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.233804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.234723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.235771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.240060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.661249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:16.686165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90603255-2edf-49a7-8b65-27a7623d3977 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1315 microversion: 2.1 time: 0.477060 Sep 14 09:32:16.688143 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2109/2785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:16 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:16.719715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:16.720758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:16.732319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.733329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.733933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:16.744718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:16.745408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:16.749259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:17.393668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:17.406870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:17.410275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:17.413841 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9428d42d-3e38-40b1-b20d-0d04b7b787e2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 0.702575 Sep 14 09:32:17.414453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2110/2786] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:16 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:17.447428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b366f4-6ae2-453b-9717-bb0b842ef3a6", "name": "network-vif-plugged", "status": "completed", "tag": "256c058b-86b2-4091-9ee4-706f3ff1ad43"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:17.486475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:17.488529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:17.489004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:17.529517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] Creating event network-vif-plugged:256c058b-86b2-4091-9ee4-706f3ff1ad43 for instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 on n-h2-851028-12 Sep 14 09:32:17.544273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0921bf56-608b-44b8-bb3d-60327ceba5e2 req-e1f371a5-6644-45f8-bc2e-3878fb242e90 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127368 Sep 14 09:32:17.552255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2111/2787] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:17.583065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:17.586671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:17.613583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:17.617725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:17.625047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:17.625889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:17.628626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:17.629162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.215939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:18.230211 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81118791-f81b-404a-a80a-54ea23cc4194 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 200 len: 1479 microversion: 2.1 time: 0.676399 Sep 14 09:32:18.231353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2112/2788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:17 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 1479 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:18.252323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:18.253252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:18.267560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.268350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.268971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.273086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.273758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.274372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.523604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:18.536982 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f5c13ce-1bcb-4e08-b7ef-fd0f572d3dac tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1315 microversion: 2.1 time: 0.301723 Sep 14 09:32:18.537882 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2113/2789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:18 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:18.543162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1999179631"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:18.546013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:18.552883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.553674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.554486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.555481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:18.556277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:18.557818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:18.972655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27aa20f9-3969-4ef8-a842-473568aa3732 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7/action" status: 202 len: 0 microversion: 2.1 time: 0.428966 Sep 14 09:32:18.978033 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2114/2790] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:18 2022] POST /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:32:19.025216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e34ddef-d20b-40d8-960c-eec44db59022 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '.version_select at 0x7f693e2345e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:19.031484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e34ddef-d20b-40d8-960c-eec44db59022 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:19.046242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e34ddef-d20b-40d8-960c-eec44db59022 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:19.046979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e34ddef-d20b-40d8-960c-eec44db59022 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:19.075042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e34ddef-d20b-40d8-960c-eec44db59022 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.060586 Sep 14 09:32:19.082019 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2115/2791] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:32:18 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:19.087301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:19.103828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:19.132032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:19.132757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:19.133226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:19.133990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:19.134456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:19.134889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.144976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:20.168518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:20.172929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:20.175267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ecab919-aec6-4f0f-8263-cbd2144c16b0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 1.091106 Sep 14 09:32:20.175857 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2116/2792] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:19 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:20.202163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44360652-a56e-4c88-b9a2-1a45fe37c321 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e23f3a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:20.261586 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44360652-a56e-4c88-b9a2-1a45fe37c321 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.066585 Sep 14 09:32:20.270980 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2117/2793] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:20 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:20.288622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b2e9491-6e33-4ee8-be81-e850102be6e0 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:20.296933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b2e9491-6e33-4ee8-be81-e850102be6e0 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014955 Sep 14 09:32:20.297832 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2118/2794] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:32:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:20.304021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:20.304907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:20.344876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:20.345674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:20.346471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.347678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:20.348612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:20.349358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:20.726663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:20.787949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81bb845a-9fa0-4a61-b102-3017bc0a8b72 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1501 microversion: 2.1 time: 0.487114 Sep 14 09:32:20.794474 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2119/2795] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:20 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1501 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:20.818192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4538946-40e7-487e-b407-fd8b812d1b49 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-87754540", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:20.891712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4538946-40e7-487e-b407-fd8b812d1b49 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.094180 Sep 14 09:32:20.894970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2120/2796] 10.222.0.90 () {60 vars in 1146 bytes} [Wed Sep 14 09:32:20 2022] POST /compute/v2.1/flavors => generated 497 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:20.910864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adda6464-fb6e-47b3-bf45-5e6839b21112 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:20.945160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-adda6464-fb6e-47b3-bf45-5e6839b21112 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040296 Sep 14 09:32:20.956718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2121/2797] 10.222.0.90 () {58 vars in 1182 bytes} [Wed Sep 14 09:32:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:32:21.208856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:21.210576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:21.244578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:21.248234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:21.248993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:21.249913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:21.252486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:21.253152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:22.076121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:22.085688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:22.096022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:22.097651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c94cacf-2257-4fb2-89e4-5208b32d48cf tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 0.894255 Sep 14 09:32:22.100561 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2122/2798] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:21 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:22.114350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-273344000", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "c0590868-6829-45c2-aa1e-9a49f9bfb00b"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:22.288943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:32:22.775244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:22.994269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:22.994706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:22.995254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:22.995709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:22.996740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:23.041549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:23.042276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:23.053901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:23.054761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:23.055247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:23.055690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:23.200767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:23.223321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:23.275283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:32:23.284487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:32:23.353834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:23.400614 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41a4d378-e562-49e9-aa83-8d9d1533e18e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.296439 Sep 14 09:32:23.404839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2123/2799] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:32:23.418957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37a99a01-ecb0-4755-940b-62d0dc78efc1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e234160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:32.780643 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:32:32.781478 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:32:33.056443 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:32:33.056920 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:32:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:32:33.150453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:33.152776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:33.265925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:33.446984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:34.814340 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37a99a01-ecb0-4755-940b-62d0dc78efc1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 11.404917 Sep 14 09:32:34.822576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2124/2800] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:23 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 11409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:34.827819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:34.828723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:34.848234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:34.848743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:34.849261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:34.850360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:34.851797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:34.852465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:35.270155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:35.281963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:35.283728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:35.285566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa4f983a-d108-469c-9c42-bbf80735594d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1740 microversion: 2.20 time: 0.467210 Sep 14 09:32:35.286334 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2125/2801] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:34 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1740 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:35.291316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:35.292925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:35.299836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:35.300660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:35.302057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:35.303869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:35.304665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:35.305310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:35.710592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:35.727409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d49d8c3-489e-4b2f-8c9c-10279b420500 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1378 microversion: 2.1 time: 0.439747 Sep 14 09:32:35.741785 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2126/2802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:35 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1378 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:35.747408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7", "name": "network-vif-plugged", "status": "completed", "tag": "e2bd70bd-780d-4ec7-91d7-6bec64ebc346"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:35.774595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:35.779124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:35.779859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:35.808659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] Creating event network-vif-plugged:e2bd70bd-780d-4ec7-91d7-6bec64ebc346 for instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 on n-h1-851028-12 Sep 14 09:32:35.827169 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5f6895c7-9f17-438a-ab78-b9409fa57acb req-d3ef9db3-6aff-48e7-98f9-4683e52c96c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083667 Sep 14 09:32:35.829181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2127/2803] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:35.838391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "749f8a4b-3bfa-45e9-a396-d7711903b846"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:35.842850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:35.849866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:35.850775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:35.851431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:35.852432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:35.856044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:35.856834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:36.278190 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-013e44a2-39ad-4f2d-9b23-372e8fee2653 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446791 Sep 14 09:32:36.280179 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2128/2804] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:32:35 2022] POST /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:36.594239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:36.613639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:36.614132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:36.614804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:36.630401 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] Creating event network-changed:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:32:36.638516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c92b1ec5-a610-4c23-b401-a973499823bb req-4cbe71c1-5e44-455f-b21f-8bf671fa66be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356035 Sep 14 09:32:36.639575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2129/2805] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:36.644954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-551ea3f0-58b9-414e-883e-35f864e56d70 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e1e3670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:36.758189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-551ea3f0-58b9-414e-883e-35f864e56d70 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.117244 Sep 14 09:32:36.759052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2130/2806] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:36 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:36.774086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:36.775139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:36.790268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:36.791075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:36.793921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:36.794935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:36.795585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:36.796246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:37.691708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:37.702767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:37.708804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:37.713320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65826bd6-0d3d-42a2-8c95-30d3b310aa9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1722 microversion: 2.20 time: 0.944835 Sep 14 09:32:37.718604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2131/2807] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:36 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1722 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:37.723714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:37.728740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:37.742148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:37.748657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:37.749437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:37.750422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:37.751112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:37.751787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:38.080756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:38.089112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb9925d3-209f-4ebd-80c0-562ffa6b34fe tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1378 microversion: 2.1 time: 0.368994 Sep 14 09:32:38.115229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2132/2808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:37 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1378 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:38.136076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-07815e76-d0e2-4a59-979d-562319cdefe4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2abca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:38.241002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-07815e76-d0e2-4a59-979d-562319cdefe4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.124496 Sep 14 09:32:38.242098 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2133/2809] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:38 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:38.248280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-plugged", "status": "completed", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:38.288930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:38.293680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:38.294363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:38.315749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] Creating event network-vif-plugged:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:32:38.330106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c1961a2b-ffbf-4ed6-aaf2-cbee5a613666 req-6d014f01-3182-417a-9ea6-18ffede971b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086067 Sep 14 09:32:38.331362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2134/2810] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:38.759330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:38.760063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:38.770778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:38.771280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:38.771723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:38.772475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:38.772936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:38.776686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:39.226822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:39.242594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:39.254570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:39.256228 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1022f0d3-3006-4403-b3d4-66342855676f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1722 microversion: 2.20 time: 0.502592 Sep 14 09:32:39.256813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2135/2811] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:38 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:39.282164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:39.282803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:39.306176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:39.307214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:39.310162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:39.311083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:39.311718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:39.312423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:39.602835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:39.622108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0be7d22f-6fe0-429f-97cd-8998ca02cec0 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1378 microversion: 2.1 time: 0.357894 Sep 14 09:32:39.630549 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2136/2812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:39 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1378 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:39.645896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d55d337c-3375-4527-aa7f-3d97ec254a11 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2189d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:39.727659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d55d337c-3375-4527-aa7f-3d97ec254a11 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.094468 Sep 14 09:32:39.740099 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2137/2813] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:39 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:40.297516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:40.298144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:40.320502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:40.323792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:40.325192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:40.326768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:40.329809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:40.330425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:40.893304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:40.925740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:40.938777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:40.946719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a5ffbb5-c564-402c-a01c-f695f5046d68 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1665 microversion: 2.20 time: 0.661818 Sep 14 09:32:40.978437 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2138/2814] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:40 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1665 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:41.005502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "name": "network-vif-unplugged", "status": "completed", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:41.032685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:41.034609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:41.035120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:41.075231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_external_events [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] Unable to find a host for instance f933d22d-e5d8-4d9f-843f-a1edf164822b. Dropping event network-vif-unplugged {{(pid=122444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:32:41.078635 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4c15b96c-9ff8-4f2d-9871-c0fdea7c5988 req-6888e2e9-7bae-4cd4-94f2-887fb60c494e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096806 Sep 14 09:32:41.082266 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2139/2815] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:32:41.094595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:41.095547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:41.109182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:41.114431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:41.115174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:41.116215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:41.116899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:41.117765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:41.915042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:41.933995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bf150fb-a027-4e1d-b60a-3b86e39f66b4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1527 microversion: 2.1 time: 0.850027 Sep 14 09:32:41.935124 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2140/2816] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:41 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1527 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:41.940323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a60fefa0-dca8-43eb-9c30-346cf24d68d0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e1d9040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:42.045158 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a60fefa0-dca8-43eb-9c30-346cf24d68d0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.108456 Sep 14 09:32:42.046831 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2141/2817] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:41 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:42.052306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64fca174-12d0-4108-b497-5b1f15262ee5"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:42.055318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:42.063783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.068531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.069392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:42.074808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.075543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.076700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:42.864299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f2bfe03-3247-4f71-98cf-d99d35adb554 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.808857 Sep 14 09:32:42.874837 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2142/2818] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Sep 14 09:32:42 2022] POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 188 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:32:42.883429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:42.892267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:42.917374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.921018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.921532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:42.922277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:42.922750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:42.923187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:43.631248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:43.641621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-93864bf8-5a6b-44f7-b3c4-71083e689635 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1527 microversion: 2.1 time: 0.765577 Sep 14 09:32:43.647526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2143/2819] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:42 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1527 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:43.661015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d0615b3-037c-41b2-be7c-0dcdc1dac421 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e233940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:43.768702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d0615b3-037c-41b2-be7c-0dcdc1dac421 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.116013 Sep 14 09:32:43.769293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2144/2820] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:43 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:43.782115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:43.782723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:43.801993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:43.802767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:43.803393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:43.812115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:43.812632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:43.815219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:43.898647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:43.955943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122444) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:32:44.156634 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:32:44.157255 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:32:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:32:44.181447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70fec1eb-a880-420d-8a26-b16574a58b98 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/action" status: 202 len: 0 microversion: 2.20 time: 0.410807 Sep 14 09:32:44.191720 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2145/2821] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:32:43 2022] POST /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:44.197068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-832a22b1-56d1-4627-bbc6-9a3fd0da1259 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:44.261058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-832a22b1-56d1-4627-bbc6-9a3fd0da1259 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/c0590868-6829-45c2-aa1e-9a49f9bfb00b" status: 202 len: 0 microversion: 2.1 time: 0.067613 Sep 14 09:32:44.262460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2146/2822] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:32:44 2022] DELETE /compute/v2.1/flavors/c0590868-6829-45c2-aa1e-9a49f9bfb00b => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:32:44.286799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:44.300004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:44.320991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:44.321418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:44.321861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:44.322612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:44.323085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:44.349587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:44.972645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:44.989181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:44.997954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:44.999448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a438077-3d58-433a-9982-b5e0f02a6d1b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1751 microversion: 2.20 time: 0.732294 Sep 14 09:32:45.024882 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2147/2823] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:44 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1751 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:45.030962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65617491-a4bd-47dc-bb2c-45838d83669c tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:45.077016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65617491-a4bd-47dc-bb2c-45838d83669c tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050643 Sep 14 09:32:45.078159 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2148/2824] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:32:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:45.086011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-116d5f4f-191b-40a1-8f26-b6983ca92b50 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fd1ed30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:45.190165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-116d5f4f-191b-40a1-8f26-b6983ca92b50 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1438 microversion: 2.1 time: 0.110609 Sep 14 09:32:45.203290 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2149/2825] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:45 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1438 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:45.208924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:45.224151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:45.239619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.246138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.247297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:45.265498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.266606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.267431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:45.358782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:45.371170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Old instance type tempest-test_resize_flavor_-87754540, new instance type m1.heat {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:32:45.384371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:45.390739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:45.394616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:45.395299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:45.395969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:45.622520 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13ec9e3c-49c7-4d23-a9d3-96c3bbcfaaa4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145/action" status: 202 len: 0 microversion: 2.1 time: 0.417761 Sep 14 09:32:45.628946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2150/2826] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:32:45 2022] POST /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:32:45.634949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:45.635848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:45.646484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.647590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.648362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:45.649484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:45.650131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:45.650731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:46.776103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:46.819184 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b54d1c61-05a7-4058-99bc-7c95d3e42398 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1536 microversion: 2.1 time: 1.184292 Sep 14 09:32:46.820191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2151/2827] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:45 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1536 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:46.832652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:46.837725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:46.860461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:46.861208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:46.861959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:46.862927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:46.863627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:46.864308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:47.605534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:47.619989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:47.622508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:47.623737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e788862-d4cf-4782-8dae-06eb65ec6f52 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1751 microversion: 2.20 time: 0.800952 Sep 14 09:32:47.624430 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2152/2828] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:46 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1751 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:47.664395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1903c4ca-af11-4c94-b8ed-13c0fa0dc5b6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e233dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:47.767226 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1903c4ca-af11-4c94-b8ed-13c0fa0dc5b6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1447 microversion: 2.1 time: 0.118543 Sep 14 09:32:47.782161 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2153/2829] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:47 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:47.787236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bf3f664-eb6c-4009-a526-ffa630d58abf tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e143550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:47.908865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bf3f664-eb6c-4009-a526-ffa630d58abf tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 200 len: 1447 microversion: 2.1 time: 0.125371 Sep 14 09:32:47.922499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2154/2830] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:32:47 2022] GET /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:47.927820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:47.939511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:47.962688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:47.963800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:47.963800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:47.965219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:47.965657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:47.973961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:48.406937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:48.421765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a2c076a-5fbe-4b87-a9d9-d8f8231f2512 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1536 microversion: 2.1 time: 0.497741 Sep 14 09:32:48.424497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2155/2831] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:47 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1536 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:48.437559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9db8de20-c16e-459f-b59b-cfb654e71c62 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e143940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:49.422864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9db8de20-c16e-459f-b59b-cfb654e71c62 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 204 len: 0 microversion: 2.1 time: 0.997102 Sep 14 09:32:49.423567 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2156/2832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:48 2022] DELETE /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 0 bytes in 999 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:49.428723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:49.429835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:49.446860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.447392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.448089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.450395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.451283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.451715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.808941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:49.820753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:49.835639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:49.837230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5351e38-b09d-480e-8709-eb875b533868 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1753 microversion: 2.20 time: 0.412365 Sep 14 09:32:49.837988 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2157/2833] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:49 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1753 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:49.855078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:49.858598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:49.872058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.874366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.875368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.877838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:49.879308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:49.880476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:49.960487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:32:50.176115 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70e1eb65-e55f-40cf-b0a7-e61000267911 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 204 len: 0 microversion: 2.1 time: 0.335630 Sep 14 09:32:50.177603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2158/2834] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:32:49 2022] DELETE /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:50.193031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:50.193745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:50.204196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:50.205943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:50.206985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:50.208167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:50.208894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:50.209631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:50.583430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:50.597269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9048bfe3-ef19-4c82-94fc-2b3e58df5496 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 0.415655 Sep 14 09:32:50.598274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2159/2835] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:50 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:50.628063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-866685469", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "58087536-265f-45db-8384-06754201e344"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:50.746451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] validate_networks() for [('58087536-265f-45db-8384-06754201e344', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:32:51.814853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:32:51.821034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:32:51.822143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:32:51.822878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:32:51.825269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:32:51.870774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:51.871806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:51.872614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:51.873738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:51.874416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:51.875464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:51.906279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:32:51.912477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Getting quotas for user 4145151290094e15916c574647542ce3 and project 99a0b17d01ea4f4ab65ddc6245c8350e. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:32:51.929494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:32:51.932528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:32:52.000003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05740088-9ac2-4afb-a55e-f890fdc85a06 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397751 Sep 14 09:32:52.004236 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2160/2836] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:32:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:32:52.013135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:52.014209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:52.024291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.027694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.028922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:52.030346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.031475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.032478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:52.402167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:52.415237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:52.424244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:52.425488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7716753e-adb1-4466-925f-83b14c058c94 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1753 microversion: 2.20 time: 0.419874 Sep 14 09:32:52.426068 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2161/2837] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:52 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1753 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:52.438605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7", "name": "network-vif-unplugged", "status": "completed", "tag": "e2bd70bd-780d-4ec7-91d7-6bec64ebc346"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:52.464540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.465052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.465504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:52.498438 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] Creating event network-vif-unplugged:e2bd70bd-780d-4ec7-91d7-6bec64ebc346 for instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 on n-h1-851028-12 Sep 14 09:32:52.508564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f17dd1d3-69e5-498b-8469-7a27d7483255 req-24f3a674-f9f8-455b-b4df-5fa9c1f2e450 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081062 Sep 14 09:32:52.509189 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2162/2838] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:52.524990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:52.525957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:52.549887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.564252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.564713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:52.565473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:52.565941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:52.566374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.372036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.383511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cec2604-0b3a-479d-81f6-a05b9ebcbc89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 0.869795 Sep 14 09:32:53.384195 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2163/2839] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:52 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:53.424429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.426126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.458923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.461587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.462737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.470111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.472491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.474193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.790408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:53.807535 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33e9fa8f-df62-4e15-9c62-6c7070c8fdd2 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1259 microversion: 2.1 time: 0.413307 Sep 14 09:32:53.810409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2164/2840] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:53 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1259 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:53.830528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:53.831297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:53.846381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.846996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.848125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.850831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:53.851405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:53.853981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:53.867233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:54.387762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:54.402253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:54.408434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:54.412270 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-654bd028-52b3-4eaa-87f9-79c4bfec1974 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1753 microversion: 2.20 time: 0.597570 Sep 14 09:32:54.415875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2165/2841] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:53 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1753 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:54.434819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7", "name": "network-vif-deleted", "tag": "e2bd70bd-780d-4ec7-91d7-6bec64ebc346"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:32:54.449237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:32:54.457147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:54.459559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:54.460409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:54.495843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] Creating event network-vif-deleted:e2bd70bd-780d-4ec7-91d7-6bec64ebc346 for instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 on n-h1-851028-12 Sep 14 09:32:54.510165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6eeaa738-6878-46f7-a946-258888c33804 req-4bf26c76-ef0a-4ef4-aeb2-0d3e7d7c870a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092068 Sep 14 09:32:54.513016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2166/2842] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:32:54.533459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:54.535660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:54.554531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:54.557696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:54.558416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:54.561516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:54.562210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:54.562954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.293492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:55.305095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-65c4c757-62bf-4bee-be32-acad410a14db tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 0.786452 Sep 14 09:32:55.305929 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2167/2843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:54 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:55.331854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:55.333231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:55.374549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.376773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.379024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.380289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.382757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.383440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.876769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:55.896577 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f52e1f83-ece7-4837-ad5d-269d03ddae1e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1265 microversion: 2.1 time: 0.588462 Sep 14 09:32:55.910767 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2168/2844] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:55 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1265 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:55.932157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:55.934745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:55.949945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.950650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.951520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:55.952666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:55.953309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:55.958183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.040858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:32:56.234644 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f275ce0f-ff84-42de-896f-639c0300e7eb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 204 len: 0 microversion: 2.1 time: 0.313517 Sep 14 09:32:56.235573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2169/2845] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:32:55 2022] DELETE /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:32:56.243875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:56.253209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:56.261184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.263062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.268347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.269398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.270137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.270822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.736869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:56.759068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:56.762670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:56.776385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f3855de-6b1e-450b-a906-c3b9f9c4776e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1753 microversion: 2.20 time: 0.533227 Sep 14 09:32:56.780251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2170/2846] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:56 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1753 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:32:56.796626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:56.798205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:56.813310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.814243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.814932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:56.817273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:56.820770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:56.821625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:57.910740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:57.964615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3f33671-486c-4b67-a24b-e9389f438edf tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1553 microversion: 2.1 time: 1.180247 Sep 14 09:32:57.965721 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2171/2847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:56 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1553 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:57.985022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:57.986024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:58.005684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.006219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.006870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.007828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:58.010161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:58.011421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:58.988796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:59.004368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed6301f1-0893-446c-909c-349d27b323d5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 1.033522 Sep 14 09:32:59.006197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2172/2848] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:57 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:59.014653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:59.015529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:59.027927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.028895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.029431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.030282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.031315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.032037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.541416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:32:59.551178 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3b90167-dc9f-4e47-ba76-c8e6d19957b4 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1307 microversion: 2.1 time: 0.543697 Sep 14 09:32:59.556765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2173/2849] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:32:59 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1307 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:32:59.562969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:32:59.563594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:32:59.591157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.591788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.592405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:32:59.593162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:32:59.598880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:32:59.599623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.650586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:00.664998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:00.666463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:00.677206 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-222b0cf2-f208-4500-be35-4611b093f523 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 1.118199 Sep 14 09:33:00.684132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2174/2850] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:32:59 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:00.693165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef39a87-cdc4-47fd-81a7-97cf2e8b0df4", "tag": "a31a7a18-a23a-43ac-bdff-abd64c1a3faa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:00.709252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:00.709967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:00.710560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.733695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] Creating event network-changed:a31a7a18-a23a-43ac-bdff-abd64c1a3faa for instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 on n-h1-851028-12 Sep 14 09:33:00.743844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-69f116e1-ad5c-4b2a-b009-523448d5164d req-080c53b0-7364-4c71-9789-1ce99c80f3f2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058082 Sep 14 09:33:00.744810 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2175/2851] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:00.750137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:00.752045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:00.760470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:00.761837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:00.762425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.763333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:00.764006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:00.764617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:00.939459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:00.952136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b689282-0440-4b84-a599-5737d16b0480 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1346 microversion: 2.1 time: 0.205824 Sep 14 09:33:00.952753 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2176/2852] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:00 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1346 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:00.983216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:00.990220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:01.022942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.025976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.027579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.028778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.031943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.032683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.545843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:01.558491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7141865-c1d4-4129-8112-954c7f8dc21e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 0.604571 Sep 14 09:33:01.560033 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2177/2853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:00 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:01.578062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:01.579025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:01.586062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.591620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.592554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.593646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:01.594105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:01.594834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:01.891690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:01.925469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:02.121062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:02.130268 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b061676-ceea-4668-90e1-6dde995f0fad tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1307 microversion: 2.1 time: 0.568852 Sep 14 09:33:02.136714 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2178/2854] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:01 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1307 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:02.141571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:02.142190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:02.165950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.166734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.167985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:02.168913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.169546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.170142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:02.735460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:02.758563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:02.770342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:02.771866 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af50baa8-5fbf-45cc-95d8-b216236c5aca tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.634101 Sep 14 09:33:02.781672 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2179/2855] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:02 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:02.795718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:02.796714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:02.816629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.821130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.832129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:02.833193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:02.833854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:02.834470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:03.740977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:03.756050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-609e7d1b-c113-42c5-9e4e-92ac18d1da36 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1346 microversion: 2.1 time: 0.971122 Sep 14 09:33:03.761191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2180/2856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:02 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1346 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:03.779248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:03.780020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:03.803428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:03.806895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:03.807620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:03.808696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:03.812092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:03.812927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:03.877904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:05.506843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:05.527362 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-601cd37b-10a6-40fd-8c20-29a356ed5b94 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1541 microversion: 2.1 time: 1.746120 Sep 14 09:33:05.528692 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2181/2857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:03 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1541 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:05.553290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14b366f4-6ae2-453b-9717-bb0b842ef3a6", "name": "network-vif-deleted", "tag": "256c058b-86b2-4091-9ee4-706f3ff1ad43"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:05.586748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.587557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.589474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.657125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] Creating event network-vif-deleted:256c058b-86b2-4091-9ee4-706f3ff1ad43 for instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 on n-h2-851028-12 Sep 14 09:33:05.684347 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6633177b-77d2-4a17-8c8b-e420d8360f19 req-4fdec542-5395-4889-a7d1-5c6fb4714312 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144753 Sep 14 09:33:05.689943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2182/2858] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:05.720852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:05.748054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:05.788747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.790948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.792063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:05.795361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:05.797624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:05.798454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:06.679102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:06.702085 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc24025a-7ed1-4b13-b763-e5b0a2644651 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1307 microversion: 2.1 time: 1.008407 Sep 14 09:33:06.705444 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2183/2859] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:05 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1307 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:06.722152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:06.723774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:06.745228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:06.751342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:06.751342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:06.762481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:06.764190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:06.765432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:07.906194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.925513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.936162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:07.941409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6633d704-fa4b-4ec6-8b34-7dd27fc0523a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 1.230416 Sep 14 09:33:07.948669 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2184/2860] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:06 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:07.971678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:07.975594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:08.008879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.013718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.015115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.016141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.018664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.019478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.376257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:08.399627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b71107c-a6aa-4aa8-8dd4-8e216875b96a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1346 microversion: 2.1 time: 0.448896 Sep 14 09:33:08.406496 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2185/2861] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:07 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1346 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:08.437201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:08.438422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:08.458802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.466259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.466962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:08.468340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:08.469048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:08.469692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.609723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:09.620369 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4053ba5c-e9c0-4442-9fd1-66d04b61ab89 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1540 microversion: 2.1 time: 1.211802 Sep 14 09:33:09.635126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2186/2862] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:08 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1540 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:09.658306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:09.664494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:09.700362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.701439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.706133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:09.707123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:09.709154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:09.716588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.384461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:11.402096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d33b978-8f5c-4017-a604-c87801c597e5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1307 microversion: 2.1 time: 1.759182 Sep 14 09:33:11.402836 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2187/2863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:09 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1307 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:11.439681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef39a87-cdc4-47fd-81a7-97cf2e8b0df4", "name": "network-vif-plugged", "status": "completed", "tag": "a31a7a18-a23a-43ac-bdff-abd64c1a3faa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:11.491619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.492164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.492620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.533253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] Creating event network-vif-plugged:a31a7a18-a23a-43ac-bdff-abd64c1a3faa for instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 on n-h1-851028-12 Sep 14 09:33:11.550065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-eff27839-805f-4c82-8bda-4fcf180983bb req-04a67ece-1cbd-423f-9af3-87debac0dce6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122627 Sep 14 09:33:11.565727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2188/2864] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:11.577612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:11.578324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:11.595865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.610956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.612423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:11.613415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:11.614078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:11.616006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.358610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.373492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.377002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.378272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27e7b1b3-cb37-4f4a-9082-b035a46770f6 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.807085 Sep 14 09:33:12.388003 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2189/2865] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:11 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:12.397946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:12.400674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:12.420114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.427151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.427151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.427151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.427526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.430247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.502061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.502841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.503611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.504314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'fault' on Instance uuid 14b366f4-6ae2-453b-9717-bb0b842ef3a6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:33:12.679413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:12.716531 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd5d5c73-26ec-43ad-bcee-4cdeea086f7a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 200 len: 1305 microversion: 2.1 time: 0.324331 Sep 14 09:33:12.721053 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2190/2866] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:12 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 1305 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:12.750393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-unplugged", "status": "completed", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:12.782881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.783736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.784474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.825367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Creating event network-vif-unplugged:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h1-851028-12 Sep 14 09:33:12.841519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:12.904914 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-496ad0f9-873d-4c54-a91f-b22054286428 req-c5453ce7-16dd-45ad-bc0c-fe84e76b1613 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174715 Sep 14 09:33:12.905874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2191/2867] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:12.915693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:12.917893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:12.945520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.948425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.948893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:12.949706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:12.963414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:12.963414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.687839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:13.711651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83efb803-5bf4-42ff-9efb-d3abec7f5b50 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1540 microversion: 2.1 time: 0.804220 Sep 14 09:33:13.712313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2192/2868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:12 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1540 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:13.726409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:13.731479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:13.749300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.749918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.750614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:13.751829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:13.752859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:13.753861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.717388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:14.743454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a803dd0a-369c-422c-9987-9308024ffa0f tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1307 microversion: 2.1 time: 1.024703 Sep 14 09:33:14.745599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2193/2869] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:13 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1307 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:14.754662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:14.755386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:14.773267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.775012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.775480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:14.776988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:14.780598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:14.781418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.290609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:15.310187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:15.312366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:15.314079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-130989b9-551c-405d-8658-748453ba1529 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.567056 Sep 14 09:33:15.315261 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2194/2870] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:14 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:15.321985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:15.323780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:15.336072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.336861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.337797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.338938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.339814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.340301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.359113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 HTTP/1.1 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '14b366f4-6ae2-453b-9717-bb0b842ef3a6'} Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:15.360898 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9ce5682-0dd9-426d-bf78-1805e132e299 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 404 len: 111 microversion: 2.1 time: 0.046959 Sep 14 09:33:15.366959 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2195/2871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:15 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:15.371711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:15.372430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:15.380383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.381011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.381448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:15.382446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:15.383055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:15.383646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.193770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:16.202862 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bad362be-bbd5-459d-af39-039f44a4a8cf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1540 microversion: 2.1 time: 0.837513 Sep 14 09:33:16.204405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2196/2872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:15 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1540 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:16.210109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:16.222045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.222917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.223570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.243508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Creating event network-changed:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h1-851028-12 Sep 14 09:33:16.257297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:16.274795 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-055f98eb-889b-4634-a360-64510255adf1 req-ff3c328e-9ff8-4fdf-b9b7-1efef3ecf561 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068811 Sep 14 09:33:16.275806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2197/2873] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:16.282883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:16.285733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:16.294203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.295084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.295796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.296772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.297971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.299405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.326919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6/os-volume_attachments HTTP/1.1 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '14b366f4-6ae2-453b-9717-bb0b842ef3a6'} Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:16.329673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:33:16.335668 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:16.339313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:16.340791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-318b5fe4-8b0f-4d31-99f3-5d0b8952b358 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063015 Sep 14 09:33:16.342006 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2198/2874] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:33:16 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:16.353492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:16.354912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:16.363452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.364478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.365475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.366706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:16.367385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:16.368179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:16.965295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:16.983984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d7c44cb-ccfe-46b0-bc3f-5d63658c820b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1487 microversion: 2.1 time: 0.640538 Sep 14 09:33:16.996707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2199/2875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:16 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:17.009500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:17.011454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:17.018951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.019780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.020435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.021467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:17.022201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:17.022825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:17.541857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:17.556148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:17.559299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:17.561058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-adbc7868-e9ce-403c-b5d5-a524d0181aa2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.562894 Sep 14 09:33:17.574950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2200/2876] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:16 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:17.582256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2098577046", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:17.679957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:33:19.226323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:33:19.227489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:33:19.230049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:33:19.230824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:33:19.231408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:33:19.247843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.248753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.249529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:19.250485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.251929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.252950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:19.267791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:19.283324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:19.289764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:19.309138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:33:19.312061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:33:19.395609 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-580d6a9c-c464-4f8b-8fc7-69ae708ec83b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817131 Sep 14 09:33:19.396999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2201/2877] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:33:19.404100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1928294678"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:19.413813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:19.425952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.426829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.427462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:19.433615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:19.434490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:19.435281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.062115 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ca7b20d-1e22-4955-be77-6e327426e279 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "POST /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4/action" status: 202 len: 0 microversion: 2.1 time: 0.644968 Sep 14 09:33:20.068056 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2202/2878] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:19 2022] POST /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:33:20.098705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:20.101398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:20.119656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.120191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.120663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.130100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.130644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.131098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.863487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:20.874903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-512dcf85-3ade-48df-94f6-84be1fc233dc tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1469 microversion: 2.1 time: 0.803808 Sep 14 09:33:20.875875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2203/2879] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:20 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1469 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:20.889927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:20.890580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:20.902897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.904827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.905603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:20.906685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:20.907384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:20.908417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.465020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:21.476255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:21.478194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:21.479768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-102d4aa2-4d8f-4af0-917b-105bf624fe36 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.602922 Sep 14 09:33:21.481028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2204/2880] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:20 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:21.486924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:21.487831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:21.491655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:21.497997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.499039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.499935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.501203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.502141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.502936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.677418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:21.696605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-658864df-4092-44c3-8a8e-0fe7ac07e181 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1267 microversion: 2.1 time: 0.209679 Sep 14 09:33:21.698214 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2205/2881] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:21 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:21.712259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9dcbf340-e1b7-4524-9c59-47d53ece2c1b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e1179d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:21.799970 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9dcbf340-e1b7-4524-9c59-47d53ece2c1b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f" status: 200 len: 1412 microversion: 2.1 time: 0.100188 Sep 14 09:33:21.800784 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2206/2882] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:33:21 2022] GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:21.807338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:21.808554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:21.816331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.819453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.820372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.822039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.822519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.823502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.885588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.886198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.886722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.887582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:21.888178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:21.888704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:21.932965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:21.938505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:22.078675 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d1f64d7-0faf-45a8-a308-965cafb3e935 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145/action" status: 202 len: 0 microversion: 2.1 time: 0.276267 Sep 14 09:33:22.079349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2207/2883] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:21 2022] POST /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:33:22.089265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-plugged", "status": "completed", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:22.099466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.099976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.100403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.114144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Creating event network-vif-plugged:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h1-851028-12 Sep 14 09:33:22.120428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:22.132317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3c96c04f-e1df-44fa-a27c-cf99358d54f6 req-07895f6a-2321-428e-ace8-2d16254c0f9f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048150 Sep 14 09:33:22.133272 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2208/2884] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:22.138439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:22.139019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:22.145322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.146206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.146206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.146923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.147374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.147802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.190130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:22.340552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de03da01-c488-4dae-a625-da2f6afcb505 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 204 len: 0 microversion: 2.1 time: 0.205803 Sep 14 09:33:22.340983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2209/2885] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:22 2022] DELETE /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:33:22.360723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3274dbc9-5ff1-4ce2-a8bf-cc06e46b5559 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2180d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:22.415085 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3274dbc9-5ff1-4ce2-a8bf-cc06e46b5559 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f" status: 200 len: 1412 microversion: 2.1 time: 0.072878 Sep 14 09:33:22.416206 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2210/2886] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:33:22 2022] GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:22.427612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:22.429201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:22.443343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.443792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.444636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.445882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.446829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.447391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.766465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:22.779090 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2b0fd0c-88e8-4259-a3f0-65babf3534bf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1468 microversion: 2.1 time: 0.357884 Sep 14 09:33:22.780211 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2211/2887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:22 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:22.785209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:22.786087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:22.800701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.801509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.802100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.803291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:22.803771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:22.804225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:22.890010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:22.906388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ddef0c1a-5594-41f3-b47c-12caeb89ef54 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1273 microversion: 2.1 time: 0.124941 Sep 14 09:33:22.908331 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2212/2888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:22 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:22.914377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47b85862-b8bd-43e9-bb5e-1acf008a15b8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e0c73a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:23.114863 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47b85862-b8bd-43e9-bb5e-1acf008a15b8 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f" status: 204 len: 0 microversion: 2.1 time: 0.203497 Sep 14 09:33:23.123032 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2213/2889] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:22 2022] DELETE /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:33:23.127534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:23.128179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:23.135774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.136921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.137733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:23.138681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.139379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.139981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:23.518078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:23.530068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:23.532159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:23.533391 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8618a44f-7dd3-4ad1-9a9c-12129d933246 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.409755 Sep 14 09:33:23.543969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2214/2890] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:23 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:23.561413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc40407b-c9d4-4e8e-8da2-aaca868e5d7d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e0c7dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:23.596487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-fc40407b-c9d4-4e8e-8da2-aaca868e5d7d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Image not found. Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc40407b-c9d4-4e8e-8da2-aaca868e5d7d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f HTTP/1.1 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '81cef106-54dc-4342-8646-ef9f76bac06f'} Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 81cef106-54dc-4342-8646-ef9f76bac06f Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:33:23.598906 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81cef106-54dc-4342-8646-ef9f76bac06f could not be found. Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc40407b-c9d4-4e8e-8da2-aaca868e5d7d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:23.603755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc40407b-c9d4-4e8e-8da2-aaca868e5d7d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f" status: 404 len: 62 microversion: 2.1 time: 0.055649 Sep 14 09:33:23.612680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2215/2891] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:33:23 2022] GET /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:33:23.612854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:23.613450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:23.625104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.625606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.626633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:23.627381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:23.627846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:23.628325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.225938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.230592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:24.238800 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2be82658-9820-4727-bc71-8728184ba89d tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1505 microversion: 2.1 time: 0.632021 Sep 14 09:33:24.240151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2216/2892] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:23 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1505 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:24.245779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:24.246669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:24.259958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.260530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.260962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.261756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.262346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.262922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.490333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.518612 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68c09ecd-d382-4fdb-b77c-4e26c41f5323 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1468 microversion: 2.1 time: 0.276620 Sep 14 09:33:24.521173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2217/2893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:24 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:24.532240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:24.533673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:24.554511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.555637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.556409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.558373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.559410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.560799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.664273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.673451 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9909fa2-c31a-472d-8e8d-87f398b02b3a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1273 microversion: 2.1 time: 0.150559 Sep 14 09:33:24.674693 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2218/2894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:24 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:24.679538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:24.680387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:24.688431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.689146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.689759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.690795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:24.691425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:24.692089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:24.856037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.868028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.871041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:24.872507 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91debd5b-ddd8-40d9-a6b1-77f995d69875 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.196623 Sep 14 09:33:24.873095 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2219/2895] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:24 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:25.273929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:25.274685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.283726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.284514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.285183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.286671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.287864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.288501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.478349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:25.502023 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43edac86-27ee-4600-b94f-cc7974a7bac1 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1500 microversion: 2.1 time: 0.238841 Sep 14 09:33:25.511965 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2220/2896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:25 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1500 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:25.562270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:25.563174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.575242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.576481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.577138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.578140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.579050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.579693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.765630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:25.783082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f23a7da-7da3-4b51-81cc-220e7a787bc5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1468 microversion: 2.1 time: 0.227612 Sep 14 09:33:25.784941 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2221/2897] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:25 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1468 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:25.790324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:25.791188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:25.808906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.808906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.813778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:25.813778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:25.813778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:25.813778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.053907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:26.072550 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-811db0af-6136-4a6c-8a05-80a9aa0e6f94 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.285869 Sep 14 09:33:26.092237 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2222/2898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:25 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:26.105799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:26.106764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:26.128898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:26.129407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:26.136683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.139524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:26.141048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:26.141565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.845560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:26.855162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:26.857066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:26.858500 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f3dbea8-c989-4353-8416-3af85cfa071f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.762996 Sep 14 09:33:26.872534 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2223/2899] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:26 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:26.884115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "name": "network-vif-plugged", "status": "completed", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:26.896034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:26.896978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:26.897622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.912279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] Creating event network-vif-plugged:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:33:26.919067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6ce481ca-5cf0-414d-b860-7e9e9963a8e7 req-4e2b09c2-6302-44ee-a28b-28db69bb5f11 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044615 Sep 14 09:33:26.920336 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2224/2900] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:26.927858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:26.928993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:26.936966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:26.937464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:26.938120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:26.938841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:26.939297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:26.939944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.318493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:27.334322 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f49d72b1-5f27-4749-bd62-0fd5d73a0ef7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1487 microversion: 2.1 time: 0.411165 Sep 14 09:33:27.336149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2225/2901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:26 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1487 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:27.348350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:27.350136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:27.359187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.360035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.360542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.361368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.361890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.363256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.783976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:27.796220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8cbf46a5-ae2c-4276-ad73-f6533d2c4c17 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1534 microversion: 2.1 time: 0.454237 Sep 14 09:33:27.812258 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2226/2902] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:27 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1534 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:27.828977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:27.834007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:27.860884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.864186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.868906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:27.870305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:27.870816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:27.871406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.213551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:28.224338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be4868e2-ee6c-4f32-afad-50f26d3ae21d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.409819 Sep 14 09:33:28.225439 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2227/2903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:27 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:28.231192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:28.232032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:28.241103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.242123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.243027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.244049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.245347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.246116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.293957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:28.497075 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a7122e3-71f8-4c44-85e5-e2247d191ae0 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 204 len: 0 microversion: 2.1 time: 0.267849 Sep 14 09:33:28.508614 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2228/2904] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:28 2022] DELETE /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:33:28.518228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:28.522036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:28.530178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.531352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.532047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:28.533120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:28.533832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:28.534657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.255661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:29.270574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:29.272541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:29.274021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-977c6369-5eb3-4c4c-bdca-c95510043d33 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1809 microversion: 2.20 time: 0.762781 Sep 14 09:33:29.274600 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2229/2905] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:28 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1809 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:29.297351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-unplugged", "status": "completed", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:29.312266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:29.314331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.315005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.315442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.353556 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Creating event network-vif-unplugged:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:33:29.367105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:33:29.395522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7779c6f7-8b97-4b7b-bf98-4e3f15bf4eb3 req-4e7f677a-2fec-4ae8-aa58-2af68d0bdd18 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119622 Sep 14 09:33:29.396489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2230/2906] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:29.408766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b30a4fe-6c0f-4cb4-9a9f-f33c03e8fb64 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e1bd9d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:29.452660 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2b30a4fe-6c0f-4cb4-9a9f-f33c03e8fb64 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Image not found. Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b30a4fe-6c0f-4cb4-9a9f-f33c03e8fb64 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f HTTP/1.1 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '81cef106-54dc-4342-8646-ef9f76bac06f'} Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 81cef106-54dc-4342-8646-ef9f76bac06f to delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81cef106-54dc-4342-8646-ef9f76bac06f could not be found. Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.454234 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b30a4fe-6c0f-4cb4-9a9f-f33c03e8fb64 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b30a4fe-6c0f-4cb4-9a9f-f33c03e8fb64 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f" status: 404 len: 62 microversion: 2.1 time: 0.058290 Sep 14 09:33:29.461238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2231/2907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:29 2022] DELETE /compute/v2.1/images/81cef106-54dc-4342-8646-ef9f76bac06f => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:33:29.472037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:29.472037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:29.485626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.486448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.487194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.488240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.488919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.489616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.911179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:29.921823 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b80cc2c9-ea67-45cf-ad4f-a998e9438d3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1534 microversion: 2.1 time: 0.461365 Sep 14 09:33:29.922511 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2232/2908] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:29 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1534 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:29.928598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef39a87-cdc4-47fd-81a7-97cf2e8b0df4", "name": "network-vif-plugged", "status": "completed", "tag": "a31a7a18-a23a-43ac-bdff-abd64c1a3faa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:29.946335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:29.947021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:29.947858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:29.969467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] Creating event network-vif-plugged:a31a7a18-a23a-43ac-bdff-abd64c1a3faa for instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 on n-h1-851028-12 Sep 14 09:33:29.981143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7b96b219-a11e-42a8-bfa1-cccc60f337a5 req-225f85f0-a3cb-467a-8a90-b5da6fe06903 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054900 Sep 14 09:33:29.982245 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2233/2909] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:29.996263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:29.997060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:30.006342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.006912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.007359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.008197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.008660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.009146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.046617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:30.443218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:30.484490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ccb06bf-e203-4ecb-ba3a-ffaa94e0f30c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.495295 Sep 14 09:33:30.487749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2234/2910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:29 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:30.494427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:30.495151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:30.506301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.507446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.508587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.510270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.510871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.511871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.555141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:30.642016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Instance is already in deleting state, ignoring this request Sep 14 09:33:30.642850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77050d65-5321-4a55-ac0b-ebe73436d3d9 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 204 len: 0 microversion: 2.1 time: 0.153343 Sep 14 09:33:30.646325 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2235/2911] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:30 2022] DELETE /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:33:30.649032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:30.649723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:30.658182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.658685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.659129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:30.659848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:30.660936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:30.661779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:31.677881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:31.700020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:31.701735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:31.703222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90caa115-3bc3-4528-83b8-5fab03a2b832 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1796 microversion: 2.20 time: 1.058447 Sep 14 09:33:31.704014 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2236/2912] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:30 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1796 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:31.719350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:31.720887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:31.750190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:31.750983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:31.751603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:31.752536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:31.756197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:31.756852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:31.906246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:32.393977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4145151290094e15916c574647542ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a0b17d01ea4f4ab65ddc6245c8350e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:32.409094 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edd56f2c-e658-404b-aaef-8d2c1b0b2d0b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 200 len: 1493 microversion: 2.1 time: 0.703805 Sep 14 09:33:32.412699 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2237/2913] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:31 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 1493 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:32.426178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:32.433881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:32.459315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:32.459315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:32.463054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:32.467313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:32.468025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:32.468665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:33.267882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:33.290103 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9166412-5afc-4a57-a479-f63db7f6124d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1534 microversion: 2.1 time: 0.874645 Sep 14 09:33:33.293309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2238/2914] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:32 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1534 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:33.307054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:33.310141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:33.329415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:33.331818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:33.333494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:33.336249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:33.337054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:33.339024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:33.871296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:33.905942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85e783b8-dbc9-4501-bf9e-09958780c01c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.605843 Sep 14 09:33:33.912806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2239/2915] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:33 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:33.943788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5ff081-ea27-41e1-a625-4a35dc6318be", "tag": "93a3d7d8-f073-4526-ace5-78171e8802eb"}, {"name": "network-changed", "server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:33.963947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:33.965656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:33.969355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.040516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Creating event network-changed:93a3d7d8-f073-4526-ace5-78171e8802eb for instance 9d5ff081-ea27-41e1-a625-4a35dc6318be on n-h1-851028-12 Sep 14 09:33:34.042764 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] Creating event network-changed:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:33:34.114395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-64358dbf-8e12-41af-bda3-7be5522eec19 req-19ebaf82-ef0a-4341-8dfa-08b9fdb65c20 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.199403 Sep 14 09:33:34.115037 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2240/2916] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:34.143741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef39a87-cdc4-47fd-81a7-97cf2e8b0df4", "name": "network-vif-unplugged", "status": "completed", "tag": "a31a7a18-a23a-43ac-bdff-abd64c1a3faa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:34.184387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.185267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.186774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.221190 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] Creating event network-vif-unplugged:a31a7a18-a23a-43ac-bdff-abd64c1a3faa for instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 on n-h1-851028-12 Sep 14 09:33:34.233372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-32910f56-52fe-4928-8192-07a3e1448585 req-5602f148-9891-4a32-95c9-abcc23ef95cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109507 Sep 14 09:33:34.235074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2241/2917] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:34.244980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef39a87-cdc4-47fd-81a7-97cf2e8b0df4", "name": "network-vif-deleted", "tag": "a31a7a18-a23a-43ac-bdff-abd64c1a3faa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:34.273025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.278011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.278814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.305902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] Creating event network-vif-deleted:a31a7a18-a23a-43ac-bdff-abd64c1a3faa for instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 on n-h1-851028-12 Sep 14 09:33:34.315013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7fe85274-6053-440c-9bd8-1042bc546693 req-8a0005a1-7ca0-4d95-b9c5-a649e5ebf74d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078349 Sep 14 09:33:34.316824 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2242/2918] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:34.344446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:34.345487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: bef39a87-cdc4-47fd-81a7-97cf2e8b0df4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:34.357714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.358929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.359729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.361133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.362678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.363706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.421590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 HTTP/1.1 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'bef39a87-cdc4-47fd-81a7-97cf2e8b0df4'} Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:34.430062 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5c21ec2-bfbb-49ed-9b12-0bd12a2d9eb5 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4" status: 404 len: 111 microversion: 2.1 time: 0.113253 Sep 14 09:33:34.440884 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2243/2919] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:34 2022] GET /compute/v2.1/servers/bef39a87-cdc4-47fd-81a7-97cf2e8b0df4 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:34.451399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:34.452130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:34.472872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.475588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.476373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:34.477352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:34.478126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:34.479461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:35.059058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:35.074435 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6490093c-8daf-473b-b4d2-41435a22eb3b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1527 microversion: 2.1 time: 0.633410 Sep 14 09:33:35.076111 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2244/2920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:34 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1527 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:35.091074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acfe6fc4-dab1-4fdb-b380-3ea02eab3dfb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693fa2cdc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:35.145544 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-acfe6fc4-dab1-4fdb-b380-3ea02eab3dfb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Image not found. Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acfe6fc4-dab1-4fdb-b380-3ea02eab3dfb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f HTTP/1.1 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1c02ff95-b8b4-4078-978a-9f4fca376b5f'} Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1c02ff95-b8b4-4078-978a-9f4fca376b5f to delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1c02ff95-b8b4-4078-978a-9f4fca376b5f could not be found. Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.148938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:33:35.157597 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:35.164291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-acfe6fc4-dab1-4fdb-b380-3ea02eab3dfb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:35.165453 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-acfe6fc4-dab1-4fdb-b380-3ea02eab3dfb tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f" status: 404 len: 62 microversion: 2.1 time: 0.084200 Sep 14 09:33:35.167294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2245/2921] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:35 2022] DELETE /compute/v2.1/images/1c02ff95-b8b4-4078-978a-9f4fca376b5f => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:33:35.176891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:35.177965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:35.196435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:35.200909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:35.203247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:35.204589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:35.205439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:35.206109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:35.596361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:35.620219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a23dd7f2-45a7-400c-8631-222d383e368a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.450657 Sep 14 09:33:35.621096 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2246/2922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:35 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:35.648341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:35.649482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:35.660098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:35.661115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:35.664832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:35.665971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:35.667274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:35.667957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.183071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:36.192004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49a7e136-509a-4c87-8830-3eaa95c91763 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1527 microversion: 2.1 time: 0.569320 Sep 14 09:33:36.208681 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2247/2923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:35 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1527 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:36.220631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:36.221382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:36.230108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:36.233781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.234790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.235416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.236436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.237346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.237960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.264760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 HTTP/1.1 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7'} Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:36.267604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.274616 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.277655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:36.278613 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc64bc32-3667-4bff-bb22-2c720da3411b tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 404 len: 111 microversion: 2.1 time: 0.068606 Sep 14 09:33:36.279587 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2248/2924] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:36 2022] DELETE /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:36.284862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c4e9179-ba02-45c4-93d9-b71a633698cb tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:36.294967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2c4e9179-ba02-45c4-93d9-b71a633698cb tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] HTTP exception thrown: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c4e9179-ba02-45c4-93d9-b71a633698cb tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Request method failure captured: Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/flavors/c0590868-6829-45c2-aa1e-9a49f9bfb00b HTTP/1.1 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8GeK-3oGXLQ_shF_FnKo8Dxy9MEaOEjnljsoVbO1idC3voY8AiXJ9tl2BAhStnZ9H5XRBkGe7xNnsCvqWISIg0w7ik-fu2d4Co7U3sqX718Yye29O9Edm_eB3BU7ZaacX4H3RLCKEKQ6pxw18NhkMcppCrDumznDSbEUazk1DJO8U Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 42699e23d9de424998fcf7416274b5e7 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MigrationsAdminTest-394860445 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_42699e23d9de424998fcf7416274b5e7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/42699e23d9de424998fcf7416274b5e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/42699e23d9de424998fcf7416274b5e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/42699e23d9de424998fcf7416274b5e7"}]}] Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MigrationsAdminTest-394860445 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 42699e23d9de424998fcf7416274b5e7 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MigrationsAdminTest-394860445 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MigrationsAdminTest-394860445-project-admin Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 8e42cc26c64d422ebaf4c62f202d77d2 Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MigrationsAdminTest-394860445-project-admin Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: exception: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'c0590868-6829-45c2-aa1e-9a49f9bfb00b'} Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.302566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c4e9179-ba02-45c4-93d9-b71a633698cb tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Returning 404 to user: Flavor c0590868-6829-45c2-aa1e-9a49f9bfb00b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c4e9179-ba02-45c4-93d9-b71a633698cb tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/c0590868-6829-45c2-aa1e-9a49f9bfb00b" status: 404 len: 109 microversion: 2.1 time: 0.023762 Sep 14 09:33:36.309473 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2249/2925] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:36 2022] DELETE /compute/v2.1/flavors/c0590868-6829-45c2-aa1e-9a49f9bfb00b => generated 109 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:36.322834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5ff081-ea27-41e1-a625-4a35dc6318be", "name": "network-vif-plugged", "status": "completed", "tag": "93a3d7d8-f073-4526-ace5-78171e8802eb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:36.335142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.335686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.336216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.348618 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] Creating event network-vif-plugged:93a3d7d8-f073-4526-ace5-78171e8802eb for instance 9d5ff081-ea27-41e1-a625-4a35dc6318be on n-h1-851028-12 Sep 14 09:33:36.359127 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2404f298-78dc-456b-8b52-519a23ca517d req-5a8f82b7-6a0a-470b-8be8-f66ba4deb2af service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037958 Sep 14 09:33:36.360087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2250/2926] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:36.381302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:36.382318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:36.391302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.392153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.393378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.394653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:36.395322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:36.396120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:36.439859 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 HTTP/1.1 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7'} Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.442527 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e13271eb-338c-439d-a463-98fce7bfe0e6 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7" status: 404 len: 111 microversion: 2.1 time: 0.082441 Sep 14 09:33:36.448453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2251/2927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:36 2022] GET /compute/v2.1/servers/0c7d6ac7-7d32-4414-bbcc-0f3b45df80b7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:36.456955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1175948e-3aa2-467f-9d52-8cb2aa3f6d34 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e1c11f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:36.497789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1175948e-3aa2-467f-9d52-8cb2aa3f6d34 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Image not found. Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1175948e-3aa2-467f-9d52-8cb2aa3f6d34 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a HTTP/1.1 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e31f239a-a911-47f0-8e11-0c4ee6ef228a'} Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e31f239a-a911-47f0-8e11-0c4ee6ef228a to delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e31f239a-a911-47f0-8e11-0c4ee6ef228a could not be found. Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.500005 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:33:36.505559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:36.508931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1175948e-3aa2-467f-9d52-8cb2aa3f6d34 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:36.511166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1175948e-3aa2-467f-9d52-8cb2aa3f6d34 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a" status: 404 len: 62 microversion: 2.1 time: 0.061715 Sep 14 09:33:36.516590 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2252/2928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:36 2022] DELETE /compute/v2.1/images/e31f239a-a911-47f0-8e11-0c4ee6ef228a => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:33:36.524817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-83215999", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:36.608327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:33:37.629187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:33:37.631167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:33:37.632547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:33:37.634252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:33:37.636202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:33:37.654050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.655277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.656701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:37.659108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.660311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.661885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:37.707889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:37.719512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Getting quotas for user e3a2ab136fd84dd3aa3b1dd038ea988c and project e79293744c194e0ebb29be9e23e6af1f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:37.773710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:33:37.779730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:33:37.849004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cede7497-99ba-4516-af10-49c6c5d35d07 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330195 Sep 14 09:33:37.850012 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2253/2929] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:33:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:33:37.855721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:37.856474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:37.864522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.865322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.866176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:37.867239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.867968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.868599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:37.890047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 HTTP/1.1 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '17d045f7-b5e7-4952-be1b-6d5db05308a0'} Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:37.894469 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:37.902053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:37.905320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:37.906839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c388958e-07d7-438f-9f56-e4b2520dd38e tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 404 len: 111 microversion: 2.1 time: 0.055397 Sep 14 09:33:37.911873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2254/2930] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:37 2022] DELETE /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:37.918369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:37.919004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:37.930185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.930680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.931130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:37.932242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:37.933169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:37.933829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.351916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:38.366147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9eaf165-010e-4a5e-9484-39bfff28e28c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1315 microversion: 2.1 time: 0.452563 Sep 14 09:33:38.367355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2255/2931] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:37 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:38.375362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cbb0b41-68dd-4bb1-aa14-f2c6e3e4b2c7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:38.376329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cbb0b41-68dd-4bb1-aa14-f2c6e3e4b2c7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:38.560665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cbb0b41-68dd-4bb1-aa14-f2c6e3e4b2c7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:38.573423 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cbb0b41-68dd-4bb1-aa14-f2c6e3e4b2c7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1211 microversion: 2.1 time: 0.204034 Sep 14 09:33:38.582967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2256/2932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:38 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:38.589692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:38.592864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 17d045f7-b5e7-4952-be1b-6d5db05308a0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:38.608000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.608674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.610232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.612718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.617023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.618510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.652409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 HTTP/1.1 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '17d045f7-b5e7-4952-be1b-6d5db05308a0'} Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.659230 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.664938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 17d045f7-b5e7-4952-be1b-6d5db05308a0 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:38.670476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4381e666-e2cc-4e5c-8d2c-59a9da6f225c tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0" status: 404 len: 111 microversion: 2.1 time: 0.085455 Sep 14 09:33:38.671232 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2257/2933] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:38 2022] GET /compute/v2.1/servers/17d045f7-b5e7-4952-be1b-6d5db05308a0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:38.678413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-plugged", "status": "completed", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:38.716413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.718798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.719368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.738458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] Creating event network-vif-plugged:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:33:38.771674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3c7349fa-4e53-42b2-ae52-35e736a37d52 req-84c92193-e7c9-460a-bc8d-3a97aea2a062 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098417 Sep 14 09:33:38.774678 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2258/2934] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:38.788852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11809819-405b-4cad-885b-5c7c96068ee7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '.version_select at 0x7f693e2395e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:38.822150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-11809819-405b-4cad-885b-5c7c96068ee7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Image not found. Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11809819-405b-4cad-885b-5c7c96068ee7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf HTTP/1.1 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b4a98a05-6234-4cf6-ab20-7233ab526ecf'} Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b4a98a05-6234-4cf6-ab20-7233ab526ecf to delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4a98a05-6234-4cf6-ab20-7233ab526ecf could not be found. Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.824546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.830500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11809819-405b-4cad-885b-5c7c96068ee7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:38.834487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11809819-405b-4cad-885b-5c7c96068ee7 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf" status: 404 len: 62 microversion: 2.1 time: 0.053344 Sep 14 09:33:38.835131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2259/2935] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:38 2022] DELETE /compute/v2.1/images/b4a98a05-6234-4cf6-ab20-7233ab526ecf => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:33:38.846658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:38.847637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:38.862700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.863610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.864445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.865624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.866363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.867041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.885967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 HTTP/1.1 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '98b3da54-6896-4d24-af27-264326077136'} Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:38.888053 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.892737 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.895310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:38.897090 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b85eefa4-dc06-40ec-9c37-73c352477946 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "DELETE /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 404 len: 111 microversion: 2.1 time: 0.057029 Sep 14 09:33:38.898449 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2260/2936] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:33:38 2022] DELETE /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:38.909312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:38.910364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] [instance: 98b3da54-6896-4d24-af27-264326077136] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:38.955142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.955720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.956335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.957125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:38.957659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:38.958156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:38.974871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] HTTP exception thrown: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Request method failure captured: Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 HTTP/1.1 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ73aTWeuevk_CnJTtzMFsk_32VKvx18GB0JadTPXctocRmZdrJiAN-75PYBWbB-Kw8tZCNCNbt1-6jL7xxeTN-8Ve4Hk25L3HD7tTTClA7bYea0lWEkmS3z-iL6qmy5HZg12wwd8V7S6AKofgvqVUNfuUzN00bmqAO8oKrJf3xJ6Qk Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_99a0b17d01ea4f4ab65ddc6245c8350e", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/99a0b17d01ea4f4ab65ddc6245c8350e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/99a0b17d01ea4f4ab65ddc6245c8350e"}]}] Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 99a0b17d01ea4f4ab65ddc6245c8350e Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesTestJSON-212499341 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4145151290094e15916c574647542ce3 Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesTestJSON-212499341-project Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '98b3da54-6896-4d24-af27-264326077136'} Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.976569 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. Sep 14 09:33:38.982895 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:38.984730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] Returning 404 to user: Instance 98b3da54-6896-4d24-af27-264326077136 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:38.985902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1288f5ab-9c43-450e-a8e2-758a8e4bdd51 tempest-ImagesTestJSON-212499341 tempest-ImagesTestJSON-212499341-project] 10.222.0.90 "GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136" status: 404 len: 111 microversion: 2.1 time: 0.082032 Sep 14 09:33:38.987807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2261/2937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:38 2022] GET /compute/v2.1/servers/98b3da54-6896-4d24-af27-264326077136 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:39.395022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:39.395318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:39.406230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:39.406230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:39.406709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:39.407392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:39.407852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:39.408382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:40.032003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:40.040395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5752b2f-0e98-456e-bb88-caa361e26865 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1500 microversion: 2.1 time: 0.651720 Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2262/2938] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:39 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1500 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:40.055372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:40.056640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:40.056640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:40.057021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:40.094995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:40.234048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:40.246170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3316aee-3469-4795-a378-5023c0d2e74e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1269 microversion: 2.1 time: 0.203509 Sep 14 09:33:40.260580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2263/2939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:40 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:41.075714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:41.076685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:41.083961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.085110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.085573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.086290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.087169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.087767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.517104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:41.528947 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8141071-16a8-40d1-9760-b20880a5273a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1500 microversion: 2.1 time: 0.457683 Sep 14 09:33:41.540734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2264/2940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:41 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1500 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:41.551282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:41.553473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:41.565620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.566759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.567343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.568657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:41.569618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:41.570545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:41.696758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:41.715220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9eca6168-c6ab-4054-ad91-60afbd3375d2 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1269 microversion: 2.1 time: 0.170883 Sep 14 09:33:41.716892 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2265/2941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:41 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:42.558730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:42.560680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:42.577709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.578529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.579183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:42.580483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:42.581196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:42.581802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:43.840671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:43.866604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-949b1e5b-b0ba-4aa4-8029-9d8be1f6ee83 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1500 microversion: 2.1 time: 1.304773 Sep 14 09:33:43.867381 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2266/2942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:42 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1500 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:43.874319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:43.875285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:43.892138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:43.897583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:43.900866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:43.902663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:43.906220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:43.909077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.673126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:44.683243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a45cd6cc-7235-4d6f-bc0b-0abe54986f1c tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1311 microversion: 2.1 time: 0.812927 Sep 14 09:33:44.685154 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2267/2943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:43 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1311 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:44.694808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:44.707694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.708308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.709073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.721272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] Creating event network-changed:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:33:44.728272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-39bcbf41-cc13-4b68-941f-69c9ce884fbc req-60e6ba46-20bc-43e6-a3bb-2dcf85eda7ae service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040883 Sep 14 09:33:44.730043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2268/2944] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:44.892137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:44.893651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:44.900872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.902149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.903203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:44.904874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:44.905808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:44.906431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.868628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:45.896227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a57100e1-59c3-47c1-96f5-7e70a06492ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1500 microversion: 2.1 time: 1.008325 Sep 14 09:33:45.904534 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2269/2945] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:44 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1500 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:45.933378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:45.934088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:45.945587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.946366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.947005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:45.948582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:45.949236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:45.949867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:46.706178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:46.719326 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20eb7961-dc20-4d61-a14d-12adb4e6857b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1311 microversion: 2.1 time: 0.811674 Sep 14 09:33:46.720433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2270/2946] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:45 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1311 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:46.744639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5ff081-ea27-41e1-a625-4a35dc6318be", "name": "network-vif-deleted", "tag": "93a3d7d8-f073-4526-ace5-78171e8802eb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:46.760777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:46.762113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:46.764629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:46.790895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] Creating event network-vif-deleted:93a3d7d8-f073-4526-ace5-78171e8802eb for instance 9d5ff081-ea27-41e1-a625-4a35dc6318be on n-h1-851028-12 Sep 14 09:33:46.796807 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-37590e12-be61-44f9-a229-bc0d2263934a req-d9c8ab78-39da-47e8-a93d-cdcee29e8c77 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056712 Sep 14 09:33:46.797757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2271/2947] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:46.941611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:46.944234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:46.955076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:46.956224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:46.957018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:46.959013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:46.959840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:46.960456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:47.011355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:47.011861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:47.012365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:47.013648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'fault' on Instance uuid 9d5ff081-ea27-41e1-a625-4a35dc6318be {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:33:47.111415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:47.144481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f22e119-dac1-467b-84f9-a3b25c445608 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 200 len: 1305 microversion: 2.1 time: 0.209907 Sep 14 09:33:47.145376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2272/2948] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:46 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 1305 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:33:47.750022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:47.750862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:47.760835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:47.765615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:47.766121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:47.766566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:47.772527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:47.773056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:47.773511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:48.243128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:48.257726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-014c33e0-6302-4b3d-b401-3796c3a6d8e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1311 microversion: 2.1 time: 0.513896 Sep 14 09:33:48.258340 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2273/2949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:47 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:48.263722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:48.264367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:48.282886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:48.283719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:48.284577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:48.285489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:48.291153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:48.292030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:48.327543 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be HTTP/1.1 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9d5ff081-ea27-41e1-a625-4a35dc6318be'} Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:33:48.329311 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:33:48.339067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:33:48.342069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c25292a0-21cf-4a37-9f7f-59ec1af6ec41 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 404 len: 111 microversion: 2.1 time: 0.082470 Sep 14 09:33:48.342554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2274/2950] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:48 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:33:48.561009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1926257142", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:48.598611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:48.646563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:33:49.861703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:33:49.862834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:33:49.862834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:33:49.863182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:33:49.863564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:33:49.889826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:49.890455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:49.891188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:49.896578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:49.897539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:49.898193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:49.940607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:33:49.964716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:33:49.992371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:33:49.998943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:33:50.136344 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d78d4a50-d254-4d3c-849b-ae7570198a1b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580761 Sep 14 09:33:50.137534 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2275/2951] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:33:50.144027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:50.155142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:50.164387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:50.165049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:50.165837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:50.169920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:50.170774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:50.174033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:50.836927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:50.853150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc8e54af-015a-4ad3-9415-c1960f8245fd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1311 microversion: 2.1 time: 0.714012 Sep 14 09:33:50.868432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2276/2952] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:50 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1311 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:51.344915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:51.345614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:51.380898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:51.400852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:51.401809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:51.403418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:51.409246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:51.409980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:51.530344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:33:51.799596 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a12d16a-45ae-45f5-b9a0-43efaf44b538 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 204 len: 0 microversion: 2.32 time: 0.929047 Sep 14 09:33:51.812043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2277/2953] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:33:50 2022] DELETE /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:33:51.825826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:51.827927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:51.843376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:51.844934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:51.846051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:51.847806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:51.849058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:51.852000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.130745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:52.147154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1d3d2dd-9908-47a0-a7a3-a7c284513dc4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1267 microversion: 2.1 time: 0.332344 Sep 14 09:33:52.164164 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2278/2954] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:51 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1267 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:52.198321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-plugged", "status": "completed", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:52.226390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:52.227255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:52.228076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.283489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] Creating event network-vif-plugged:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:33:52.292779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ec2fabfe-42d5-4693-ab3c-8c6629117fb0 req-e8da68ba-7dfd-47cb-b473-671998ba4f0a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137898 Sep 14 09:33:52.293912 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2279/2955] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:52.312466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:52.313294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:52.326928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:52.327767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:52.329827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.331081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:52.331739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:52.332696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:52.954826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:52.985914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:52.989101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:52.991626 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc45caae-0327-42d7-a663-0153ef0649d6 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2952 microversion: 2.32 time: 0.696189 Sep 14 09:33:52.992881 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2280/2956] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:52 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2952 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:52.999825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:53.001132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:53.015325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:53.018824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.019915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.020989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.022388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.022959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.023459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.063811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:53.520252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:53.544847 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21b3b494-0b68-4313-bd5c-a4e8596066e9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1311 microversion: 2.1 time: 0.549234 Sep 14 09:33:53.545595 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2281/2957] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:52 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1311 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:53.553130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:53.553130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:53.561269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.561902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.562859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.563861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:53.564575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:53.565212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:53.738999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:53.758065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f499cb7d-ec1c-4496-bad2-fde00530a47d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1273 microversion: 2.1 time: 0.208447 Sep 14 09:33:53.760979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2282/2958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:53 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:54.033684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:54.035913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:54.045920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.046878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.047519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:54.052945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.054160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.055335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:54.668101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:54.690306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:54.692022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:54.693386 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af859453-8fd5-4234-aedf-8c8ed29a2008 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2952 microversion: 2.32 time: 0.667150 Sep 14 09:33:54.694551 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2283/2959] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:54 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2952 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:54.710512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:54.711654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:54.726080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.738517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.740710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:54.745794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:54.746586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:54.753924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.007854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:56.024677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c500182-b210-435f-8b0b-bc50b8edc684 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1460 microversion: 2.1 time: 1.325891 Sep 14 09:33:56.028086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2284/2960] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:54 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1460 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:56.042772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:56.046295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:56.064925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.067530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.071342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.074141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.074953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.078486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.736804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:56.753010 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d91c331c-16df-46f5-9380-8b80f34a8c22 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1315 microversion: 2.1 time: 0.722106 Sep 14 09:33:56.753937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2285/2961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:56 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:56.763883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-unplugged", "status": "completed", "tag": "9ccf476e-11c5-41cd-86b5-ada944305366"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:56.786966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.787737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.788540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.806353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] Creating event network-vif-unplugged:9ccf476e-11c5-41cd-86b5-ada944305366 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:33:56.813041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-be696e4d-f8b9-4615-8f79-0778a2d02c35 req-2a594eb4-1b18-4b67-b6c6-c7e2d5cc7949 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057661 Sep 14 09:33:56.814246 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2286/2962] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:56.819985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:56.820947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:56.828846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.829560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.830180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:56.831325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:56.833500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:56.834155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:57.603225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:57.625921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:57.629421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:57.631716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2731632-ac59-4a86-b9b9-02418c15628e tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2931 microversion: 2.32 time: 0.815885 Sep 14 09:33:57.646130 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2287/2963] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:56 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2931 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:33:57.672303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:57.672988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:57.682094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:57.682980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:57.683637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:57.684568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:57.685204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:57.685805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.233080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ecad27d-dbd8-4cfe-9582-7ebf7e17298d tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1613 microversion: 2.1 time: 0.584914 Sep 14 09:33:58.234283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2288/2964] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:57 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1613 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:58.243552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00ef0aac-3742-483b-a475-b041d204373d", "tag": "abb91ebc-56d5-49c6-88da-4fc340c5e083"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:58.258918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.260288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.260939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.277287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] Creating event network-changed:abb91ebc-56d5-49c6-88da-4fc340c5e083 for instance 00ef0aac-3742-483b-a475-b041d204373d on n-h1-851028-12 Sep 14 09:33:58.282950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-15f204df-d481-4f1c-b2ee-d6639b8422b8 req-dac04c40-d0e8-4661-bafd-6e839679f80f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046893 Sep 14 09:33:58.284514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2289/2965] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:33:58.295831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:58.295831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:58.302247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.302247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.302247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.304111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.304111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.304111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.766229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:58.779279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83a088b5-0dbd-4df8-b2dd-4f36874f0136 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1315 microversion: 2.1 time: 0.493278 Sep 14 09:33:58.797728 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2290/2966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:33:58 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:33:58.816175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:33:58.817048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:58.827486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.828275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.828783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.829576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:58.830294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:58.830792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:58.867255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8e42cc26c64d422ebaf4c62f202d77d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699e23d9de424998fcf7416274b5e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:33:58.868006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] flavor_id is None. Assuming migration. {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 09:33:58.868529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 09:33:59.032290 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd78aeaf-d180-4441-86d9-b4c305ef9125 tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.232863 Sep 14 09:33:59.033428 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2291/2967] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:33:58 2022] POST /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:33:59.039611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:33:59.040735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:33:59.061150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.065819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.066530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.068841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:33:59.071975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:33:59.073238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:33:59.907263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:33:59.974888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:00.062957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:00.080348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:00.082212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:00.085634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b56c636b-9246-4346-8529-52a1ff689da3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2863 microversion: 2.32 time: 1.050967 Sep 14 09:34:00.099420 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2292/2968] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:33:59 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2863 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:00.127102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-unplugged", "status": "completed", "tag": "1997a392-ef74-4aa6-a907-5d66aab6e0c3"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce7fcce-4b40-48f5-85a2-e418e5efd248"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-unplugged", "status": "completed", "tag": "2cadb215-5e51-45c2-abc9-874896bafee9"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-unplugged", "status": "completed", "tag": "e5599917-9c4b-499a-9b53-6c5f21cedbd6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:00.147888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:00.148687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:00.149525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:00.204967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Creating event network-vif-unplugged:1997a392-ef74-4aa6-a907-5d66aab6e0c3 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:00.208209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Creating event network-vif-unplugged:2ce7fcce-4b40-48f5-85a2-e418e5efd248 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:00.208992 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Creating event network-vif-unplugged:2cadb215-5e51-45c2-abc9-874896bafee9 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:00.209784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] Creating event network-vif-unplugged:e5599917-9c4b-499a-9b53-6c5f21cedbd6 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:00.221688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-977be938-85de-49eb-91cd-5ef048826281 req-9d44df06-901e-49e4-8386-bcf2cba89601 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.120493 Sep 14 09:34:00.226874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2293/2969] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:00.233601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:00.243356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:00.258627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:00.259629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:00.260483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:00.264946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:00.265716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:00.266366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:01.325658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:01.354497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8251720-50de-4ba9-be8e-85b6de48f061 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1469 microversion: 2.1 time: 1.125891 Sep 14 09:34:01.355412 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2294/2970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:00 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1469 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:01.360579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:01.367539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:01.383585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:01.387548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:01.388054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:01.392330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:01.392927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:01.393825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:04.190697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:04.210007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44da2fc8-76ee-4641-8f24-dac9c0260048 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1315 microversion: 2.1 time: 2.853031 Sep 14 09:34:04.223977 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2295/2971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:01 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1315 bytes in 2868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:04.230330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-deleted", "tag": "e5599917-9c4b-499a-9b53-6c5f21cedbd6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:04.258598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:04.265895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:04.266913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:04.308464 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] Creating event network-vif-deleted:e5599917-9c4b-499a-9b53-6c5f21cedbd6 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:04.316814 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a8f22ade-9c1f-47de-ac75-8ae2b516fcc2 req-efc71582-d2ff-4f6d-8257-088e514651d8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090459 Sep 14 09:34:04.318055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2296/2972] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:04.325650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:04.326894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:04.335407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:04.336281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:04.336931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:04.337975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:04.338727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:04.339394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:05.091104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:05.116910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:05.121174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:05.124656 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f93015b5-6c17-4e92-8720-0f3d08930ad8 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2703 microversion: 2.32 time: 0.804972 Sep 14 09:34:05.125819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2297/2973] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:04 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2703 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:05.147528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:05.148493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:05.160457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:05.161303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:05.162764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:05.163739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:05.164405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:05.165119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.109730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:06.153571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb91bfab-25b5-4c8a-be7a-cfd73e413caf tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1469 microversion: 2.1 time: 1.023668 Sep 14 09:34:06.157362 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2298/2974] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:05 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1469 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:06.172257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:06.173153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:06.189633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.193070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.194166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.196791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.200758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.203765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.254931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:06.297057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17a46035-57cc-4dfd-9efd-82978fb6a140 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments/64fca174-12d0-4108-b497-5b1f15262ee5" status: 200 len: 194 microversion: 2.20 time: 0.137578 Sep 14 09:34:06.297790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2299/2975] 10.222.0.90 () {60 vars in 1454 bytes} [Wed Sep 14 09:34:06 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments/64fca174-12d0-4108-b497-5b1f15262ee5 => generated 194 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:06.329100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:06.330990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:06.354294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.357976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.358677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.360795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.361266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.362558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.784861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:06.793815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84067c5b-5dee-4d99-9efc-a5b720ce172a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1315 microversion: 2.1 time: 0.479382 Sep 14 09:34:06.794529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2300/2976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:06 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:06.817322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:06.818142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:06.828741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.830434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.830915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:06.832453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:06.832958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:06.833386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:07.481761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:07.495275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:07.508591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:07.512662 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1122a7d6-7579-4c09-9537-e3d6db066c14 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 2656 microversion: 2.32 time: 0.702387 Sep 14 09:34:07.514563 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2301/2977] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:06 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 2656 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:07.526556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ef0aac-3742-483b-a475-b041d204373d", "name": "network-vif-plugged", "status": "completed", "tag": "abb91ebc-56d5-49c6-88da-4fc340c5e083"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:07.553429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:07.557188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:07.557640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:07.595685 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] Creating event network-vif-plugged:abb91ebc-56d5-49c6-88da-4fc340c5e083 for instance 00ef0aac-3742-483b-a475-b041d204373d on n-h1-851028-12 Sep 14 09:34:07.615707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c958edba-b905-49d5-827b-5a70fb72a97c req-ce130ec7-3626-4e59-a1e6-09d859d9b41e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098591 Sep 14 09:34:07.622136 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2302/2978] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:07.636586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-deleted", "tag": "2ce7fcce-4b40-48f5-85a2-e418e5efd248"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:07.664988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:07.669789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:07.670231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:07.710823 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] Creating event network-vif-deleted:2ce7fcce-4b40-48f5-85a2-e418e5efd248 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:07.729038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2c0a5ead-e4d2-4c2d-98b0-dfd4b09f8575 req-f4063162-b142-4078-87b4-cbbbf1555319 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104037 Sep 14 09:34:07.729997 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2303/2979] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:07.759034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:07.760909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:07.785206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:07.789714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:07.790153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:07.795287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:07.796400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:07.797659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:08.070791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lazy-loading 'services' on Instance uuid f933d22d-e5d8-4d9f-843f-a1edf164822b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:34:08.272222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-198d818c-d1f0-4657-a7e2-a1b1f34306e5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments/64fca174-12d0-4108-b497-5b1f15262ee5" status: 202 len: 0 microversion: 2.20 time: 0.536275 Sep 14 09:34:08.278816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2304/2980] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Sep 14 09:34:07 2022] DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments/64fca174-12d0-4108-b497-5b1f15262ee5 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:08.293837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:08.295106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:08.314875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:08.316242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:08.318272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:08.320437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:08.323022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:08.323665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:08.716849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:08.731312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b15d3d4-a810-472f-a82f-d45db0d54f68 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.450691 Sep 14 09:34:08.746251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2305/2981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:08 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:08.746251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:08.746251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:08.767633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:08.768840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:08.771083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:08.771861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:08.774665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:08.775625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.308218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:09.317300 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7ad7439-c1a8-4919-bd97-636b2e762c08 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1315 microversion: 2.1 time: 0.579800 Sep 14 09:34:09.339811 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2306/2982] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:08 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:09.346043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:09.358412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:09.380131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.381035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.381671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.382577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.383205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.383884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.471374 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b22a580-0c76-446a-aa62-ecae9d234f04 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130511 Sep 14 09:34:09.473937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2307/2983] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:34:09 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:09.497294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:09.501890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:09.525703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.529174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.531667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.532778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.533525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.534692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.774737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:09.789917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:09.794401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:09.798272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f88ff09-dc10-4cbe-97fe-45f8cde60ca2 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.322596 Sep 14 09:34:09.800220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2308/2984] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:09 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:09.812032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:09.816995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:09.832905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.833698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.834318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:09.835223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:09.839861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:09.840781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:10.361138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:10.369788 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8902683b-9fb8-4acc-86f1-dd33b42b3609 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.567664 Sep 14 09:34:10.395456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2309/2985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:09 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:10.414075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-deleted", "tag": "2cadb215-5e51-45c2-abc9-874896bafee9"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-deleted", "tag": "1997a392-ef74-4aa6-a907-5d66aab6e0c3"}, {"server_uuid": "5d61b4df-fc15-4ce2-a0d1-83afa829b86a", "name": "network-vif-deleted", "tag": "9ccf476e-11c5-41cd-86b5-ada944305366"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:10.456030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:10.457043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:10.460630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:10.496576 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Creating event network-vif-deleted:2cadb215-5e51-45c2-abc9-874896bafee9 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:10.504769 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Creating event network-vif-deleted:1997a392-ef74-4aa6-a907-5d66aab6e0c3 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:10.505832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] Creating event network-vif-deleted:9ccf476e-11c5-41cd-86b5-ada944305366 for instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a on n-h2-851028-12 Sep 14 09:34:10.515658 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-48d96e20-6b8f-458f-8ad9-83c82b767018 req-0d063178-0d49-4a6c-8a46-d7fc252b5b84 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.114401 Sep 14 09:34:10.516780 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2310/2986] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:10.530884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:10.531913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:10.551477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:10.554180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:10.555233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:10.559424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:10.562132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:10.562910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:11.863588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:11.878265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a43c6e1f-948d-4aac-be9b-d09cdade6fee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1501 microversion: 2.1 time: 1.359992 Sep 14 09:34:11.901819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2311/2987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:10 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1501 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:11.916476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:11.919359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:11.937245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:11.938037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:11.944532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:11.945790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:11.946515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:11.948042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:12.019732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f34bbd0d-1661-4594-abcf-5973e6e8111b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115829 Sep 14 09:34:12.027597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2312/2988] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:34:11 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:12.033020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:12.033612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:12.039834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:12.040891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:12.041605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:12.042489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:12.043101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:12.043693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:12.265587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:12.284636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:12.289065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:12.296628 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8e087e1-c6f1-45d5-8d2b-817952009b39 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.264259 Sep 14 09:34:12.299781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2313/2989] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:12 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:12.315659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:12.316655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:12.337905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:12.339206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:12.342004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:12.343044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:12.345598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:12.346349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.042900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:13.053393 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75220cef-86cb-4026-b2b4-4ddec1861fd6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.749620 Sep 14 09:34:13.054004 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2314/2990] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:12 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:13.068332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:13.073526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:13.102971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.104858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.106008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.107006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.107709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.108399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.347596 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c8feaa7-a6d9-4b25-8fe2-cc1e8a809af4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d/action" status: 202 len: 0 microversion: 2.1 time: 0.292322 Sep 14 09:34:13.348307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2315/2991] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:13 2022] POST /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:34:13.373091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:13.376402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:13.394107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.396360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.400120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.402091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.402954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.405553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.419636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:13.521404 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-935345a2-6baa-4d27-9d7a-ed70dcc53493 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.171762 Sep 14 09:34:13.522249 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2316/2992] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:34:13 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:13.531318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:13.534173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:13.549409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.551070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.553756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.556187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.557936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.560120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.817230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:13.833950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:13.835412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:13.836655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70e27809-ec6f-418b-8aa2-cac48802a637 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.313136 Sep 14 09:34:13.840749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2317/2993] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:13 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:13.851477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:13.852155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:13.872995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.873481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.873918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:13.874851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:13.875532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:13.876150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:14.163638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:14.184633 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e224b0f-ef68-466c-a085-7876af2c8a3d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1486 microversion: 2.1 time: 0.334471 Sep 14 09:34:14.186042 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2318/2994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:13 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1486 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:14.526548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-155614973", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "97594a1c-c3e5-4a53-bda5-9ff07554f88b"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:14.636255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] validate_networks() for [('97594a1c-c3e5-4a53-bda5-9ff07554f88b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:34:16.236715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:34:16.240529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:34:16.242866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:34:16.245505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:34:16.246184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:34:16.268794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.269663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.270631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:16.273286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.274365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.275448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:16.314308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:16.328950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for user bcaca2d700a54540918f61d900ba2a1d and project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:16.354872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:34:16.358301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:34:16.491490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db6d5860-6629-45c4-9369-f0f7532cea95 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.298962 Sep 14 09:34:16.494445 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2319/2995] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:34:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:34:16.515567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:16.519079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:16.542039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.543064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.544409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:16.545502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.546244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.547079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:16.815222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:16.830208 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f65fc16-315f-4c5b-a0c3-e084656c0bc7 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.334528 Sep 14 09:34:16.851399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2320/2996] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:16 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:16.866397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:16.867188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:16.891489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.893948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.896112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:16.898932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:16.901611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:16.902181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.013548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:34:17.241702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:17.262766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc0a450f-23c8-4d42-a19f-c17e889a1799 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 204 len: 0 microversion: 2.1 time: 0.408529 Sep 14 09:34:17.263583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2321/2997] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:34:16 2022] DELETE /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:17.274337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:17.282514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:17.300050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.307454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.308292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.309252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.309723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.310151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.404280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81130bb0-15fa-454b-8334-ab5117eaf871 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135638 Sep 14 09:34:17.407628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2322/2998] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:34:17 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:34:17.419229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:17.426638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:17.435251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.436101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.436417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.437163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.437633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.438071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.615538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:17.631797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:17.638170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:17.640651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4143171c-cd5a-460d-9afc-bcdc8e7ac863 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.231347 Sep 14 09:34:17.657762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2323/2999] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:17 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:17.678512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:17.683776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:17.699517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.700356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.703766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.706050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.706874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.717295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.842438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:17.854610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6dad0bab-5ac1-4db3-acf8-e821927b6baf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1228 microversion: 2.1 time: 0.192530 Sep 14 09:34:17.855838 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2324/3000] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:17 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1228 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:17.865648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:17.869436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:17.888947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.891827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.892312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:17.894423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:17.897052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:17.897934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.243042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:18.257894 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ba121c4-9864-4203-8e28-da0313ab8209 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1492 microversion: 2.1 time: 0.400563 Sep 14 09:34:18.261514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2325/3001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:17 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1492 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:18.276456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:18.278338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:18.287047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.288106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.288907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.291950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.292830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.293544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.524541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:18.533089 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1493540e-f8bf-4fbf-bef2-95718bd9c345 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.270401 Sep 14 09:34:18.533795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2326/3002] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:18 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:18.551646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:18.572469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:18.585030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.585868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.586617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.588593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.590348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.591253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.657907 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-444df5e1-ba14-4a4a-8bba-835f4608df70 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.122584 Sep 14 09:34:18.667026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2327/3003] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:34:18 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:18.672061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:18.673175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:18.680064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.680493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.681905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:18.683132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:18.683787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:18.684447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:19.783220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:19.797536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:19.799618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:19.801586 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10433b13-4ef4-47af-8470-636e09354f70 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 1.133316 Sep 14 09:34:19.802917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2328/3004] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:18 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:19.810055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:19.811324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:19.825062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:19.825902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:19.827076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:19.828883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:19.829560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:19.830646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:19.872581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:34:20.149352 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccb6655b-9815-441d-873f-33be41de8853 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 204 len: 0 microversion: 2.20 time: 0.335756 Sep 14 09:34:20.156715 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2329/3005] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:34:19 2022] DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:34:20.176226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:20.189192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:20.201231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.236756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.237802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:20.238578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.239037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.242396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:20.263349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:20.434081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:20.444780 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4ce9beb-7c1e-4542-a471-a745dece5857 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1282 microversion: 2.1 time: 0.286576 Sep 14 09:34:20.466562 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2330/3006] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:20 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:20.476781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:20.480817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:20.512895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.519557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.520806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:20.525750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.527159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.527811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:20.812924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:20.840751 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-653ab078-5806-4c64-be6f-b38eb793ee3e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 200 len: 1492 microversion: 2.1 time: 0.379110 Sep 14 09:34:20.863585 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2331/3007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:20 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 1492 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:20.878561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:20.879646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:20.888058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.889027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.889708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:20.890769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:20.891485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:20.893438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:21.339442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:21.357628 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d747cf2-2407-4731-a3fe-f6144358761b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.489756 Sep 14 09:34:21.358149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2332/3008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:20 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:21.380847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:21.381467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:21.402940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:21.403545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:21.404020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:21.404756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:21.405215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:21.405644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:22.004286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.032069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.038857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.041520 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fce61dd3-d8ae-481c-9f4f-6f69db3f4aed tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 0.663801 Sep 14 09:34:22.042653 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2333/3009] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:21 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:22.053394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:22.054364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:22.064657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:22.065230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:22.065591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:22.066313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:22.066824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:22.067394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:22.359666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.382924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.389164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:22.397456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d0aa15aa-e611-46a3-b567-14ef63097eb9 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.353478 Sep 14 09:34:22.400525 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2334/3010] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:22 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:22.407982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:22.408620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:22.433150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:22.433676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:22.434303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:22.435050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:22.435519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:22.436011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.011529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:23.020420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46efdf63-3678-4b88-8291-da9175e97941 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.618592 Sep 14 09:34:23.021350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2335/3011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:22 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:23.037179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:23.037821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:23.052226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.053099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.053740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.054744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.070728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.071222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.150512 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d HTTP/1.1 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '00ef0aac-3742-483b-a475-b041d204373d'} Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:23.152545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17ed7516-3479-41c0-971d-e90532e01d7d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 404 len: 111 microversion: 2.1 time: 0.131350 Sep 14 09:34:23.158137 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2336/3012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:23 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:34:23.184466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00ef0aac-3742-483b-a475-b041d204373d", "name": "network-vif-deleted", "tag": "abb91ebc-56d5-49c6-88da-4fc340c5e083"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:23.206689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.207513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.208177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.224151 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] Creating event network-vif-deleted:abb91ebc-56d5-49c6-88da-4fc340c5e083 for instance 00ef0aac-3742-483b-a475-b041d204373d on n-h1-851028-12 Sep 14 09:34:23.231675 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d3a7f39e-cdd1-4cdc-a787-4e3db5b2466f req-265a755e-6e64-42f0-a8fe-e3ea5331a81a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075945 Sep 14 09:34:23.233328 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2337/3013] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:23.239308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:23.240720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:23.249737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.250818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.251523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.252779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.253483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.254158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.680247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:23.689342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92924b49-c19d-46fb-8fae-dbd16ce91501 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 0.454519 Sep 14 09:34:23.695562 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2338/3014] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:23 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:23.713722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:23.714866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:23.731807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.735421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.736150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:23.738181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:23.740871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:23.741675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:24.198769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.215515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.217484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.219006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-069183ef-7f3c-4810-9e66-50a689148258 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1724 microversion: 2.20 time: 0.521846 Sep 14 09:34:24.220756 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2339/3015] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:23 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:24.227472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:24.229192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:24.236227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:24.237080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:24.237765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:24.238731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:24.239409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:24.240097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:24.491332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.511678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.513462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:24.515095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5cb80c4-6499-4de3-9286-c5117977890a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.291639 Sep 14 09:34:24.532597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2340/3016] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:24 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:24.547305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2052191969", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:24.697372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:34:25.959932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:34:25.961551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:34:25.962882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:34:25.963645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:34:25.964699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:34:25.977567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:25.981283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:25.982195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:25.984682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:25.985582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:25.986558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:26.031890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:26.038878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:26.055666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:34:26.059749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:34:26.131538 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-794a6089-e69c-4156-a75d-c06cc963bf62 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597473 Sep 14 09:34:26.136038 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2341/3017] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:34:26.146350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:26.147882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:26.158500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:26.159288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:26.160082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:26.161121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:26.161766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:26.162378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:26.595555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:26.612424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c7584b2-47d4-4a57-8861-94e9e16784dc tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.474001 Sep 14 09:34:26.615998 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2342/3018] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:26 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:26.638511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:26.639144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:26.666200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:26.667641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:26.668129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:26.669253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:26.669738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:26.670174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:28.080957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.093725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4641e9a3-cc6e-4c69-ac5d-4a8aff7f6b93 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1474 microversion: 2.1 time: 1.475855 Sep 14 09:34:28.095102 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2343/3019] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:26 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1474 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:28.127579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:28.130798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:28.158746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:28.160691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:28.161335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:28.166635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:28.167500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:28.168174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:28.576391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.613450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.617387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.620353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2fbb259-837e-49ef-8846-2f255030862f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 200 len: 1366 microversion: 2.20 time: 0.523414 Sep 14 09:34:28.622234 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2344/3020] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:28 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:28.629969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:28.631087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:28.642295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:28.643208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:28.644441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:28.646799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:28.648757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:28.650623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:28.963868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.984589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.986912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:28.989046 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cbd0ad01-bf16-41e0-99ce-82bcd08764c3 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.365340 Sep 14 09:34:29.006553 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2345/3021] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:28 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:29.022740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:29.023828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:29.035413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.036471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.038094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.039674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.041128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.041966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.183816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:29.198771 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dde2a10d-434b-4fe7-b103-8cafd21fd677 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1267 microversion: 2.1 time: 0.182861 Sep 14 09:34:29.216197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2346/3022] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:29 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:29.230164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fba5d56-a673-4635-bfe6-0a730034b64c", "tag": "b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:29.276477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.276997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.277428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.313091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] Creating event network-changed:b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d for instance 8fba5d56-a673-4635-bfe6-0a730034b64c on n-h2-851028-12 Sep 14 09:34:29.327239 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cbab26f7-a053-4015-8566-b0cda934e8ce req-5cc74c27-394e-4f8f-8f6f-09b2e85d24ac service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109134 Sep 14 09:34:29.328577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2347/3023] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:29.341593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:29.344390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:29.362050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.362386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.371332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.372160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.372652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.373097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.818933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:29.831805 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc733461-d5b4-40aa-912c-1a4aaaceea56 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.500808 Sep 14 09:34:29.847239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2348/3024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:29 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:29.853618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:29.854810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:29.867470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.870830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.871434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.873001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:29.875109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:29.875772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:29.915857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:30.233417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:30.288977 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8597ff4a-d76d-4de9-912c-a14f0392ff87 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1473 microversion: 2.1 time: 0.436136 Sep 14 09:34:30.294755 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2349/3025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:29 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1473 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:30.303959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:30.312248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:30.324764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.325462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.326249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.327244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.327957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.329459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.383948 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b HTTP/1.1 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f933d22d-e5d8-4d9f-843f-a1edf164822b'} Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:30.387227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:34:30.392598 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:30.397979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:30.399170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc09314b-6dce-481f-b820-6624bfa646c3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 404 len: 111 microversion: 2.20 time: 0.103028 Sep 14 09:34:30.407308 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2350/3026] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:30 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:30.420717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:30.422110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:30.439359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.441438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.442162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.443772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.444511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.445161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.581497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:30.605834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:30.611196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:30.614100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ebea9b98-d0c7-4cd5-b03d-174b39e0b212 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.203586 Sep 14 09:34:30.616859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2351/3027] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:30 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:30.638321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:30.638976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:30.646853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.647365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.647841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.648708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.649178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.650364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.785423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:30.802313 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9de66426-b2c2-429a-b125-604538c39210 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1273 microversion: 2.1 time: 0.180622 Sep 14 09:34:30.803433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2352/3028] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:30 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:30.810111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-896b61b0-95a7-4480-af74-fa2eb4458de7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '.version_select at 0x7f693e8ce430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:30.852101 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-896b61b0-95a7-4480-af74-fa2eb4458de7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797466476" status: 204 len: 0 microversion: 2.20 time: 0.047144 Sep 14 09:34:30.853521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2353/3029] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797466476 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:34:30.859137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:30.869746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.870471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.871070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.884602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Creating event network-vif-unplugged:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h2-851028-12 Sep 14 09:34:30.891353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] Instance a96cc8de-e682-403f-b2a5-09086f762fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:34:30.904206 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-10b5f4e0-b7a4-401d-b073-2065333e3e38 req-30900787-64d0-48f1-9413-fc84ce9472c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049270 Sep 14 09:34:30.905716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2354/3030] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:30.910960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:30.911931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:30.919349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.920174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.920784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:30.921656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:30.922334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:30.922928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:31.465523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:31.481455 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d955ff28-eb34-4075-b6d7-573ac7b0b283 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.574316 Sep 14 09:34:31.482069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2355/3031] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:30 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:31.486712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:31.487326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:31.509837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:31.509837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:31.510647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:31.511307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:31.511771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:31.512254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:31.880589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:31.893976 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-640b2b8e-689d-4864-885e-c51059824fb6 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1473 microversion: 2.1 time: 0.410778 Sep 14 09:34:31.894990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2356/3032] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:31 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1473 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:31.911172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:31.913765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:31.940224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:31.941236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:31.942218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:31.943608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:31.944853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:31.945406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.092456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:32.108645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:32.110529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:32.114001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-746ed82a-29c3-4f56-b2e8-d412ff10006a tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.217054 Sep 14 09:34:32.119741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2357/3033] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:31 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:32.128098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f933d22d-e5d8-4d9f-843f-a1edf164822b", "name": "network-vif-deleted", "tag": "756dc53a-125d-4713-87a8-33607a3cfc53"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:32.148589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.154876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.155541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.177289 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] Creating event network-vif-deleted:756dc53a-125d-4713-87a8-33607a3cfc53 for instance f933d22d-e5d8-4d9f-843f-a1edf164822b on n-h1-851028-12 Sep 14 09:34:32.194783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-28bbc0f1-c611-44ca-9767-e29f22ec8262 req-3d016668-e0b0-472e-9ed9-17356917785d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073275 Sep 14 09:34:32.196041 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2358/3034] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:32.202475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:32.215682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:32.218061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:32.230821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.231591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.232232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.233154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.236403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.237092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.783367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:32.791756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c17e8574-5201-4900-b4f2-64e9c170a756 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.593625 Sep 14 09:34:32.809956 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2359/3035] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:32 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:32.815870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:32.816904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:32.824856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.825744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.826489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:32.827747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:32.828495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:32.829165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.513146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:33.528725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46122381-f1a6-4c5a-888f-b070c7832b2c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.710381 Sep 14 09:34:33.531915 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2360/3036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:32 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:33.547820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:33.552958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:33.576677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.580274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.581031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:33.582069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:33.582900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:33.583714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.003696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:34.014568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a64c3cfa-759c-40f2-bc79-7df04bd428bd tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1473 microversion: 2.1 time: 0.481091 Sep 14 09:34:34.019372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2361/3037] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:33 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1473 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:34.029659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:34.059052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.062564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.064037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.093219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Creating event network-changed:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h2-851028-12 Sep 14 09:34:34.101204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] Instance a96cc8de-e682-403f-b2a5-09086f762fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:34:34.115518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c4ece9db-0534-49c7-87bc-98e783e9c615 req-405dd4d1-a1c4-4f00-a061-16ee92865faf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093432 Sep 14 09:34:34.116757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2362/3038] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:34.136742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:34.138268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:34.146705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.147704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.149003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.150858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.151580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.152356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.787127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:34.808033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:34.811966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:34.813330 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5600af5-c696-42e7-8ad6-c4cf7e2b4203 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.695171 Sep 14 09:34:34.829809 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2363/3039] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:34 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:34.842681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c2dc3f18-7225-4eab-8480-35e254929030 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: .version_select at 0x7f693e932ca0>, body: {"keypair": {"name": "tempest-keypair-1192329653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELHLdbaWWvGDYklTccwrvxmgx0OqIgtplUbZuwHs+Nzgnx9RK1MzCGtRO6KxJTCva9ChjuCwQF2mI++005N/+o/irWLCs/F+EUCTHX4N/J1tVQuISHABcq1zVrJ3Vv3zg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:34.863550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c2dc3f18-7225-4eab-8480-35e254929030 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:34.869364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c2dc3f18-7225-4eab-8480-35e254929030 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for user 116e4c7e83ce4e62b00dd7ce80aab5a2 and project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:34.901623 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c2dc3f18-7225-4eab-8480-35e254929030 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.070425 Sep 14 09:34:34.909432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2364/3040] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:34:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:34:34.911177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:34.911953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:34.920048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.920553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.920997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:34.921875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:34.922391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:34.923008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:35.477443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:35.499408 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac38de1c-a607-4157-a401-349ae279822e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.588874 Sep 14 09:34:35.503935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2365/3041] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:34 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:35.513634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fba5d56-a673-4635-bfe6-0a730034b64c", "name": "network-vif-plugged", "status": "completed", "tag": "b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:35.548538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:35.557249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:35.558863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:35.579132 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] Creating event network-vif-plugged:b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d for instance 8fba5d56-a673-4635-bfe6-0a730034b64c on n-h2-851028-12 Sep 14 09:34:35.585940 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fe6353d3-f381-415c-bf62-19097e4cbaf9 req-585dff3f-3f95-4f1d-9d25-eb976d8a6cdb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080182 Sep 14 09:34:35.590168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2366/3042] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:35.637719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:35.639229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:35.650723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:35.651232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:35.653307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:35.654677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:35.667338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:35.669218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.007657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:36.292104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.304108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a78b1f5-c2b1-4108-998f-e49a7b7692ff tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.711300 Sep 14 09:34:36.308629 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2367/3043] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:35 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:36.322372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aab17a3-a626-47cd-a176-866f1e66c32b", "tag": "5542d625-072b-461d-9336-3fdb4995daaf"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:36.341196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.341688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.342124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.366884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] Creating event network-changed:5542d625-072b-461d-9336-3fdb4995daaf for instance 3aab17a3-a626-47cd-a176-866f1e66c32b on n-h1-851028-12 Sep 14 09:34:36.381884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6192d488-d9c9-4e28-b826-2abed5ec3c1b req-4e423dd3-ed53-44b3-b7ce-302b18bab3a3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071919 Sep 14 09:34:36.386111 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2368/3044] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:36.394774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:36.395489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:36.416625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.417164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.417612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.418344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.418804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.419233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.654856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.668911 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de5c6633-feb2-4e04-8654-b0fced00d33a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1468 microversion: 2.1 time: 0.281611 Sep 14 09:34:36.691699 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2369/3045] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:36 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1468 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:36.702320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:36.703024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:36.713226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.713858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.714500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.715313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.715791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.716263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.848254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.866933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.870186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:36.871032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-57a89b1d-8606-48dd-9de6-b99838c33904 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.178227 Sep 14 09:34:36.879952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2370/3046] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:36 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:36.890214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:36.891346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:36.901540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.902992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.904457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.906234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:36.906715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:36.907374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:36.948616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:37.218844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:37.233721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd692a38-d0a7-4990-b5a9-16021601d1db tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.351338 Sep 14 09:34:37.235188 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2371/3047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:36 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:37.242329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:37.243234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:37.261399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.263002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.263703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:37.265812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.267072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.268348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:37.476111 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7557c3ac-5c21-45bb-b3f2-a6bc33eecd01 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "POST /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.238616 Sep 14 09:34:37.476750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2372/3048] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:37 2022] POST /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:34:37.498579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:37.501380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:37.528887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.529396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.531699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:37.533934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:37.535819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:37.536479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.075065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:38.095218 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-397b0603-e554-4065-a69f-82c747e421d1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1324 microversion: 2.1 time: 0.617172 Sep 14 09:34:38.096310 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2373/3049] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:37 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:38.101554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:38.103811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:38.114404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:38.117586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:38.118658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.120005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:38.120648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:38.121589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.642064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:38.662514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c07d334-bc80-41ff-88fc-0673bbe59e53 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1467 microversion: 2.1 time: 0.564773 Sep 14 09:34:38.667355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2374/3050] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:38 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1467 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:38.677710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:38.682092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:38.692455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:38.693564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:38.694368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.695402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:38.696140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:38.698030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.914205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:38.926265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:38.928144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebb3a51601cf4b1eb53a185555ee574e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13dda24ab614859ad25993717e7235d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:38.929592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d14c808-217b-4558-87b5-6e0356533775 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 200 len: 1605 microversion: 2.32 time: 0.258929 Sep 14 09:34:38.931305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2375/3051] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:38 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 1605 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:38.936580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-plugged", "status": "completed", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:38.948883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:38.949591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:38.950208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:38.965490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Creating event network-vif-plugged:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h2-851028-12 Sep 14 09:34:38.972803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] Instance a96cc8de-e682-403f-b2a5-09086f762fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:34:38.986509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-67d46262-2360-4757-ade4-a998479ffce5 req-a3ed0489-a7a8-4709-ab1e-d63f6e468fd4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053381 Sep 14 09:34:38.988215 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2376/3052] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:38.996204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:38.997724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:39.005761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:39.007311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:39.008319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:39.010224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:39.011386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:39.012412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:39.351930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:39.362000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c39e684-a9b5-42f9-9a63-429e0a4e8139 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.372244 Sep 14 09:34:39.362609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2377/3053] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:38 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:39.377313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-962898110", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc3713a2-3955-4c6d-8194-3c354d4a86d3"}], "security_groups": [{"name": "tempest-securitygroup--1629734777"}], "key_name": "tempest-keypair-1192329653", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:39.585351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] validate_networks() for [('fc3713a2-3955-4c6d-8194-3c354d4a86d3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:34:41.274090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:34:41.274955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:34:41.275371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:34:41.276069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:34:41.276391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:34:41.288750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=17 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:41.292948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.294555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.296339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:41.297910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.299004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.300731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:41.322744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:34:41.328124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Getting quotas for user 116e4c7e83ce4e62b00dd7ce80aab5a2 and project 21b2d5efe3d2479fae21e38e09675e60. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:34:41.341370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:34:41.343749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:34:41.399101 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b7c3cf4-d2b4-4445-a49e-1d2038d00779 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.033233 Sep 14 09:34:41.400201 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2378/3054] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:34:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:34:41.411324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:41.412645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:41.420973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.421518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.422857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:41.423801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.424772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.425464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:41.771994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:41.784008 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64a06982-1201-474f-9048-9608b17fd19e tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.381629 Sep 14 09:34:41.818909 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2379/3055] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:41 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:41.838826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:41.842797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:41.855862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.856977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.857634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:41.858772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:41.859430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:41.861577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.204619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:42.221898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-829a900b-0582-4eb5-900f-450a26a28d1f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1467 microversion: 2.1 time: 0.401362 Sep 14 09:34:42.225319 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2380/3056] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:41 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1467 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:42.249151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:42.250140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:42.260770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.261978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.262390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.263246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.263778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.264259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.281571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] HTTP exception thrown: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Request method failure captured: Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a HTTP/1.1 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ28tWKQA1W1QepVdoYnL7w9leEv_pHaTr81LKN2txpjiWCkaEbusnyG51sd4QdIVuku2n62jgYz4JgWRHRI8PxM2I4ACdTrE4mLqaVivl9blM6ccr0P-2t6CG1A0mLp6_3NBR4kSDC5rudY7k3xehNaPJRzJnIyCzA46eRxBmQDh74 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c13dda24ab614859ad25993717e7235d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c13dda24ab614859ad25993717e7235d"}]}] Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ebb3a51601cf4b1eb53a185555ee574e Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5d61b4df-fc15-4ce2-a0d1-83afa829b86a'} Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:42.284080 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:42.291012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:42.298597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Returning 404 to user: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:42.298597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c58fea14-3b57-4e64-8d4c-b3ade773b8b5 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 404 len: 111 microversion: 2.32 time: 0.067385 Sep 14 09:34:42.298597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2381/3057] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:42 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:42.306377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:42.307470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:42.314925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.315809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.316583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.317582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.318286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.318950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.705360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:42.715622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a91479cd-a1f4-4feb-9d07-c2b9efab33df tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.415235 Sep 14 09:34:42.716710 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2382/3058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:42 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:42.723808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:42.724747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:42.736892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.737642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.738255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.739170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.739997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.740600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.851692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:42.866538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:42.868849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:42.873165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc0ecb0a-89ac-450d-b188-e62c8cb5fff3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1333 microversion: 2.20 time: 0.152737 Sep 14 09:34:42.874446 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2383/3059] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:42 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1333 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:42.881980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:42.883202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:42.897633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.898955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.900652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:42.903282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:42.903990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:42.905377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:43.324802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:43.336629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aabd4b78-0b2f-40a9-bf0c-6ed17ae949c4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.459836 Sep 14 09:34:43.338066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2384/3060] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:42 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:43.343412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d0e1ad3-0642-43da-8bca-cf4abcc6b4a0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '.version_select at 0x7f693f821dc0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:43.376049 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d0e1ad3-0642-43da-8bca-cf4abcc6b4a0 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805745574" status: 204 len: 0 microversion: 2.32 time: 0.036564 Sep 14 09:34:43.382239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2385/3061] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805745574 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:34:43.389741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aab17a3-a626-47cd-a176-866f1e66c32b", "name": "network-vif-plugged", "status": "completed", "tag": "5542d625-072b-461d-9336-3fdb4995daaf"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:43.404906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:43.405784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:43.406946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:43.434474 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] Creating event network-vif-plugged:5542d625-072b-461d-9336-3fdb4995daaf for instance 3aab17a3-a626-47cd-a176-866f1e66c32b on n-h1-851028-12 Sep 14 09:34:43.440864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-caa7583c-df6c-4fd7-b73b-ae84382548fa req-09ef2ec7-345d-4cfc-a9e6-f46c9bfff380 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056952 Sep 14 09:34:43.442227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2386/3062] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:43.449964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:43.463214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:43.464199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:43.465011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:43.496136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Creating event network-vif-unplugged:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:34:43.509036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] Instance a96cc8de-e682-403f-b2a5-09086f762fc7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 09:34:43.522730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6c251eb6-1113-40e5-8ff3-df25b5378a2c req-3f225488-5ac1-484e-a0fe-2c1b98ac22b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078684 Sep 14 09:34:43.523380 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2387/3063] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:43.530536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:43.531543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:43.539326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:43.540648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:43.542275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:43.543250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:43.543948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:43.544563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:43.955034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:43.967320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d20bcf3c-d464-4b8a-a0c3-009b7a7b98d9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1467 microversion: 2.1 time: 0.441060 Sep 14 09:34:43.969422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2388/3064] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:43 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1467 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:43.975594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e70ed15-1177-4caa-9367-eca4694e8a11 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1422728866", "metadata": {"": ""}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e70ed15-1177-4caa-9367-eca4694e8a11 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action HTTP/1.1 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 107 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1422728866", "metadata": {"": ""}}} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1422728866', 'metadata': {'': ''}}}} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'': ''} Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:34:43.983341 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:43.996157 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:43.999801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e70ed15-1177-4caa-9367-eca4694e8a11 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:44.004666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e70ed15-1177-4caa-9367-eca4694e8a11 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action" status: 400 len: 170 microversion: 2.1 time: 0.033466 Sep 14 09:34:44.011116 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2389/3065] 10.222.0.90 () {60 vars in 1279 bytes} [Wed Sep 14 09:34:43 2022] POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action => generated 170 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:44.029475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:44.032720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:44.044422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:44.048568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:44.049036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:44.049803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:44.050273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:44.050742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:44.561035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:44.576039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c2d20ed-7c0c-40c2-9af7-110c79aca6b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1315 microversion: 2.1 time: 0.558445 Sep 14 09:34:44.579020 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2390/3066] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:44 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:44.622675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:44.623314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:44.630634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:44.631219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:44.632008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:44.633464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:44.635140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:44.636039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:44.643032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:45.121374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:45.137749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:45.140631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:45.142801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b88d1a7-4b34-43c2-99b4-505adef7f129 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1339 microversion: 2.20 time: 0.543916 Sep 14 09:34:45.143668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2391/3067] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:44 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1339 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:45.153777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:45.154727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:45.163305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:45.164176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:45.164852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:45.166422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:45.167508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:45.168379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:45.704113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:45.718147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3a52174-977c-4232-b697-f0548cc7a367 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.571410 Sep 14 09:34:45.719075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2392/3068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:45 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:46.214954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:46.216078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:46.230042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.231225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.235126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.240621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.241179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.241733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.808682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:46.822729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d6e5bd4-0ae3-4cb1-8a6f-f286a16e68de tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1467 microversion: 2.1 time: 1.099918 Sep 14 09:34:46.826582 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2393/3069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:45 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1467 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:46.840862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:46.853839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:46.870691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.872300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.874240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.910883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] Creating event network-changed:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:34:46.920108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8acfff1f-336e-46d1-ba79-cce8f057a42f req-297174eb-50bb-4eab-8411-3468377439e0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089189 Sep 14 09:34:46.921305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2394/3070] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:46.936814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:46.940485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:46.958480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.962250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.962960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:46.966983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:46.968414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:46.972057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:47.780313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:47.791865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-973edbf6-7b39-491a-b87b-98693f6aad55 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1500 microversion: 2.1 time: 0.861659 Sep 14 09:34:47.794017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2395/3071] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:46 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1500 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:47.806467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:47.807569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:47.823462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:47.824948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:47.827953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:47.829057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:47.837819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:47.838861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:48.438656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:48.469006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-107f854a-570a-49e0-816b-e8f9a395346b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.673357 Sep 14 09:34:48.472320 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2396/3072] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:47 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:48.488185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:48.489816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:48.514320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:48.515988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:48.516636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:48.517565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:48.518368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:48.519604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:48.978653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:48.995291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:48.997181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:48.998632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee5c187e-1347-403b-8cff-0af4a9d869be tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.523881 Sep 14 09:34:49.002108 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2397/3073] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:48 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:49.008621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:49.015126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:49.030701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.036336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.037073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.038021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.038714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.039322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.085049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'flavor' on Instance uuid 3aab17a3-a626-47cd-a176-866f1e66c32b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:34:49.363076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-715f275a-3ce7-4623-a97e-6c13e679f790 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b/action" status: 202 len: 0 microversion: 2.1 time: 0.358702 Sep 14 09:34:49.366972 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2398/3074] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:49 2022] POST /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:34:49.389638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:49.390649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:49.402463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.403431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.404144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.405287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.405991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.406674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.775497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:49.788823 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1826871e-6aa4-4a81-8a56-d1bd80fb642b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1460 microversion: 2.1 time: 0.423290 Sep 14 09:34:49.802294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2399/3075] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:49 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1460 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:49.807943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24ccc68b-d4c1-4139-8bef-5904b9a17be9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-521578356", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24ccc68b-d4c1-4139-8bef-5904b9a17be9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action HTTP/1.1 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 618 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-521578356", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-521578356', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:34:49.813537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:34:49.817144 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:49.820316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24ccc68b-d4c1-4139-8bef-5904b9a17be9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:49.820316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24ccc68b-d4c1-4139-8bef-5904b9a17be9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action" status: 400 len: 938 microversion: 2.1 time: 0.024113 Sep 14 09:34:49.820316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2400/3076] 10.222.0.90 () {60 vars in 1279 bytes} [Wed Sep 14 09:34:49 2022] POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:49.825011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:49.825637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:49.862234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.862893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.863184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:49.863939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:49.864402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:49.864842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:50.459392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:50.480388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61fa7b40-c1a8-4088-bd8d-4edb102d4716 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.659255 Sep 14 09:34:50.493646 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2401/3077] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:49 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:50.529604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:50.530246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:50.551307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:50.551307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:50.551548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:50.552518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:50.553152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:50.553757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.014579 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ec893e28-0504-4aec-a7db-cc128e64f4be tempest-MigrationsAdminTest-394860445 tempest-MigrationsAdminTest-394860445-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1613 microversion: 2.1 time: 0.519025 Sep 14 09:34:51.050375 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2402/3078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:50 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1613 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:51.061833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:51.063457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:51.082441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.083272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.083933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.085753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.086475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.087210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.310888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:51.338042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:51.356907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:51.366181 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fed1191f-9d06-44e4-8f3c-a5303fece7a7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.313515 Sep 14 09:34:51.380855 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2403/3079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:51 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:51.392968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:51.393877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:51.402726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.403466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.405227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.406149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.409704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.411096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.657450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:51.672416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:51.674315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:51.675679 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fcad465-c196-4e2d-80ad-569029612310 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.293396 Sep 14 09:34:51.687956 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2404/3080] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:51 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:51.687956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:51.692632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.693489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.694158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.708748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] Creating event network-changed:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:34:51.715192 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c5dbfb36-2eab-4fef-9d91-49f689030fa3 req-b376394a-fb54-405c-a568-6ed32de98327 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036910 Sep 14 09:34:51.716501 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2405/3081] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:51.723130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-plugged", "status": "completed", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:51.734906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.736374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.737031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.750705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] Creating event network-vif-plugged:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:34:51.756333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-916ad4e8-1527-401a-ae44-039cae366444 req-a46adc06-f285-41d9-9383-491afba4cd3c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037920 Sep 14 09:34:51.757379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2406/3082] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:51.763642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:51.763642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:51.770291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.770802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.771244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.771998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.772464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.772892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.807848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:34:51.847680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:51.905708 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6881c90-b4a2-44b2-a2d8-4267ed557c0b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 204 len: 0 microversion: 2.1 time: 0.146441 Sep 14 09:34:51.906516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2407/3083] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:34:51 2022] DELETE /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:51.912755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:51.913737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:51.921348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.922146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.922795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:51.924494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:51.925775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:51.926387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:52.725918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:52.745622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8851e28-db4e-45e1-a99b-bfc3d8e8ddf4 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.837623 Sep 14 09:34:52.764483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2408/3084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:51 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:52.770277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:52.771435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:52.779092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:52.779941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:52.780669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:52.781621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:52.782291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:52.782928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:53.201393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:53.222988 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ff2480c-78d6-43e1-9e8b-d64e6ebdaebd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.445831 Sep 14 09:34:53.236224 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2409/3085] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:52 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:53.246596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:53.247569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:53.253995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.254758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.255392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:53.256565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.257376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.258089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:53.634743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:53.650205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20538d14-fc0a-4b16-81c8-c8ea36ebb226 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 200 len: 1466 microversion: 2.1 time: 0.410541 Sep 14 09:34:53.652677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2410/3086] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:53 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 1466 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:53.659193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:53.660318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:53.667240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.668042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.668722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:53.670639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:53.671435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:53.672092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:54.248838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:54.268034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:54.273851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:54.278614 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df4ea83d-270e-4439-a704-cddf5bee4f73 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.624580 Sep 14 09:34:54.279850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2411/3087] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:53 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:54.289161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add639f0-c75e-42c8-8b9c-c685428679eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add639f0-c75e-42c8-8b9c-c685428679eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action HTTP/1.1 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 285 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:54.294752 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:34:54.299228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:54.303588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add639f0-c75e-42c8-8b9c-c685428679eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:54.303588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-add639f0-c75e-42c8-8b9c-c685428679eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action" status: 400 len: 619 microversion: 2.1 time: 0.019912 Sep 14 09:34:54.303588 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2412/3088] 10.222.0.90 () {60 vars in 1279 bytes} [Wed Sep 14 09:34:54 2022] POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:54.311403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:54.312151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:54.319804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:54.320419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:54.320966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:54.322335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:54.322885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:54.323390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:54.801425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:54.811020 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1c842ca-9fa4-4ea4-aa62-aa2cded9b1fb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.503429 Sep 14 09:34:54.811626 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2413/3089] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:54 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:54.843798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:54.851241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:54.873283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:54.874176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:54.874698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:54.875547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:54.876169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:54.876853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.206900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:55.219872 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9de9601-d5c1-42b5-8374-62a91d66638f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.384785 Sep 14 09:34:55.227008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2414/3090] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:54 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:55.234100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96cc8de-e682-403f-b2a5-09086f762fc7", "name": "network-vif-deleted", "tag": "1cdc4d8d-27cf-4ea3-a604-85370ee31606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:55.261478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.265180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.266895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.299064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] Creating event network-vif-deleted:1cdc4d8d-27cf-4ea3-a604-85370ee31606 for instance a96cc8de-e682-403f-b2a5-09086f762fc7 on n-h1-851028-12 Sep 14 09:34:55.312277 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-20308860-89bf-4481-bfcc-e44df3fecfc6 req-3de3c40d-19ac-491b-b83a-cf4dc2be4837 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081156 Sep 14 09:34:55.317806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2415/3091] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:55.325379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:55.329313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: a96cc8de-e682-403f-b2a5-09086f762fc7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:55.346557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.349084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.351887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.355166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.357830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.358452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.398466 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] HTTP exception thrown: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Request method failure captured: Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 HTTP/1.1 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8FO1WwYrEW4PEEaCdMDveMwGk2emwMgMVjZv39P1Z9HMeuURglw2bWe-ma8_MKkhXOiSwCZJInkIEoJHzdYlUeL6L8Yuh-hZRPdrdaLP37rOFODBFF2H4NSSLRnY_pGhjQcvz8OviVo7e8TWVF8Gqsy-Uv7LE5TDXswaXuHTf6uMA Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e79293744c194e0ebb29be9e23e6af1f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e79293744c194e0ebb29be9e23e6af1f"}]}] Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MigrationsAdminTest-701578743 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MigrationsAdminTest-701578743-project Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e3a2ab136fd84dd3aa3b1dd038ea988c Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MigrationsAdminTest-701578743-project Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a96cc8de-e682-403f-b2a5-09086f762fc7'} Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:55.400761 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Returning 404 to user: Instance a96cc8de-e682-403f-b2a5-09086f762fc7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1dddae5-ac1d-4100-8bfb-c5bca3ef5100 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7" status: 404 len: 111 microversion: 2.1 time: 0.083022 Sep 14 09:34:55.408599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2416/3092] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:55 2022] GET /compute/v2.1/servers/a96cc8de-e682-403f-b2a5-09086f762fc7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:34:55.412580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:55.412580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:55.419798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.420390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.423275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.428815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.429312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.429762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.682191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:55.704175 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-828881a3-00c2-4c87-b5a0-88dc95848590 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.296698 Sep 14 09:34:55.706361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2417/3093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:55 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:55.715596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:55.728219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:55.755133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.758961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.761235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:55.767147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:55.768989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:55.770969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.223644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:56.237426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:56.246297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:56.248349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ed09804-d436-4c12-a838-2e471f795d06 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.540324 Sep 14 09:34:56.250141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2418/3094] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:55 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:56.279402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:56.284100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:56.297412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.297909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.298348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.302923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.303638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.309091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.385199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:34:56.514056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09a34f07-eb3c-40ca-bded-c65efa0b5af5 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "DELETE /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 204 len: 0 microversion: 2.1 time: 0.262064 Sep 14 09:34:56.514722 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2419/3095] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:34:56 2022] DELETE /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:56.521978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1976062211"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:56.525886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:56.532993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.533485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.534195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.535254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.535714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.536165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.796688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d4beb1b-8a10-4e13-b502-4f8978fef329 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action" status: 202 len: 0 microversion: 2.1 time: 0.280064 Sep 14 09:34:56.804658 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2420/3096] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:56 2022] POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:34:56.811761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:56.812902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:56.828994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.829752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.830479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:56.831476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:56.832307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:56.832833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.087098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:57.100269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69684350-3187-42c3-9479-f23128ddf96d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.293671 Sep 14 09:34:57.101026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2421/3097] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:56 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:57.110165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.111413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.121075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.122079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.122749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.123720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.124668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.125301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.144433 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] HTTP exception thrown: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Request method failure captured: Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a HTTP/1.1 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ28tWKQA1W1QepVdoYnL7w9leEv_pHaTr81LKN2txpjiWCkaEbusnyG51sd4QdIVuku2n62jgYz4JgWRHRI8PxM2I4ACdTrE4mLqaVivl9blM6ccr0P-2t6CG1A0mLp6_3NBR4kSDC5rudY7k3xehNaPJRzJnIyCzA46eRxBmQDh74 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c13dda24ab614859ad25993717e7235d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c13dda24ab614859ad25993717e7235d"}]}] Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ebb3a51601cf4b1eb53a185555ee574e Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5d61b4df-fc15-4ce2-a0d1-83afa829b86a'} Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:57.146502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.152124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.154191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Returning 404 to user: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:57.155796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3717e8c8-21dc-45db-a933-abc275b15389 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 404 len: 111 microversion: 2.32 time: 0.050573 Sep 14 09:34:57.156609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2422/3098] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:34:57 2022] DELETE /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:57.161472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.162085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.176129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.177450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.178258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.179193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.179883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.181262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.534433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:57.549906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:34:57.557295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-425a1d3e-148c-456b-ada6-f1ac6d68d1c1 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1533 microversion: 2.1 time: 0.398521 Sep 14 09:34:57.574927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2423/3099] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:57 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1533 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:57.586065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-709361854"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:57.589699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.616236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.617026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.623734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.624832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.625329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.625774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.677155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Cannot 'createImage' instance 8fba5d56-a673-4635-bfe6-0a730034b64c while it is in task_state image_snapshot_pending Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action HTTP/1.1 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 84 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-709361854"}} Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'createImage' instance 8fba5d56-a673-4635-bfe6-0a730034b64c while it is in task_state image_snapshot_pending Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-709361854'}}} Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:34:57.679015 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8fba5d56-a673-4635-bfe6-0a730034b64c while it is in task_state image_snapshot_pending Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8fba5d56-a673-4635-bfe6-0a730034b64c while it is in task_state image_snapshot_pending Sep 14 09:34:57.683970 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.686029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 409 to user: Cannot 'createImage' instance 8fba5d56-a673-4635-bfe6-0a730034b64c while it is in task_state image_snapshot_pending {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:57.686978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab335d41-8a4b-4f2e-a367-ed8296312994 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action" status: 409 len: 167 microversion: 2.1 time: 0.107955 Sep 14 09:34:57.688114 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2424/3100] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:34:57 2022] POST /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c/action => generated 167 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:34:57.694607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.695236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] [instance: 5d61b4df-fc15-4ce2-a0d1-83afa829b86a] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.707052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.707976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.708927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.719213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.720192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.720653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.766120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] HTTP exception thrown: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Request method failure captured: Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a HTTP/1.1 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ28tWKQA1W1QepVdoYnL7w9leEv_pHaTr81LKN2txpjiWCkaEbusnyG51sd4QdIVuku2n62jgYz4JgWRHRI8PxM2I4ACdTrE4mLqaVivl9blM6ccr0P-2t6CG1A0mLp6_3NBR4kSDC5rudY7k3xehNaPJRzJnIyCzA46eRxBmQDh74 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.32 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c13dda24ab614859ad25993717e7235d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c13dda24ab614859ad25993717e7235d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c13dda24ab614859ad25993717e7235d"}]}] Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c13dda24ab614859ad25993717e7235d Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TaggedBootDevicesTest-299197588 Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ebb3a51601cf4b1eb53a185555ee574e Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TaggedBootDevicesTest-299197588-project Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5d61b4df-fc15-4ce2-a0d1-83afa829b86a'} Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:34:57.768927 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. Sep 14 09:34:57.773718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:34:57.777874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] Returning 404 to user: Instance 5d61b4df-fc15-4ce2-a0d1-83afa829b86a could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:34:57.779024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f28b0ce-b950-48ec-81fe-b35c020a1490 tempest-TaggedBootDevicesTest-299197588 tempest-TaggedBootDevicesTest-299197588-project] 10.222.0.90 "GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a" status: 404 len: 111 microversion: 2.32 time: 0.089782 Sep 14 09:34:57.780043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2425/3101] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:57 2022] GET /compute/v2.1/servers/5d61b4df-fc15-4ce2-a0d1-83afa829b86a => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:34:57.800221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:57.810960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:57.824266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.825105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.825686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:57.826617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:57.827613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:57.828968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:58.495138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:58.510726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:58.513162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:58.514374 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce5a6fed-2708-4740-b171-d2710fa8d3f1 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.733155 Sep 14 09:34:58.514961 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2426/3102] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:34:57 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:34:58.530088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2893b308-c397-4471-a4d9-6113c0052424 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693f821ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:58.718871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2893b308-c397-4471-a4d9-6113c0052424 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/images/3c45fc23-bb6d-4a65-81e0-c28a20e06ed0" status: 204 len: 0 microversion: 2.1 time: 0.194448 Sep 14 09:34:58.720789 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2427/3103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:58 2022] DELETE /compute/v2.1/images/3c45fc23-bb6d-4a65-81e0-c28a20e06ed0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:34:58.737892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:58.738740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:58.746642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:58.747440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:58.748132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:58.749133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:58.749811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:58.750567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.298279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:59.324096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b376518b-f73b-484c-a880-ca9caeadcfba tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.591503 Sep 14 09:34:59.328009 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2428/3104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:58 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:59.344289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-plugged", "status": "completed", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:34:59.378370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.379017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.379712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.408599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] Creating event network-vif-plugged:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:34:59.417287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-988330ce-778c-4295-8037-c82910ac1a41 req-d07fc2c8-7bcf-4405-abcf-1911433b9593 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085787 Sep 14 09:34:59.418299 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2429/3105] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:34:59.424344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:59.425500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:59.433153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.434048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.434724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.435881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.436608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.437277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.691402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:34:59.708323 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22165f08-1c28-45fa-b2fd-fe5a81fdecf9 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1491 microversion: 2.1 time: 0.287168 Sep 14 09:34:59.726272 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2430/3106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:59 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1491 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:34:59.738424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:34:59.739151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:34:59.757467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.757975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.758474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:34:59.759720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:34:59.760238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:34:59.760719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:00.204166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:00.232986 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b69a2a1a-e956-4e54-96ba-fad4f997e89a tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1539 microversion: 2.1 time: 0.505426 Sep 14 09:35:00.247921 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2431/3107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:34:59 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1539 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:00.260812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:00.263251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:00.296513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:00.297414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:00.307910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:00.308886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:00.309384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:00.309890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:00.658358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:00.675612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:00.682441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:00.686071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dabfa512-e88d-43fc-baf2-b77d2d1582c5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.446085 Sep 14 09:35:00.686700 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2432/3108] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:35:00 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:35:00.705841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93dcdfcc-0110-4f64-bd2a-7ef2bd32c145", "name": "network-vif-deleted", "tag": "50ebcdb7-5e4e-413d-818e-1c7e9dab19b0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:00.767359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:00.768280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:00.768280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:00.834395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] Creating event network-vif-deleted:50ebcdb7-5e4e-413d-818e-1c7e9dab19b0 for instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 on n-h2-851028-12 Sep 14 09:35:00.848892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-24890011-7e33-44bf-902c-999cbaaf2ada req-35a29e50-b8fc-4b06-94c6-37b375b2f463 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160828 Sep 14 09:35:00.849500 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2433/3109] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:00.870669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:00.871389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:00.908624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:00.909128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:00.909576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:00.910313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:00.910774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:00.911204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.294946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:01.305297 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00870b80-1eb7-47a3-a1d9-5a07d6f6b397 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.454326 Sep 14 09:35:01.307823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2434/3110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:00 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:01.341632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:01.342384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:01.363414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:01.366259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:01.366726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.367501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:01.375657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:01.376377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.487979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:01.488487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:01.488934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.489396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lazy-loading 'fault' on Instance uuid 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:01.614722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:01.627678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-863ee179-8436-40ff-9ab8-bb78edf94677 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 200 len: 1368 microversion: 2.1 time: 0.320525 Sep 14 09:35:01.629048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2435/3111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:01 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:01.634554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:01.648445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:01.665241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:01.670906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:01.671756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.673682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:01.680041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:01.681179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:01.986606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:02.009288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02f539bd-c9c3-4ae7-b804-1c07d765e3d7 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1539 microversion: 2.1 time: 0.372442 Sep 14 09:35:02.013614 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2436/3112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:01 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1539 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:02.020358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:02.021654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:02.039124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.040586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.041997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.043827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.044905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.045869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.338515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:02.355740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:02.358883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:02.361109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3da54195-0490-4f8d-aa0b-df4403906048 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1407 microversion: 2.20 time: 0.345352 Sep 14 09:35:02.369450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2437/3113] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:35:02 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:35:02.386294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:02.387433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:02.398511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.407480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.408100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.408890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.409364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.411004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.780243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:02.794547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b13cc207-7bd8-4717-a476-457102828775 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.423028 Sep 14 09:35:02.796251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2438/3114] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:02 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:02.801830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:02.802461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:02.810199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.810706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.811203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.811944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:02.812410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:02.812843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:02.850828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] HTTP exception thrown: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Request method failure captured: Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 HTTP/1.1 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8FO1WwYrEW4PEEaCdMDveMwGk2emwMgMVjZv39P1Z9HMeuURglw2bWe-ma8_MKkhXOiSwCZJInkIEoJHzdYlUeL6L8Yuh-hZRPdrdaLP37rOFODBFF2H4NSSLRnY_pGhjQcvz8OviVo7e8TWVF8Gqsy-Uv7LE5TDXswaXuHTf6uMA Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e79293744c194e0ebb29be9e23e6af1f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e79293744c194e0ebb29be9e23e6af1f"}]}] Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e3a2ab136fd84dd3aa3b1dd038ea988c Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '93dcdfcc-0110-4f64-bd2a-7ef2bd32c145'} Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:02.858181 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Returning 404 to user: Instance 93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19f93fc8-987f-481e-91e5-132f32ebc083 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145" status: 404 len: 111 microversion: 2.1 time: 0.062586 Sep 14 09:35:02.863283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2439/3115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:02 2022] GET /compute/v2.1/servers/93dcdfcc-0110-4f64-bd2a-7ef2bd32c145 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:02.895024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61676dec-42a3-4477-9b8c-22cd7e62de61 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '.version_select at 0x7f693fa750d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:02.910245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:02.926301 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61676dec-42a3-4477-9b8c-22cd7e62de61 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563174629" status: 202 len: 0 microversion: 2.1 time: 0.060265 Sep 14 09:35:02.927981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2440/3116] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563174629 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:35:03.039242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:03.040773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:03.068536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:03.071432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:03.072200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:03.073344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:03.076380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:03.078240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:03.618655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:03.635494 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d16e938a-91d6-4e92-8061-fc44ed9e10db tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1521 microversion: 2.1 time: 0.600258 Sep 14 09:35:03.640076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2441/3117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:03 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:03.655418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:03.657359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:03.678928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:03.679443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:03.679911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:03.683086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:03.683579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:03.685674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:04.397916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:04.411217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:04.420022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:04.421967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89bf81bf-d274-4bc7-82b0-2f1e9e9be29b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1599 microversion: 2.20 time: 0.780593 Sep 14 09:35:04.424863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2442/3118] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:35:03 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1599 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:35:04.439395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:04.441015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:04.462871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:04.464913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:04.465377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:04.468257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:04.468963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:04.471859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:04.545245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:04.589204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:04.658077 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b60feb29-5585-4fbc-a986-470831bf8b70 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 204 len: 0 microversion: 2.1 time: 0.231505 Sep 14 09:35:04.659399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2443/3119] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:04 2022] DELETE /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:04.666756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:04.667753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:04.678148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:04.679006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:04.679754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:04.681527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:04.682217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:04.682846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:06.111636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:06.129071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d51ebdee-ce38-4959-80a2-f7f942c19835 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 1.467547 Sep 14 09:35:06.133025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2444/3120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:04 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:06.145647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:06.146489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:06.167576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:06.170308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:06.170797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:06.171554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:06.173148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:06.175238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:06.354052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6b92f57-6a3d-4618-bba4-bc4068ab7bcb tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.217791 Sep 14 09:35:06.354936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2445/3121] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:35:06 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:35:06.364706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:06.366329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:06.379365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:06.380976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:06.381690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:06.383273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:06.385120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:06.385841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.060534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:07.071857 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5152554-a6c2-422e-9f15-d0693c1e8de3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1527 microversion: 2.1 time: 0.715302 Sep 14 09:35:07.094570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2446/3122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:06 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1527 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:07.100573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:07.101405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:07.109934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.110805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.111510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.112622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.114069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.115140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.160442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:07.298910 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a174029b-65eb-4fa2-8477-db42482411e4 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 204 len: 0 microversion: 2.1 time: 0.201354 Sep 14 09:35:07.301550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2447/3123] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:07 2022] DELETE /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:07.312266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:07.314202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:07.324243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.325276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.326323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.327847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.328902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.329579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.865539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:07.879299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a3bf799-e325-4cc7-a23b-75097ad94548 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.574600 Sep 14 09:35:07.880418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2448/3124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:07 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:07.892810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:07.893434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:07.924166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.924787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.925247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:07.928346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:07.930536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:07.930995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.703392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:08.715020 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bd684b7-2b7d-4067-8e51-0e38b8a20032 tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1469 microversion: 2.1 time: 0.829830 Sep 14 09:35:08.715640 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2449/3125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:07 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1469 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:08.723470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fba5d56-a673-4635-bfe6-0a730034b64c", "name": "network-vif-plugged", "status": "completed", "tag": "b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:08.734967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:08.735981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:08.736411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.758278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] Creating event network-vif-plugged:b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d for instance 8fba5d56-a673-4635-bfe6-0a730034b64c on n-h2-851028-12 Sep 14 09:35:08.765246 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-514b4397-3fcc-4590-8814-5943bc20ea8d req-46db957d-94b6-4448-96cd-8d90d977541f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045950 Sep 14 09:35:08.768231 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2450/3126] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:08.782990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fba5d56-a673-4635-bfe6-0a730034b64c", "name": "network-vif-deleted", "tag": "b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:08.808012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:08.808614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:08.809252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.831604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] Creating event network-vif-deleted:b963dc57-2d9d-43ae-ba1d-7ccd67bf0e4d for instance 8fba5d56-a673-4635-bfe6-0a730034b64c on n-h2-851028-12 Sep 14 09:35:08.839928 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1dcf9b74-190f-4360-b9e9-afd426719f4b req-cc7e5347-b7cf-43f7-820d-c77460ed7553 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070052 Sep 14 09:35:08.841098 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2451/3127] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:08.853258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:08.853986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:08.865824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:08.866489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:08.866962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.880623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:08.881765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:08.882241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.969515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:08.975689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:08.979593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:08.979867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lazy-loading 'fault' on Instance uuid 8fba5d56-a673-4635-bfe6-0a730034b64c {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:09.097691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:09.109668 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6501a059-f832-4c9f-8787-9c33f2a65def tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 200 len: 1314 microversion: 2.1 time: 0.266753 Sep 14 09:35:09.110975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2452/3128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:08 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:09.121150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:09.125273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:09.142003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:09.143007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:09.143610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:09.149692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:09.150713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:09.151414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:09.659983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:09.687663 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be59c639-e56a-4b5e-8f35-da11a3d83436 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.573154 Sep 14 09:35:09.705063 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2453/3129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:09 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:09.720617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:09.731521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:09.732211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:09.732890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:09.748846 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] Creating event network-changed:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:35:09.764288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-bafce480-6771-4b79-9c9c-b77c9f557c06 req-65502c11-5624-47d1-b7aa-8c8fcbbf3f65 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047305 Sep 14 09:35:09.778302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2454/3130] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:09.791682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:09.792961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:09.800939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:09.801868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:09.802561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:09.803865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:09.804647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:09.805363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:10.802659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:10.823349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01270940-a4f5-49df-9237-1d69e54948ea tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1469 microversion: 2.1 time: 1.037290 Sep 14 09:35:10.823934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2455/3131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:09 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1469 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:10.828925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:10.829550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:10.853829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:10.860926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:10.861679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:10.862643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:10.863305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:10.864125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:10.896933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c HTTP/1.1 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c'} Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:10.899984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:35:10.906984 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:10.913089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:10.914232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e23d7e76-d0a0-47d4-9287-01e0d7dca831 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 404 len: 111 microversion: 2.1 time: 0.089334 Sep 14 09:35:10.925439 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2456/3132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:10 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:10.931089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:10.932157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:10.945243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:10.946388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:10.947096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:10.949701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:10.950711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:10.951438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:11.394130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:11.409365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e1fea6b-b736-411e-ae32-972fa29ca64c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.481056 Sep 14 09:35:11.411769 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2457/3133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:10 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:11.423518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19289237-a82d-4517-b3f4-7acdab6348e1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'create', calling method: .version_select at 0x7f693fa19dc0>, body: {"keypair": {"name": "tempest-keypair-1211223134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfchwQ3kdn8gkYC+1eg/Otg30xt9Ds+lJmv7jY43MHqgSzckYx6GqRwmqL5XQeECF/MXlKnW98+L4nbO2wq6QaVH+e5/Od1LmVWGfL1V6LQJL/5nXuDRFVzkAJLhcMcbw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:11.472853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-19289237-a82d-4517-b3f4-7acdab6348e1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:11.492085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-19289237-a82d-4517-b3f4-7acdab6348e1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for user bcaca2d700a54540918f61d900ba2a1d and project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:11.591562 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19289237-a82d-4517-b3f4-7acdab6348e1 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177762 Sep 14 09:35:11.598035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2458/3134] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:35:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:11.617467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca089a91-9c9b-40cc-b4cc-2d66989997c1", "name": "network-vif-deleted", "tag": "99cc81e1-8fe2-4111-b2a6-c7a17ca73fda"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:11.657009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:11.664100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:11.667414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:11.720943 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] Creating event network-vif-deleted:99cc81e1-8fe2-4111-b2a6-c7a17ca73fda for instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 on n-h2-851028-12 Sep 14 09:35:11.743804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9d3887e0-ec05-4be0-9fce-cb921cacf8f6 req-25546d5f-1db9-48e1-9133-a9eefe119571 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143093 Sep 14 09:35:11.746662 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2459/3135] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:11.848177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:11.849063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:11.869393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:11.870371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:11.872050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:11.873172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:11.874093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:11.876588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:12.016916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:12.018550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:12.020019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:12.020915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lazy-loading 'fault' on Instance uuid ca089a91-9c9b-40cc-b4cc-2d66989997c1 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:12.638110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:12.653825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba45f473-8a99-4755-9719-9735a89472ef tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 200 len: 1303 microversion: 2.1 time: 0.810090 Sep 14 09:35:12.656287 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2460/3136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:11 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 1303 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:12.668268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:12.669264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:12.683503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:12.685779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:12.686468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:12.688472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:12.689153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:12.692770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:12.938316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:12.956568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-891d6091-05d2-426f-ae24-2aab0ca9d868 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.290036 Sep 14 09:35:12.958337 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2461/3137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:12 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:13.685036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:13.687696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: ca089a91-9c9b-40cc-b4cc-2d66989997c1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:13.701429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.704224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.707136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:13.709471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.711097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.712622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:13.742767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:13.744509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] HTTP exception thrown: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Request method failure captured: Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 HTTP/1.1 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8FO1WwYrEW4PEEaCdMDveMwGk2emwMgMVjZv39P1Z9HMeuURglw2bWe-ma8_MKkhXOiSwCZJInkIEoJHzdYlUeL6L8Yuh-hZRPdrdaLP37rOFODBFF2H4NSSLRnY_pGhjQcvz8OviVo7e8TWVF8Gqsy-Uv7LE5TDXswaXuHTf6uMA Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e79293744c194e0ebb29be9e23e6af1f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e79293744c194e0ebb29be9e23e6af1f"}]}] Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e3a2ab136fd84dd3aa3b1dd038ea988c Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ca089a91-9c9b-40cc-b4cc-2d66989997c1'} Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:13.746622 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. Sep 14 09:35:13.752128 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:13.755522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Returning 404 to user: Instance ca089a91-9c9b-40cc-b4cc-2d66989997c1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:13.756777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ec07aed-24ca-45a7-9047-b18cc2d6181a tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1" status: 404 len: 111 microversion: 2.1 time: 0.078120 Sep 14 09:35:13.758000 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2462/3138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:13 2022] GET /compute/v2.1/servers/ca089a91-9c9b-40cc-b4cc-2d66989997c1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:13.770253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:13.771439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:13.781890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.782823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.783537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:13.785880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.786716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.787486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:13.829175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:13.936910 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b212b7e6-a3e6-4657-93ca-c5148e10ab4b tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 204 len: 0 microversion: 2.1 time: 0.173338 Sep 14 09:35:13.940596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2463/3139] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:13 2022] DELETE /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:13.947737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:13.948504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:13.959804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.960667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.962114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:13.962967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:13.963601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:13.964377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:14.259716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:14.271002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-57080221-fa39-40ae-8ce3-caf65d34696e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1468 microversion: 2.1 time: 0.328989 Sep 14 09:35:14.275279 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2464/3140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:13 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1468 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:14.287679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:14.292150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:14.313917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:14.314763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:14.317249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:14.319534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:14.326010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:14.326613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:14.754348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:14.767797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aeb58381-edb7-42d1-8ea1-4ab3f3a0cf16 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1506 microversion: 2.1 time: 0.485605 Sep 14 09:35:14.768580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2465/3141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:14 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:15.298645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:15.299371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:15.307327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:15.307831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:15.308302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:15.309028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:15.309490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:15.309921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:15.559504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:15.571632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-686b0aa4-ab95-4d94-a3e8-cd224ec1602f tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1468 microversion: 2.1 time: 0.276127 Sep 14 09:35:15.572917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2466/3142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:15 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:15.592228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-731045632", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:15.684450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] validate_networks() for [('97594a1c-c3e5-4a53-bda5-9ff07554f88b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:35:16.449168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:35:16.449785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:35:16.450071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:35:16.450536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:35:16.451313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:35:16.469003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:16.469542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:16.470002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:16.470811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:16.471281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:16.471717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:16.525031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:16.541425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for user bcaca2d700a54540918f61d900ba2a1d and project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:16.586933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:35:16.600800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:35:16.641769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:16.785434 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a52c50e-bbe4-4638-99a9-aabd5960efcf tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.211093 Sep 14 09:35:16.793265 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2467/3143] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:35:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:35:16.799605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:16.800744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:16.809786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:16.810699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:16.811341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:16.812284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:16.813334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:16.814318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:17.526608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:17.545052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38d72b1d-97f3-475b-858c-83b429492b8c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1527 microversion: 2.1 time: 0.749372 Sep 14 09:35:17.575651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2468/3144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:16 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1527 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:17.600650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:17.604922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:17.652757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:17.658675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:17.666645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:17.668412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:17.672291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:17.672971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:17.725146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:17.726510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:17.728428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:17.729279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lazy-loading 'fault' on Instance uuid c481f44e-658d-472e-b40d-5fd7907281ff {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:17.990607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3a2ab136fd84dd3aa3b1dd038ea988c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e79293744c194e0ebb29be9e23e6af1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:18.004304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da0dfe40-7268-4e03-b607-74c86223693e tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 200 len: 1302 microversion: 2.1 time: 0.424647 Sep 14 09:35:18.025336 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2469/3145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:17 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 1302 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:18.030282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c481f44e-658d-472e-b40d-5fd7907281ff", "name": "network-vif-deleted", "tag": "393b90db-a72d-4ca9-b829-854a0c149b87"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:18.048504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:18.048990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:18.049655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:18.076629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] Creating event network-vif-deleted:393b90db-a72d-4ca9-b829-854a0c149b87 for instance c481f44e-658d-472e-b40d-5fd7907281ff on n-h1-851028-12 Sep 14 09:35:18.085622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b96ab3d4-3183-4bc7-9d73-e76225a5bb4f req-50225f59-1977-4974-a227-77cfb1462bc5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058903 Sep 14 09:35:18.087582 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2470/3146] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:18.108087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:18.110743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:18.127558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:18.129537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:18.131630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:18.134276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:18.135148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:18.135869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:18.238148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:18.263413 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d6eec8ea-1607-4626-8bc2-90f17baf2bf6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1228 microversion: 2.1 time: 0.168098 Sep 14 09:35:18.264975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2471/3147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:18 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1228 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:18.593396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:18.594906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:18.613094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:18.616783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:18.617986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:18.623548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:18.624500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:18.625293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:18.968833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:18.977432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cec3e7ce-7660-4ea1-ad22-9b252f8e669d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.388766 Sep 14 09:35:18.978048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2472/3148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:18 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:18.996178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aab17a3-a626-47cd-a176-866f1e66c32b", "name": "network-vif-plugged", "status": "completed", "tag": "5542d625-072b-461d-9336-3fdb4995daaf"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:19.022106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:19.024433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:19.026129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:19.074182 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] Creating event network-vif-plugged:5542d625-072b-461d-9336-3fdb4995daaf for instance 3aab17a3-a626-47cd-a176-866f1e66c32b on n-h1-851028-12 Sep 14 09:35:19.086683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b097cd23-36e0-4750-ab2d-af76dd0bff04 req-66b110ce-dde1-4abd-97ae-0bea64dff90f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102363 Sep 14 09:35:19.087357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2473/3149] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:19.098490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:19.099570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] [instance: c481f44e-658d-472e-b40d-5fd7907281ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:19.108667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:19.109510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:19.110136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:19.111054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:19.111745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:19.112463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:19.140717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] HTTP exception thrown: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Request method failure captured: Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff HTTP/1.1 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ8FO1WwYrEW4PEEaCdMDveMwGk2emwMgMVjZv39P1Z9HMeuURglw2bWe-ma8_MKkhXOiSwCZJInkIEoJHzdYlUeL6L8Yuh-hZRPdrdaLP37rOFODBFF2H4NSSLRnY_pGhjQcvz8OviVo7e8TWVF8Gqsy-Uv7LE5TDXswaXuHTf6uMA Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e79293744c194e0ebb29be9e23e6af1f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e79293744c194e0ebb29be9e23e6af1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e79293744c194e0ebb29be9e23e6af1f"}]}] Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e79293744c194e0ebb29be9e23e6af1f Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-MigrationsAdminTest-701578743 Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e3a2ab136fd84dd3aa3b1dd038ea988c Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-MigrationsAdminTest-701578743-project Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'c481f44e-658d-472e-b40d-5fd7907281ff'} Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:19.148971 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. Sep 14 09:35:19.154702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:19.156716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] Returning 404 to user: Instance c481f44e-658d-472e-b40d-5fd7907281ff could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:19.158036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3400b584-3e2d-48e2-b72f-7ef068fb794d tempest-MigrationsAdminTest-701578743 tempest-MigrationsAdminTest-701578743-project] 10.222.0.90 "GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff" status: 404 len: 111 microversion: 2.1 time: 0.064761 Sep 14 09:35:19.159730 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2474/3150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:19 2022] GET /compute/v2.1/servers/c481f44e-658d-472e-b40d-5fd7907281ff => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:19.293684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:19.294321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:19.307978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:19.311732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:19.312458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:19.313482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:19.319517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:19.320317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:19.447163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:19.460766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df913dae-31fa-44ae-8302-9ff356246217 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1282 microversion: 2.1 time: 0.171732 Sep 14 09:35:19.462944 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2475/3151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:19 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:20.002738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:20.004408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:20.012794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:20.013698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:20.014610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:20.017023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:20.018501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:20.020365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:20.607850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:20.639334 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-994b5d60-aa76-43cf-a6e1-1306feaa69f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.641207 Sep 14 09:35:20.646601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2476/3152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:19 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:20.657438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:20.659215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:20.670474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:20.672628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:20.673432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:20.674669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:20.675354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:20.676481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:20.822018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:20.841113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4eb2049-0ce8-4a13-aa5d-f5f926488967 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1282 microversion: 2.1 time: 0.192428 Sep 14 09:35:20.841983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2477/3153] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:20 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:21.676241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:21.678098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:21.692339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:21.693186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:21.693980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:21.694938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:21.697536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:21.698369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:22.747619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:22.756689 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1579f969-dd52-46b6-bad4-93f0ebf3d298 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 1.087188 Sep 14 09:35:22.768732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2478/3154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:21 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:22.774699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:22.775837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:22.790536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:22.791468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:22.792210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:22.793957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:22.794430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:22.806191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:23.282196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:23.292383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc807e97-50f7-4a4a-9460-20090b9a1b1f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.522158 Sep 14 09:35:23.292980 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2479/3155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:22 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:23.795664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:23.797025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:23.810177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:23.811751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:23.812576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:23.814798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:23.817632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:23.818310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:23.907661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:24.767677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:24.821996 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-374e1b70-46db-4176-9b26-12186c19ac25 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 1.028227 Sep 14 09:35:24.824897 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2480/3156] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:23 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:24.856529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:24.857256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:24.880858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:24.891244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:24.892294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:24.894371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:24.895098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:24.896025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:25.450474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:25.474411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b4efabf6-828a-488c-a6bf-1eccdf7433d9 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.645771 Sep 14 09:35:25.480602 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2481/3157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:24 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:25.500732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfaf5ef-2bad-4875-8029-d5b677c28357", "tag": "92b2aca5-b2ed-4e59-bc62-6c11d814e9c8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:25.526210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:25.526855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:25.527481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:25.543630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] Creating event network-changed:92b2aca5-b2ed-4e59-bc62-6c11d814e9c8 for instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 on n-h1-851028-12 Sep 14 09:35:25.549560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-260d3fa9-bc9b-4907-a82d-96ac3fbc71ec req-c8f14f08-acff-4555-90e2-59b195616257 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067630 Sep 14 09:35:25.550778 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2482/3158] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:25.788388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96056933-8c8d-4029-8858-33ef9abea01a tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] Calling method '.version_select at 0x7f693f06ec10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:25.813143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96056933-8c8d-4029-8858-33ef9abea01a tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.260815 Sep 14 09:35:25.843524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2483/3159] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:35:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:25.853168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ec457896-8b61-4030-afa6-fa186be64daa tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] Action: 'update', calling method: .version_select at 0x7f693fa29ca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:26.517557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:26.625380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ec457896-8b61-4030-afa6-fa186be64daa tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.778956 Sep 14 09:35:26.639508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2484/3160] 10.222.0.90 () {60 vars in 1206 bytes} [Wed Sep 14 09:35:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:26.661838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:26.666716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:26.697177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:26.708565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:26.708565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:26.713498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:26.713498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:26.713498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:27.237596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:27.255430 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-972fdf0d-eb7a-4ca2-8814-26e085a49075 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.605782 Sep 14 09:35:27.258093 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2485/3161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:26 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:27.263403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:27.271085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:27.284283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:27.284683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:27.285113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:27.285817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:27.303482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:27.304240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:27.785304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:27.799766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bfbb97f7-2e0b-4122-a4e8-e07a85dea351 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.539993 Sep 14 09:35:27.812772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2486/3162] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:27 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:27.823699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01766eb4-6c8f-4558-b87d-28c0da7d2ac4 tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] Calling method '.version_select at 0x7f693e5a6040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:27.848790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01766eb4-6c8f-4558-b87d-28c0da7d2ac4 tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.034484 Sep 14 09:35:27.853459 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2487/3163] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:35:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:27.870737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-930cb206-f238-49c8-b359-c6595419d887 tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] Action: 'update', calling method: .version_select at 0x7f693fa3e3a0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:27.942483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=73,nova_api:UPDATE=17 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:28.070302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-930cb206-f238-49c8-b359-c6595419d887 tempest-QuotaClassesAdminTestJSON-1334888676 tempest-QuotaClassesAdminTestJSON-1334888676-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.208087 Sep 14 09:35:28.080581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2488/3164] 10.222.0.90 () {60 vars in 1206 bytes} [Wed Sep 14 09:35:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:35:28.282932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:28.284683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:28.293835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:28.298818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:28.301126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:28.302778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:28.303618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:28.304229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:28.779652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:28.790160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcccc43e-c59e-4146-bca2-9ec403ceab28 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.513136 Sep 14 09:35:28.799805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2489/3165] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:28 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:28.827581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:28.829084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:28.843183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:28.844202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:28.844909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:28.846893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:28.848943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:28.850688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:29.678845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:29.690540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d821197-324c-40a5-b8c0-61c072d69c06 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.867587 Sep 14 09:35:29.694088 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2490/3166] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:28 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:29.823821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:29.824659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:29.837845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:29.848707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:29.849175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:29.849947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:29.850412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:29.851009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:30.203551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:30.219791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7cfb13ef-2b25-40f3-b61b-c84e4f7f717f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.400836 Sep 14 09:35:30.220718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2491/3167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:29 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:30.723232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:30.725688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:30.754671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:30.756885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:30.758382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:30.759419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:30.760181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:30.761112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:31.247753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:31.277275 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58820d5d-c90d-4c4c-a11d-f0037a274024 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.562294 Sep 14 09:35:31.278665 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2492/3168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:30 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:31.290286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:31.291210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:31.318295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:31.319509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:31.328813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:31.330015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:31.330648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:31.331273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:33.042657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:33.057767 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c58fc30d-b837-42b3-8330-5c9f6dea35c7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 1.774524 Sep 14 09:35:33.059674 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2493/3169] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:31 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:33.074603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf5ef-2bad-4875-8029-d5b677c28357", "name": "network-vif-plugged", "status": "completed", "tag": "92b2aca5-b2ed-4e59-bc62-6c11d814e9c8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:33.091760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:33.099402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:33.100153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:33.120704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] Creating event network-vif-plugged:92b2aca5-b2ed-4e59-bc62-6c11d814e9c8 for instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 on n-h1-851028-12 Sep 14 09:35:33.137793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-156cc2ce-203a-485f-9f94-57dcb5842af2 req-d89f88b6-8404-4afc-8155-ea44f0fbe372 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067286 Sep 14 09:35:33.138687 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2494/3170] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:33.144443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:33.145439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:33.152828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:33.153659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:33.154390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:33.155463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:33.156537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:33.157216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:33.875485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:33.893738 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ffa49c3-51b7-41c3-a670-8e0b2b8ac379 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1324 microversion: 2.1 time: 0.753473 Sep 14 09:35:33.894413 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2495/3171] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:33 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1324 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:34.094852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:34.096639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:34.121887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.123977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.125693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:34.129239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.134856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.138039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:34.668724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:34.680370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a107980-8df5-480b-8efb-37f1d49058f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.601883 Sep 14 09:35:34.691242 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2496/3172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:34 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:34.927769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:34.928895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:34.945497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.947553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.948353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:34.949623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:34.950382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:34.951076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.226034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:35.253703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e02a3d41-34c8-43fa-94e7-a8ccaa37d696 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1522 microversion: 2.1 time: 0.331882 Sep 14 09:35:35.256629 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2497/3173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:34 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:35.299454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:35.301258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:35.310517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.311278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.312378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.313332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.314052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.314708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.491680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:35.502729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-361a7827-46e6-4b3c-ba13-9aa2cbf71ad6 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1522 microversion: 2.1 time: 0.219458 Sep 14 09:35:35.517307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2498/3174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:35 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:35.534587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-45809078"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:35.539376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:35.548155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.548992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.549758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:35.550963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:35.551717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:35.552451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:36.053311 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0621d86-4cd7-45b5-a085-42269a6b65eb tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357/action" status: 202 len: 0 microversion: 2.1 time: 0.525033 Sep 14 09:35:36.054391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2499/3175] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:35:35 2022] POST /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:35:36.072878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:36.075983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:36.095045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:36.096289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:36.096973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:36.112207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:36.118519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:36.119631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:36.650666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:36.654075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:36.673068 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-033fdf6a-9769-416a-b5d6-0c4b27da40aa tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.613803 Sep 14 09:35:36.675684 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2500/3176] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:36 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:36.692975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b7b5f8b-8030-4c4b-8a86-4cbaa5e15271 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693f81a5e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:36.947125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b7b5f8b-8030-4c4b-8a86-4cbaa5e15271 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63" status: 204 len: 0 microversion: 2.1 time: 0.268319 Sep 14 09:35:36.954973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2501/3177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:36 2022] DELETE /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:37.001601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-358d84da-b4fb-46b5-b1c3-7530b80f775f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693e8cee50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:37.052263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-358d84da-b4fb-46b5-b1c3-7530b80f775f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Image not found. Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-358d84da-b4fb-46b5-b1c3-7530b80f775f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63 HTTP/1.1 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e6e05349-6ff8-4f80-942f-1e7bf58d7e63'} Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e6e05349-6ff8-4f80-942f-1e7bf58d7e63 Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 14 09:35:37.056718 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6e05349-6ff8-4f80-942f-1e7bf58d7e63 could not be found. Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:35:37.060402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:37.062864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-358d84da-b4fb-46b5-b1c3-7530b80f775f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:37.063606 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-358d84da-b4fb-46b5-b1c3-7530b80f775f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63" status: 404 len: 62 microversion: 2.1 time: 0.107244 Sep 14 09:35:37.064461 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2502/3178] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:35:36 2022] GET /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:35:37.093065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:37.096456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:37.116325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:37.116840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:37.117760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:37.118611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:37.119148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:37.119635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:37.775640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:37.790833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9bef2c6a-ac6f-4dd1-9f5f-923327289894 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1534 microversion: 2.1 time: 0.721686 Sep 14 09:35:37.792104 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2503/3179] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:37 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1534 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:38.064619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=39,nova_cell0:UPDATE=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:38.097899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d1dd140-93a6-4bfa-84ef-b7474bd42a07 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693e8ce040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:38.854984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d1dd140-93a6-4bfa-84ef-b7474bd42a07 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488" status: 200 len: 371 microversion: 2.1 time: 1.060260 Sep 14 09:35:38.856711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2504/3180] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:35:37 2022] GET /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488 => generated 371 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:38.872534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:38.874514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:38.888931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:38.890670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:38.892094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:38.897315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:38.900456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:38.901172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:39.379305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:39.388521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8031c086-f3c4-47d6-9068-c24759edb02b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1522 microversion: 2.1 time: 0.529799 Sep 14 09:35:39.406550 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2505/3181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:38 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:39.416589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:39.418055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:39.435040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:39.435832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:39.436628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:39.438174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:39.438790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:39.439380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:39.780879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:39.800678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9a5bf55-1838-4b1a-a647-0e4a58e9a607 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1522 microversion: 2.1 time: 0.388802 Sep 14 09:35:39.837594 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2506/3182] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:39 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:39.851284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Action: 'update', calling method: .version_select at 0x7f693e8cef70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:40.430805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.431380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.431735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.432507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.436532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.436992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.536118 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc43964d-7eb5-4e2b-8432-0337b786b695 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488" status: 200 len: 328 microversion: 2.1 time: 0.694016 Sep 14 09:35:40.537573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2507/3183] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:35:39 2022] PUT /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488 => generated 328 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:40.551334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:40.554377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:40.566588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.567515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.569100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.572457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.573408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.574059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.616657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:40.830124 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3da8f64-abb1-441a-aba6-7637e6d8cb8b tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 204 len: 0 microversion: 2.1 time: 0.288311 Sep 14 09:35:40.832383 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2508/3184] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:40 2022] DELETE /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:40.843834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:40.844791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:40.855464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.856463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.857150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:40.858074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:40.858824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:40.859464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.076088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:41.085517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9131d66-dc7f-4f48-9771-efd3244ff6f7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1504 microversion: 2.1 time: 0.247567 Sep 14 09:35:41.086197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2509/3185] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:40 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:41.108011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa51ca4a-9f45-40e7-be4e-1c5e5ea24e57 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:41.135779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa51ca4a-9f45-40e7-be4e-1c5e5ea24e57 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488" status: 202 len: 0 microversion: 2.1 time: 0.033774 Sep 14 09:35:41.136537 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2510/3186] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:35:41 2022] DELETE /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:35:41.143828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:41.148799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:41.158280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:41.158937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:41.159385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.160568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:41.161182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:41.161613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.481397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:41.496580 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a595d0f4-da30-42dd-a410-eebac528db29 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1528 microversion: 2.1 time: 0.359039 Sep 14 09:35:41.513447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2511/3187] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:41 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:41.528530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf5ef-2bad-4875-8029-d5b677c28357", "name": "network-vif-plugged", "status": "completed", "tag": "92b2aca5-b2ed-4e59-bc62-6c11d814e9c8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:41.544464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:41.545370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:41.546012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:41.566578 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] Creating event network-vif-plugged:92b2aca5-b2ed-4e59-bc62-6c11d814e9c8 for instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 on n-h1-851028-12 Sep 14 09:35:41.572987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5feedd77-6f0f-40de-bcd5-5e2dff54c102 req-d41ca668-9c79-4a25-97eb-f1dae8803340 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057456 Sep 14 09:35:41.574561 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2512/3188] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:41.583442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dcb7261-4151-4463-8153-773cb98704ff tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693f1004c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:42.075652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dcb7261-4151-4463-8153-773cb98704ff tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488" status: 200 len: 371 microversion: 2.1 time: 0.499353 Sep 14 09:35:42.087937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2513/3189] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 09:35:41 2022] GET /compute/v2.1/os-quota-sets/54e1422bb8684c408607c52c69fd6488 => generated 371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:42.119227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:42.124179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:42.134834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.135559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.136324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.137565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.138343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.138894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.460334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:42.472125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e9ca1de-d03b-4acb-819f-a3b3a0759303 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1504 microversion: 2.1 time: 0.362859 Sep 14 09:35:42.473393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2514/3190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:42 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:35:42.533533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:42.534388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:42.546649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.547156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.548175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.548907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:42.549569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:42.550015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:42.995214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:43.010905 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fff7f9f9-6a00-4c1d-9f6b-c64d358732df tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 200 len: 1528 microversion: 2.1 time: 0.481161 Sep 14 09:35:43.013844 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2515/3191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:42 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 1528 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:43.040873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6154db49-8561-4d51-96c9-a8b8987978d4 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693fd0d700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:43.477985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6154db49-8561-4d51-96c9-a8b8987978d4 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.460881 Sep 14 09:35:43.478926 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2516/3192] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:35:43 2022] GET /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad/defaults => generated 371 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:43.484116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:43.484680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:43.491708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.496917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.497718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.498562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.499121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.502387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.582486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c87a948-839f-4004-b0b6-65622c2e8299 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/ips" status: 200 len: 152 microversion: 2.20 time: 0.102152 Sep 14 09:35:43.590321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2517/3193] 10.222.0.90 () {60 vars in 1289 bytes} [Wed Sep 14 09:35:43 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/ips => generated 152 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:35:43.596832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:43.600670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:43.615369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.620139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.621170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.623249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:43.623941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:43.626090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:43.981176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:43.996869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6950b872-24a6-4d0f-ac5c-c6ad538b1aee tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 200 len: 1507 microversion: 2.1 time: 0.405333 Sep 14 09:35:43.998255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2518/3194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:43 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:44.012842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aab17a3-a626-47cd-a176-866f1e66c32b", "name": "network-vif-unplugged", "status": "completed", "tag": "5542d625-072b-461d-9336-3fdb4995daaf"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:44.038968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:44.042441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:44.043733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:44.061421 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] Creating event network-vif-unplugged:5542d625-072b-461d-9336-3fdb4995daaf for instance 3aab17a3-a626-47cd-a176-866f1e66c32b on n-h1-851028-12 Sep 14 09:35:44.069287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4d5b2dd2-c070-4d84-b7d6-d4aa3a52b853 req-c20df1a2-a5a9-4310-9377-05babaf11aac service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069443 Sep 14 09:35:44.070863 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2519/3195] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:44.078513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Action: 'update', calling method: .version_select at 0x7f693fce0820>, body: {"quota_set": {"ram": "5120"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:44.391441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:44.395164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:44.395640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:44.396658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:44.399697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:44.400602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:44.447157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=8,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:44.549069 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b60c3877-13f0-4dcc-9d21-56eeb3ed2cc7 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0" status: 200 len: 328 microversion: 2.1 time: 0.476315 Sep 14 09:35:44.553752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2520/3196] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:35:44 2022] PUT /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0 => generated 328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:44.568945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:44.572143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:44.579493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:44.580397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:44.581019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:44.582173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:44.582795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:44.584081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:44.622928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:35:44.630423 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Working on deleting snapshot 58bb4c7b-535d-4ab2-bca5-6dae9bc57fa8 from shelved instance... Sep 14 09:35:45.952664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Doing local delete in cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122444) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 14 09:35:45.954607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:45.958147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:45.958906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:45.959565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 14 09:35:45.964351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] deallocate_for_instance() {{(pid=122444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 14 09:35:47.719149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Updating instance_info_cache with network_info: [] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 09:35:48.124908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:48.426985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9aa9cce3-dc4c-4a19-ab90-4a5de5743202 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 204 len: 0 microversion: 2.1 time: 3.868786 Sep 14 09:35:48.427631 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2521/3197] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:35:44 2022] DELETE /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 0 bytes in 3873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:48.434946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:48.435563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:48.455234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:48.455743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:48.459116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:48.461569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:48.462054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:48.462467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:48.509905 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 HTTP/1.1 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5bfaf5ef-2bad-4875-8029-d5b677c28357'} Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:48.514048 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:48.517120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:48.517629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fb8b4be-057b-4bb9-b2ee-794054a7165d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 404 len: 111 microversion: 2.1 time: 0.088917 Sep 14 09:35:48.527946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2522/3198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:48 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:48.534245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693e40aee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:49.489405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.490491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.490926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.491657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.492938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.493977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.537574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09d63f76-2f8a-4be7-a3ff-1d0a26714ff2 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0/detail" status: 200 len: 916 microversion: 2.1 time: 1.010948 Sep 14 09:35:49.538286 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2523/3199] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:35:48 2022] GET /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0/detail => generated 916 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:49.560238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfaf5ef-2bad-4875-8029-d5b677c28357", "name": "network-vif-deleted", "tag": "92b2aca5-b2ed-4e59-bc62-6c11d814e9c8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:49.575307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.575803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.576268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.594433 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] Creating event network-vif-deleted:92b2aca5-b2ed-4e59-bc62-6c11d814e9c8 for instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 on n-h1-851028-12 Sep 14 09:35:49.602846 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-61248290-75f1-4c85-9ac9-1d08baa960d2 req-eb9fb56c-9906-488f-9ced-78eae0a31a4f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060771 Sep 14 09:35:49.604019 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2524/3200] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:49.613286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:49.614275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:49.625890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.628170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.640140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.641613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:49.644737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:49.645192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:49.690359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lazy-loading 'flavor' on Instance uuid f007a8ed-829d-4abd-a458-1154edefa4c4 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:35:50.172215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e097e2c6-647f-49fe-9d05-8281f2dc77d8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/action" status: 202 len: 0 microversion: 2.20 time: 0.566614 Sep 14 09:35:50.176390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2525/3201] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:35:49 2022] POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:35:50.181529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aab17a3-a626-47cd-a176-866f1e66c32b", "name": "network-vif-deleted", "tag": "5542d625-072b-461d-9336-3fdb4995daaf"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:50.193471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:50.194199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:50.194781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:50.213080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_external_events [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] Unable to find a host for instance 3aab17a3-a626-47cd-a176-866f1e66c32b. Dropping event network-vif-deleted {{(pid=122444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:35:50.214412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c6684059-fd41-44c9-9d0d-d7ad576f551a req-e78faf72-6c8f-4ad7-8388-a04a72bd3450 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039277 Sep 14 09:35:50.215084 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2526/3202] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:35:50.221376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:50.222329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:50.231097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:50.231814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:50.232427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:50.234083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:50.234718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:50.235641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:50.253123 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b HTTP/1.1 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3aab17a3-a626-47cd-a176-866f1e66c32b'} Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:35:50.255046 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:35:50.259421 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:35:50.260746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:35:50.261774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c309494e-5089-4068-b3b7-762c659e61b7 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 404 len: 111 microversion: 2.1 time: 0.045764 Sep 14 09:35:50.262816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2527/3203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:50 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:35:50.286101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1467932651", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:50.378232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] validate_networks() for [('97594a1c-c3e5-4a53-bda5-9ff07554f88b', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:35:51.066449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:35:51.067014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:35:51.067332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:35:51.067744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:35:51.068186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:35:51.079223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.079717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.080192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.080924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.081490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.082399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.102874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:51.109134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Getting quotas for user bcaca2d700a54540918f61d900ba2a1d and project 9fa72ffc46124d6381be9392e49e0f48. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:51.123038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:35:51.125409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:35:51.178381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b6dc036-7196-4895-86e6-30aea61d50c3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.912556 Sep 14 09:35:51.185521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2528/3204] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:35:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:35:51.188891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Action: 'update', calling method: .version_select at 0x7f693ff004c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:51.387475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.388532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.389366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.390174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.390635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.391406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.456512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.457211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.458137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.459276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.460136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.460812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.569762 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdaf8c5f-67ba-422a-99c3-86003ee57683 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0?user_id=8fa42767348845a7bf875dafc1703723" status: 200 len: 328 microversion: 2.1 time: 0.387937 Sep 14 09:35:51.578454 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2529/3205] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:35:51 2022] PUT /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0?user_id=8fa42767348845a7bf875dafc1703723 => generated 328 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:51.828324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:51.829317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:51.838687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.843997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.844935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:51.849267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:51.850021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:51.850687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:52.229632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:52.252050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:52.257260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:52.264858 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-575d4d14-80ad-40fc-817d-3b2e142be152 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1724 microversion: 2.20 time: 0.687889 Sep 14 09:35:52.267658 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2530/3206] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:35:51 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1724 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:35:52.281199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-967599227", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:52.384551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:35:52.791012 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:35:52.791601 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:35:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:35:53.077288 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:35:53.077448 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:35:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:35:53.084461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:35:53.085184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:35:53.086415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:35:53.087065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:35:53.087682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:35:53.098531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:53.099341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:53.100034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:53.100997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:53.102352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:53.104177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:53.126022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:53.136426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:53.169114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:35:53.172034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:35:53.248975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b058f402-41cb-40d0-9f17-8959ee00a131 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979512 Sep 14 09:35:53.257243 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2531/3207] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:35:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:35:53.454294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1858323306", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ef9ca8bc-534a-49ad-81bd-763feca429e7"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:53.575412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] validate_networks() for [('ef9ca8bc-534a-49ad-81bd-763feca429e7', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:35:55.440921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:35:55.442440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:35:55.443854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:35:55.444482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:35:55.445170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:35:55.461715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:55.463134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:55.463871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:55.466113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:55.466928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:55.467699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:55.504837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:35:55.535998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Getting quotas for project 12b5a7b946f7416c8235b8e1e5a62843. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:35:55.543824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Getting quotas for user f1c5185bba3a477abfd9bc83d526eb6d and project 12b5a7b946f7416c8235b8e1e5a62843. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:35:55.561395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:35:55.564032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:35:55.633871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.376145 Sep 14 09:35:55.642376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2532/3208] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:35:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:35:55.654044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:55.655016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:55.688219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:55.691043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:55.691782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:55.693147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:55.693908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:55.695126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:56.192023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:56.202447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01b3caca-865c-4c12-bae2-566938353b8d tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1325 microversion: 2.1 time: 0.558257 Sep 14 09:35:56.208251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2533/3209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:55 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:56.215844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e74a3981-0064-436c-905a-b896805141fa tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693fce09d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:56.372276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e74a3981-0064-436c-905a-b896805141fa tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0?user_id=8fa42767348845a7bf875dafc1703723" status: 200 len: 370 microversion: 2.1 time: 0.162663 Sep 14 09:35:56.372964 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2534/3210] 10.222.0.90 () {58 vars in 1323 bytes} [Wed Sep 14 09:35:56 2022] GET /compute/v2.1/os-quota-sets/cfe7dbcc59d449b492a092c997c8f2a0?user_id=8fa42767348845a7bf875dafc1703723 => generated 370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:56.401818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:56.403391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:56.422932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:56.424879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:56.426645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:56.427561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:56.437805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:56.439920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:56.741240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:56.763367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3093fac6-1006-4401-92a1-045b640d1c34 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1272 microversion: 2.1 time: 0.371536 Sep 14 09:35:56.771677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2535/3211] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:56 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1272 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:56.797691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:56.806026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:56.834749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:56.846683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:56.847257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:56.859408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:56.913553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:56.914662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.054s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:57.582556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:57.611844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:57.613364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:57.614582 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1453803a-ba93-45ae-927d-380f3ec1d08c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1724 microversion: 2.20 time: 0.835799 Sep 14 09:35:57.643656 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2536/3212] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:35:56 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1724 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:35:57.669039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:57.670154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:57.685452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:57.685958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:57.686396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:57.687112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:57.687565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:57.692350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:57.966629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:57.983519 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95f275ef-0a0c-4454-a6ec-6f79430c0160 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1269 microversion: 2.1 time: 0.338607 Sep 14 09:35:57.984404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2537/3213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:57 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1269 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:58.018758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec73e10d-65e4-4daa-931b-b1a322bbfb44", "tag": "01fe88c2-c352-4453-a5a3-67130a2fc6ea"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:35:58.142896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:58.238250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:58.243185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.095s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:58.295391 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] Creating event network-changed:01fe88c2-c352-4453-a5a3-67130a2fc6ea for instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 on n-h1-851028-12 Sep 14 09:35:58.311532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0bb2d3d7-e93c-4a4d-88a1-ec7edeb834cc req-46f6ca35-5aca-4ca1-9f39-e717af1fbf5b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325454 Sep 14 09:35:58.312895 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2538/3214] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:58.327745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:58.333387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:58.373174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:58.373901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:58.374383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:58.376946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:58.377463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:58.378679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:58.949894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:35:58.964028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd41a27e-32fc-4cc3-af8d-8a8c270cbab2 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1325 microversion: 2.1 time: 0.645595 Sep 14 09:35:58.969149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2539/3215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:58 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1325 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:35:58.979595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ada2c90-97a7-44af-a7a4-dbafec4cd6b8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Calling method '.version_select at 0x7f693e317f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:59.454508 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ada2c90-97a7-44af-a7a4-dbafec4cd6b8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad/defaults" status: 200 len: 371 microversion: 2.1 time: 0.484254 Sep 14 09:35:59.464316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2540/3216] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 09:35:58 2022] GET /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad/defaults => generated 371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:35:59.476158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:35:59.477604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:35:59.512433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.513003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.513452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.514192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:35:59.514650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:35:59.515076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:35:59.542840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:00.026441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:00.041880 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cb072a0-634f-4ab0-ac80-e1addd114419 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.569484 Sep 14 09:36:00.042903 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2541/3217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:35:59 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:00.048834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:00.049866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:00.060830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.062289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.077096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:00.078601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:00.080242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:00.081075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:01.200043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:01.226457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:01.232892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:01.239696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-372e3478-8a7b-4798-b226-e6731220038f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1724 microversion: 2.20 time: 1.194916 Sep 14 09:36:01.242962 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2542/3218] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:00 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1724 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:01.248040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:01.252782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:01.266977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:01.272138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:01.272900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:01.274510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:01.275235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:01.275949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.377080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:02.393896 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d88e277d-af03-4dbc-9d52-2b689d7ec90a tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 1.143864 Sep 14 09:36:02.394621 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2543/3219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:01 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:02.405209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Action: 'update', calling method: .version_select at 0x7f6944192dc0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:02.533183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:02.533899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:02.534761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.535846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:02.536551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:02.537334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:02.982838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3549f311-05c8-4e7c-b381-fd50838d6ab8 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad" status: 200 len: 329 microversion: 2.1 time: 0.585259 Sep 14 09:36:02.986070 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2544/3220] 10.222.0.90 () {60 vars in 1263 bytes} [Wed Sep 14 09:36:02 2022] PUT /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad => generated 329 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:03.003504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:03.004203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:03.014943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.015448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.015926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.016651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.017120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.017951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.395367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:03.416774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06f19336-bc30-4ccd-87a2-22c7111455fe tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1325 microversion: 2.1 time: 0.428930 Sep 14 09:36:03.417600 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2545/3221] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:02 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:03.423202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7017aec0-68bc-4327-9c94-b0272350df49", "tag": "b9abac1d-7fda-473a-80fd-b32e86bac0f7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:03.440371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.441444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.442269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.466287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] Creating event network-changed:b9abac1d-7fda-473a-80fd-b32e86bac0f7 for instance 7017aec0-68bc-4327-9c94-b0272350df49 on n-h2-851028-12 Sep 14 09:36:03.481831 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3941c99d-134e-4348-bace-5236f6685cf2 req-a2e988a2-4552-4f50-a24a-73c703a03962 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062599 Sep 14 09:36:03.483272 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2546/3222] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:03.494347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:03.495243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:03.504407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.504407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.505000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.505871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.506444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.507005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.795058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:03.815934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3cdae353-b800-4d9e-b059-c1e22ddaab2c tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.330782 Sep 14 09:36:03.816707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2547/3223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:03 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:03.827344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:03.827344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:03.838233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.843560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.844409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:03.845313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:03.845906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:03.846452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.186499 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:36:04.187069 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:36:04.369885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:04.387660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:04.396268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:04.400394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a11df5e-1403-44d8-a99d-f9c3d81c5412 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.579905 Sep 14 09:36:04.401482 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2548/3224] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:03 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:04.409079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776b359a-4722-4ba0-930b-9a44fd8ed875", "tag": "04ec5d85-e306-4d40-9403-053fe9f00f4a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:04.441447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.443769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.447519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.482934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] Creating event network-changed:04ec5d85-e306-4d40-9403-053fe9f00f4a for instance 776b359a-4722-4ba0-930b-9a44fd8ed875 on n-h1-851028-12 Sep 14 09:36:04.490119 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fa7e1734-08c8-49a9-b314-ebd4efb06867 req-94a286d8-ba18-4314-a1c4-e011f100ba56 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086772 Sep 14 09:36:04.491287 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2549/3225] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:04.513425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Action: 'update', calling method: .version_select at 0x7f693e35d0d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:04.700547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.701511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.702135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.704164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:04.706083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:04.708523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:04.866963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=19,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:04.891034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:05.452945 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3e08953-8383-4d99-9457-5a5cd6fbe991 tempest-QuotasAdminTestJSON-1442899724 tempest-QuotasAdminTestJSON-1442899724-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad" status: 200 len: 329 microversion: 2.1 time: 0.959372 Sep 14 09:36:05.461495 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2550/3226] 10.222.0.90 () {60 vars in 1263 bytes} [Wed Sep 14 09:36:04 2022] PUT /compute/v2.1/os-quota-sets/8cfa8bc4effa4f5882053862751f3aad => generated 329 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:05.480559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec73e10d-65e4-4daa-931b-b1a322bbfb44", "name": "network-vif-plugged", "status": "completed", "tag": "01fe88c2-c352-4453-a5a3-67130a2fc6ea"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:05.533447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.533942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.534382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.562707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] Creating event network-vif-plugged:01fe88c2-c352-4453-a5a3-67130a2fc6ea for instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 on n-h1-851028-12 Sep 14 09:36:05.592567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-44b7a569-ee10-498f-b0df-2cc952514c4e req-020a9036-8e01-48de-87a1-aa7f849f3df4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129714 Sep 14 09:36:05.593346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2551/3227] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:05.603591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:05.606959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:05.623619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.625131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.626848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:05.630688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:05.631499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:05.633768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.212368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:06.222499 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c88513e-9f52-4224-beed-8a8b55ddcaa6 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 0.628083 Sep 14 09:36:06.231620 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2552/3228] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:05 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:06.251415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:06.256565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:06.266027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.266936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.268728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.269920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.270683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.271332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.499292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:06.511088 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d1ca4ec-84dc-44aa-98a2-240845bc5979 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1325 microversion: 2.1 time: 0.275303 Sep 14 09:36:06.513849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2553/3229] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:06 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:06.522001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:06.529422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:06.542489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.543305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.543975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.544875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.545516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.546130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.893817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:06.903607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95b8c010-1458-44ce-94f0-02c75e2db0cd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.388359 Sep 14 09:36:06.911001 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2554/3230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:06 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:06.918774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:06.922854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:06.935346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.938491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.939278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:06.940305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:06.940994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:06.942428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.213909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:07.226756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:07.228535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:07.229936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38c3a6a4-d43c-4d4b-a776-c7792546a996 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.317648 Sep 14 09:36:07.230918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2555/3231] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:06 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:07.259199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:07.259971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:07.274021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.276079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.278062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.279450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.281716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.281836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.669204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:07.697415 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00e0a88b-d3e8-426a-8451-02efa82806fc tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 0.429912 Sep 14 09:36:07.712584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2556/3232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:07 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:07.725134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:07.728243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:07.749810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.750630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.752620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:07.753940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:07.754622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:07.755240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.061559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:08.072268 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1a9a0f4-7e73-48c0-9622-1770f5bc2be3 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1522 microversion: 2.1 time: 0.353838 Sep 14 09:36:08.074974 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2557/3233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:07 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:08.089933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-plugged", "status": "completed", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:08.111760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.112478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.113054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.130922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] Creating event network-vif-plugged:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:36:08.150595 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c656bc96-d21a-41e4-a13a-7c9d24de8d1f req-fbf36dd4-272e-405e-8cc8-1b6cf1a395be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069992 Sep 14 09:36:08.152076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2558/3234] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:08.189034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:08.191681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:08.229674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.230282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.231258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.231578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.232142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.232665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.633691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:08.648794 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ad2928e-0ca9-4b81-9384-00eee3b899c2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.494053 Sep 14 09:36:08.649819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2559/3235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:08 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:08.662020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:08.662742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:08.686498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.688611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.689219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.689980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:08.692661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:08.692661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:08.768644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:36:08.886027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:09.057017 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fef2e62b-096d-441b-b971-ab0cb7e987de tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 204 len: 0 microversion: 2.1 time: 0.405463 Sep 14 09:36:09.062301 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2560/3236] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:36:08 2022] DELETE /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:36:09.082846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:09.083576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:09.106937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.109040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.109495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.112416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.112954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.113409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.608601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:09.624593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:09.631359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:09.636676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a2cfe60-493e-43a2-96f3-fc38ffb68658 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.573725 Sep 14 09:36:09.640541 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2561/3237] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:09 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:09.657775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:09.663415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:09.709876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.730315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.731249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:09.734832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:09.737605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:09.739459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.135969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:10.149041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f6a9a86-2a4e-4748-ab7b-44a5f952e26f tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 0.505643 Sep 14 09:36:10.152218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2562/3238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:09 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:10.179145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:10.180010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:10.191771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.196553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.197032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.198618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.199119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.199553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.799552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:10.811420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c167f10e-5712-4a3d-9626-fe1f21dafeed tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1528 microversion: 2.1 time: 0.658021 Sep 14 09:36:10.821055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2563/3239] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:10 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1528 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:10.841075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:10.845443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:10.868999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.869904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.871998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:10.884499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:10.884499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:10.884499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.517653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:11.543784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4c3a3de5-3716-4e35-a3b3-1f24724e6905 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.721479 Sep 14 09:36:11.544432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2564/3240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:10 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:11.564523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7017aec0-68bc-4327-9c94-b0272350df49", "name": "network-vif-plugged", "status": "completed", "tag": "b9abac1d-7fda-473a-80fd-b32e86bac0f7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:11.607694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.611456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.615335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.680555 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] Creating event network-vif-plugged:b9abac1d-7fda-473a-80fd-b32e86bac0f7 for instance 7017aec0-68bc-4327-9c94-b0272350df49 on n-h2-851028-12 Sep 14 09:36:11.709562 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5dda3559-51f2-4b76-bf8e-b2e27d3e6c73 req-48770d53-ea0e-442d-8c68-da23508145c7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160853 Sep 14 09:36:11.714830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2565/3241] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:11.737160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:11.737879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:11.782138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.782657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.783113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:11.783855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:11.784362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:11.785225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.416688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.434813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.436873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:12.447565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cf1f3f2-02b3-4303-9d2e-22cd8da57263 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.722221 Sep 14 09:36:12.454477 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2566/3242] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:11 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:12.474489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:12.475119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:12.498543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.499191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.499697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:12.500472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:12.501062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:12.501920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.105538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:13.134729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-921a01cb-2dbc-4022-b57e-aedb0991b687 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 0.673762 Sep 14 09:36:13.135420 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2567/3243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:12 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:13.161910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:13.162880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:13.170646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.171581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.174985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.176583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.177566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.178948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.329303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcaca2d700a54540918f61d900ba2a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa72ffc46124d6381be9392e49e0f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:13.339804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-471b6674-cb4e-4887-9294-2a1340fd4768 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 200 len: 1486 microversion: 2.1 time: 0.189487 Sep 14 09:36:13.350754 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2568/3244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:13 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 1486 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:13.373145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:13.374109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:13.382339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.386855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.388397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.393373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:13.397579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:13.397579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:13.886489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:13.903851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-352413be-4090-4770-b6e1-ade008db06f0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1314 microversion: 2.1 time: 0.544152 Sep 14 09:36:13.909999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2569/3245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:13 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:14.355474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-362017769", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:14.365507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=14,nova_api:INSERT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:14.458841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:36:14.751680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=21 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:14.994234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:14.996172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:14.996909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:14.997539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:14.997976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:15.028571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.029188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.029526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.030274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.030740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.031171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.059712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:15.066105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:15.081574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:36:15.084283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:15.167928 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87d5d9ca-74e6-4e20-b7fa-c39b29f7e9a7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257354 Sep 14 09:36:15.169232 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2570/3246] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:36:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:36:15.179155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec73e10d-65e4-4daa-931b-b1a322bbfb44", "name": "network-vif-deleted", "tag": "01fe88c2-c352-4453-a5a3-67130a2fc6ea"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:15.197471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.198338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.198982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.233515 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] Creating event network-vif-deleted:01fe88c2-c352-4453-a5a3-67130a2fc6ea for instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 on n-h1-851028-12 Sep 14 09:36:15.249279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a01e9d6c-5134-4064-b5b3-e021017f4aab req-68130ec2-a4e1-43e0-bba6-6dc3084bd2e2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077285 Sep 14 09:36:15.253881 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2571/3247] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:15.261023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:15.261740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:15.269825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.270325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.270771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.271578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.272177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.272615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.462340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:15.480854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:15.482103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:15.483372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06b48d22-b13b-435c-ad52-2d9af05216f2 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.228020 Sep 14 09:36:15.496887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2572/3248] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:15 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:15.511616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776b359a-4722-4ba0-930b-9a44fd8ed875", "name": "network-vif-plugged", "status": "completed", "tag": "04ec5d85-e306-4d40-9403-053fe9f00f4a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:15.539074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.539929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.540596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.561293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] Creating event network-vif-plugged:04ec5d85-e306-4d40-9403-053fe9f00f4a for instance 776b359a-4722-4ba0-930b-9a44fd8ed875 on n-h1-851028-12 Sep 14 09:36:15.578916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-25704923-fb04-49c9-a8a4-f489db76f0bd req-de6f85d7-0a55-4820-a65d-606aa4a8f7df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070803 Sep 14 09:36:15.581539 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2573/3249] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:15.596424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:15.598706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:15.613012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.617952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.618959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:15.620411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:15.625285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:15.626526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.181357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:16.196911 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a86fa84c-1142-47ad-bdcf-da70e8173d01 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1317 microversion: 2.1 time: 0.611384 Sep 14 09:36:16.215524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2574/3250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:15 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:16.216582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.217518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: ec73e10d-65e4-4daa-931b-b1a322bbfb44] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:16.234789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.236387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.238069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.239650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.241447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.244353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.269959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 HTTP/1.1 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ec73e10d-65e4-4daa-931b-b1a322bbfb44'} Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.271932 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. Sep 14 09:36:16.275638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.277137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance ec73e10d-65e4-4daa-931b-b1a322bbfb44 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:16.278181 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3060b0ab-71ac-4dc2-8e55-2e6bf33c6e9c tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44" status: 404 len: 111 microversion: 2.1 time: 0.076846 Sep 14 09:36:16.279146 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2575/3251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:16 2022] GET /compute/v2.1/servers/ec73e10d-65e4-4daa-931b-b1a322bbfb44 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:16.284330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.286104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:16.294239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.294940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.295540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.296444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.298013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.298634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.573641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:16.586816 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a69f017-3efb-4681-9d4c-dcdd5a0ff75d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1499 microversion: 2.1 time: 0.306236 Sep 14 09:36:16.589849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2576/3252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:16 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1499 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:16.612955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.616620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:16.631027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.631581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.633897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.634954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.637574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.638692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.802558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:16.814376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-641e297f-beed-48a8-a3df-6705b62f8368 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1268 microversion: 2.1 time: 0.223363 Sep 14 09:36:16.816027 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2577/3253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:16 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:16.847276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69d27777-93b7-41fb-bb6e-a2cfb1156a02 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693f119af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.907130 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-69d27777-93b7-41fb-bb6e-a2cfb1156a02 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Image not found. Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69d27777-93b7-41fb-bb6e-a2cfb1156a02 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63 HTTP/1.1 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e6e05349-6ff8-4f80-942f-1e7bf58d7e63'} Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e6e05349-6ff8-4f80-942f-1e7bf58d7e63 to delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e6e05349-6ff8-4f80-942f-1e7bf58d7e63 could not be found. Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:16.910427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:36:16.914284 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:16.916006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69d27777-93b7-41fb-bb6e-a2cfb1156a02 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:16.917250 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69d27777-93b7-41fb-bb6e-a2cfb1156a02 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63" status: 404 len: 62 microversion: 2.1 time: 0.092934 Sep 14 09:36:16.920613 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2578/3254] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:16 2022] DELETE /compute/v2.1/images/e6e05349-6ff8-4f80-942f-1e7bf58d7e63 => generated 62 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:36:16.929929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:16.931398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:16.942273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.943248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.944177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:16.945484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:16.946432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:16.947174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.234978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:17.246568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:17.248222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:17.249661 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5dc26ddc-f449-45e8-9fac-2f69458805f4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.327762 Sep 14 09:36:17.250393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2579/3255] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:16 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:17.273680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:17.283954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.284705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.285302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.371920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:36:17.463246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:17.519431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f183f4b4-e56c-42de-a9af-310bc39bc778 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49/action" status: 202 len: 0 microversion: 2.1 time: 0.264057 Sep 14 09:36:17.525417 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2580/3256] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:36:17 2022] POST /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:36:17.549408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:17.551099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:17.582077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.586645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.588677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.591420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.594203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.596246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.665370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 HTTP/1.1 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5bfaf5ef-2bad-4875-8029-d5b677c28357'} Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:17.672427 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:17.676364 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4786a5e1-39fa-4d5f-881f-5fdacd81a057 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 404 len: 111 microversion: 2.1 time: 0.144305 Sep 14 09:36:17.686223 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2581/3257] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:36:17 2022] DELETE /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:17.716683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:17.717318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:17.744766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.745379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.745694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:17.746413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:17.749826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:17.750287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.094242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:18.109919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00bd907a-dc4a-45ec-88eb-04b2eccb0047 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1506 microversion: 2.1 time: 0.421213 Sep 14 09:36:18.110710 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2582/3258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:17 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:18.144657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:18.146309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:18.179182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.179704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.180185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.180913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.181374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.181809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.615411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:18.652607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-302d0d5d-eb35-4e5d-98ca-b74010573b57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.537782 Sep 14 09:36:18.656317 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2583/3259] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:18 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:18.676398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:18.677518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 5bfaf5ef-2bad-4875-8029-d5b677c28357] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:18.701420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.709460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.711106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.717161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.717670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.720266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.763779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 HTTP/1.1 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '5bfaf5ef-2bad-4875-8029-d5b677c28357'} Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:18.766057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. Sep 14 09:36:18.769402 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:18.774306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 5bfaf5ef-2bad-4875-8029-d5b677c28357 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:18.775450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39a7dfb6-e0d2-4a9d-8ae6-0c67c353b3bd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357" status: 404 len: 111 microversion: 2.1 time: 0.116982 Sep 14 09:36:18.776602 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2584/3260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:18 2022] GET /compute/v2.1/servers/5bfaf5ef-2bad-4875-8029-d5b677c28357 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:18.781704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:18.782629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:18.790230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.791105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.791768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.792781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:18.793453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:18.794890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:18.966049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:18.981282 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cfe11e7-c369-4bb4-a8be-3e219e5e8ba0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1274 microversion: 2.1 time: 0.203266 Sep 14 09:36:18.982218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2585/3261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:18 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1274 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:19.003473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:19.003473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:19.011842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.012568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.013350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.016224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.016850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.017426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.055068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:19.056385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2127da5-622f-4a39-bc3c-908483b1b473 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/os-instance-actions/req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893" status: 200 len: 313 microversion: 2.1 time: 0.073102 Sep 14 09:36:19.065796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2586/3262] 10.222.0.90 () {58 vars in 1419 bytes} [Wed Sep 14 09:36:18 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/os-instance-actions/req-5f3fa5c2-7ed1-4079-a213-d2100b1d3893 => generated 313 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:19.070110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:19.071037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:19.079306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.080082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.081345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.082789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.083954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.084659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.504915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:19.570327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:19.585144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:19.589561 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-63947e67-5c26-4328-baab-285c1927579a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.530994 Sep 14 09:36:19.592753 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2587/3263] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:19 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:19.635688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edf1071a-f6fd-4df6-9ee9-23031cf3ccde tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693e31fc10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:19.706835 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edf1071a-f6fd-4df6-9ee9-23031cf3ccde tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211223134" status: 202 len: 0 microversion: 2.1 time: 0.109553 Sep 14 09:36:19.714605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2588/3264] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 09:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1211223134 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:36:19.724168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:19.728149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:19.739439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.742560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.745141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.747486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:19.748841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:19.749445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:19.987990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be3fbe65-fd63-43da-b808-a886b79abefd tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "POST /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/action" status: 202 len: 0 microversion: 2.1 time: 0.269560 Sep 14 09:36:19.993298 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2589/3265] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:36:19 2022] POST /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:36:20.005835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:20.009145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:20.029159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.029777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.033980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:20.036216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.036731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.039683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:20.847701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:20.861707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a44b03c2-ed30-4bc6-bdcd-d3e37cbe2c9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.868771 Sep 14 09:36:20.863128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2590/3266] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:19 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:20.868406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:20.871497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:20.895109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.895643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.896131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:20.896880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:20.897358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:20.898135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.280249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:21.294290 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae1a34d5-4704-4e9d-80e4-7731cdd7d4c7 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1508 microversion: 2.1 time: 0.429605 Sep 14 09:36:21.300740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2591/3267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:20 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:21.320380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:21.321346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:21.335030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:21.336511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:21.337209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.340669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:21.341397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:21.342279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.723830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:21.732915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f44c6075-f1e5-4340-b059-936c18190fc4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.430807 Sep 14 09:36:21.748467 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2592/3268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:21 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:21.762516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:21.763194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:21.785166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:21.785684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:21.786107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.786819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:21.787275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:21.787698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:21.984138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.001886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.003687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.005056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e59719bc-1e45-4316-a8d3-388ed46c9678 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.255373 Sep 14 09:36:22.021235 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2593/3269] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:21 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:22.028241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:22.029147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:22.037391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.037886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.038321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.039228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.039681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.040146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.574050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.595559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a7ade0e-58e0-4d27-b23e-f8c4477957d4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.572655 Sep 14 09:36:22.598667 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2594/3270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:22 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:22.607693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:22.610508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:22.621670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.627286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.628738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.629689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:22.631795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:22.632679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:22.975699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:22.989731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d0c2278-9932-41f7-85b0-b6201d895bf0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1513 microversion: 2.1 time: 0.389753 Sep 14 09:36:22.990984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2595/3271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:22 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:23.019417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:23.020541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:23.028574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.029613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.030214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.031221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.031839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.032449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.419930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:23.432246 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc4b2b78-69c1-457f-8cfd-8faad78d409c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.422045 Sep 14 09:36:23.444638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2596/3272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:23 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:23.454776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ecc089b-0f53-48e8-9e23-b4fb9c38fbcd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '.version_select at 0x7f693efa0af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:23.485724 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7ecc089b-0f53-48e8-9e23-b4fb9c38fbcd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Image not found. Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ecc089b-0f53-48e8-9e23-b4fb9c38fbcd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/images/3c45fc23-bb6d-4a65-81e0-c28a20e06ed0 HTTP/1.1 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: exception: Image not found. Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3c45fc23-bb6d-4a65-81e0-c28a20e06ed0'} Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3c45fc23-bb6d-4a65-81e0-c28a20e06ed0 to delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c45fc23-bb6d-4a65-81e0-c28a20e06ed0 could not be found. Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:23.490141 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ecc089b-0f53-48e8-9e23-b4fb9c38fbcd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Image not found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ecc089b-0f53-48e8-9e23-b4fb9c38fbcd tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/images/3c45fc23-bb6d-4a65-81e0-c28a20e06ed0" status: 404 len: 62 microversion: 2.1 time: 0.043054 Sep 14 09:36:23.494016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2597/3273] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:23 2022] DELETE /compute/v2.1/images/3c45fc23-bb6d-4a65-81e0-c28a20e06ed0 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:36:23.503785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:23.506555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:23.535656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.536183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.536625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.537349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.537805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.538234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:23.859364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:23.869793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:23.879635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:23.885034 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-935ae727-aead-469c-9aae-98bdb8a1aa11 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.393920 Sep 14 09:36:23.902705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2598/3274] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:23 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:23.932429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864f9917-6f8f-434e-8942-3e2f7a854cd7", "tag": "5a598588-710d-4056-960c-cf064d05b6aa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:23.972212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:23.972697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:23.973123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.011455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:24.018516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] Creating event network-changed:5a598588-710d-4056-960c-cf064d05b6aa for instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 on n-h1-851028-12 Sep 14 09:36:24.029536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e42cf7b0-0f25-4689-981d-1018adaec916 req-0ede2367-0183-42e7-a1a6-db728a826b4e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125715 Sep 14 09:36:24.032306 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2599/3275] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:24.044184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.046103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.078370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.079460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.080278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.081340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.081947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.082611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.103249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c HTTP/1.1 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c'} Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:24.105345 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.109699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.111481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:24.112643 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9082f4f9-ae2c-448a-98f6-f03af1f7f82f tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 404 len: 111 microversion: 2.1 time: 0.078416 Sep 14 09:36:24.113754 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2600/3276] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:36:24 2022] DELETE /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:24.119810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.121011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.127307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.128094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.128695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.129565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.130167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.130893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.361704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:24.371626 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4c0ad454-1e70-4750-8f35-a7f6b0c30f6e tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.256033 Sep 14 09:36:24.372434 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2601/3277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:24 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:24.391943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.412426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.423802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.424446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.424907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.425782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.426238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.426787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.658860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:24.672194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32aa31bb-de6f-4c76-8b8a-2a78e3d16911 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1506 microversion: 2.1 time: 0.298468 Sep 14 09:36:24.689589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2602/3278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:24 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:24.700203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.706946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] [instance: 8fba5d56-a673-4635-bfe6-0a730034b64c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.726420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.727079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.730619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.732646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.734808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.736696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.777313 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] HTTP exception thrown: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Request method failure captured: Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c HTTP/1.1 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaAVu-4jREfY8bB4gS3uH4npWfapKHhs_5mr1UZF9Ep8UPQyQK9qHxTz2X5AZ62_uits-ElGQdZtyIkAqlUaI8QxVQ9nbhWXTshkVBQmAMyJyM7YTX9JvESGpEhCnCLczfuecyAoxhiHm9gFknPwEC-4gg_RIuRCpEFPsumFG3hChY0 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_9fa72ffc46124d6381be9392e49e0f48", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/9fa72ffc46124d6381be9392e49e0f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/9fa72ffc46124d6381be9392e49e0f48"}]}] Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 9fa72ffc46124d6381be9392e49e0f48 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545 Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bcaca2d700a54540918f61d900ba2a1d Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1627541545-project Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8fba5d56-a673-4635-bfe6-0a730034b64c'} Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.779051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. Sep 14 09:36:24.783174 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:24.785436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] Returning 404 to user: Instance 8fba5d56-a673-4635-bfe6-0a730034b64c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:24.786414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4858f076-8997-46d5-b847-85f41b14e882 tempest-ImagesOneServerNegativeTestJSON-1627541545 tempest-ImagesOneServerNegativeTestJSON-1627541545-project] 10.222.0.90 "GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c" status: 404 len: 111 microversion: 2.1 time: 0.094701 Sep 14 09:36:24.788323 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2603/3279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:24 2022] GET /compute/v2.1/servers/8fba5d56-a673-4635-bfe6-0a730034b64c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:24.809968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:24.829964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:24.859884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.861739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.863502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:24.866273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:24.867667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:24.868726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.051039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:25.075009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=30 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:25.220413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:25.233439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2fc9284e-d54a-4de1-bf61-066833bf4bf8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.440296 Sep 14 09:36:25.241952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2604/3280] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:24 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:25.247529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '.version_select at 0x7f693e3d1820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:25.249456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:25.265024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.265852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.268943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.271715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.274507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.275233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.335152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-681d6168-1934-47b8-a393-3eaf5b303fb0 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.088848 Sep 14 09:36:25.338284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2605/3281] 10.222.0.90 () {58 vars in 1296 bytes} [Wed Sep 14 09:36:25 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875/os-instance-actions => generated 611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:25.353959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:25.355253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:25.376775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.377538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.379468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.380442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.381063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.381651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.786221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:25.800142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:25.801662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:25.802873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dccd521-646a-4e65-8035-110c6e1c8942 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.463446 Sep 14 09:36:25.803457 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2606/3282] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:25 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:25.813458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:25.813967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:25.832309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.832309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.832765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.833478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:25.833935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:25.834361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:25.908298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:36:26.115974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41d7f758-35fc-48c6-aa86-d681e4de5c55 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "DELETE /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 204 len: 0 microversion: 2.1 time: 0.311124 Sep 14 09:36:26.117191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2607/3283] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:36:25 2022] DELETE /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:36:26.123144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:26.123969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:26.140946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.141456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.141960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.142867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.143165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.143615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.608075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:26.619652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c671752-fdc7-468e-9ee4-8bf1ea715808 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.500590 Sep 14 09:36:26.620295 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2608/3284] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:26 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:26.627206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:26.628094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:26.650659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.652529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.653201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.660257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.661027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.661473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.884438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1c5185bba3a477abfd9bc83d526eb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b5a7b946f7416c8235b8e1e5a62843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:26.900147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cd71171-5922-4001-9a0f-f47c8f173551 tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 200 len: 1512 microversion: 2.1 time: 0.278351 Sep 14 09:36:26.902371 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2609/3285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:26 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:26.913899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:26.920969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:26.930905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.931696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.932373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:26.933692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:26.934353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:26.935430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:27.839132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:27.850130 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2378c2f0-6859-461f-b6b3-792448854e7d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.943400 Sep 14 09:36:27.865061 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2610/3286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:26 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:27.875687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:27.877029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:27.880995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:27.886057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:27.887732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:27.888624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:27.889562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:27.890246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:27.890887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:28.707527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:28.725618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:28.727930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:28.729505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a56a66f-fe87-4245-b5aa-278512da30e3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1740 microversion: 2.20 time: 0.863182 Sep 14 09:36:28.759924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2611/3287] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:27 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1740 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:28.784503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:28.785211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:28.798300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:28.798959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:28.799405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:28.805563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:28.807061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:28.808568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.258523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:29.266685 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5f003ea-4648-4bf8-94d3-5da81bf13922 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.508009 Sep 14 09:36:29.267816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2612/3288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:28 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:29.273599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:29.274450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] [instance: 776b359a-4722-4ba0-930b-9a44fd8ed875] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:29.283289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.285080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.285675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.287246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.287963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.288928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.304808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] HTTP exception thrown: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Request method failure captured: Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 HTTP/1.1 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaB2EcLxz6XI6dbqRQ7zauI5Xg6F732na2A8cdrE7NIpA99b7gXseSsDfChLpwl78NpSO1edA76HQ0t_KHHYsxOFD1dZ-sxey1KoM7Wp2nvWR84yd3DUKwZtUCmHQfes0pcA3MvMHws-T-v3HcOwcBv1qo3S-fYvH6X6IqhS9ku3svs Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 12b5a7b946f7416c8235b8e1e5a62843 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsTestJSON-1487236626 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_12b5a7b946f7416c8235b8e1e5a62843", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12b5a7b946f7416c8235b8e1e5a62843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/12b5a7b946f7416c8235b8e1e5a62843"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/12b5a7b946f7416c8235b8e1e5a62843"}]}] Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsTestJSON-1487236626 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 12b5a7b946f7416c8235b8e1e5a62843 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1487236626 Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsTestJSON-1487236626-project Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: f1c5185bba3a477abfd9bc83d526eb6d Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsTestJSON-1487236626-project Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '776b359a-4722-4ba0-930b-9a44fd8ed875'} Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:29.306563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] Returning 404 to user: Instance 776b359a-4722-4ba0-930b-9a44fd8ed875 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f38ced8f-7e9d-42b7-8569-7ee71b29532b tempest-InstanceActionsTestJSON-1487236626 tempest-InstanceActionsTestJSON-1487236626-project] 10.222.0.90 "GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875" status: 404 len: 111 microversion: 2.1 time: 0.039058 Sep 14 09:36:29.310875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2613/3289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:29 2022] GET /compute/v2.1/servers/776b359a-4722-4ba0-930b-9a44fd8ed875 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:29.315403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776b359a-4722-4ba0-930b-9a44fd8ed875", "name": "network-vif-deleted", "tag": "04ec5d85-e306-4d40-9403-053fe9f00f4a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:29.330289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.331132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.332044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.352098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] Creating event network-vif-deleted:04ec5d85-e306-4d40-9403-053fe9f00f4a for instance 776b359a-4722-4ba0-930b-9a44fd8ed875 on n-h1-851028-12 Sep 14 09:36:29.374727 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1412a9d2-dc23-4917-91da-fd3eeb0d0c10 req-fa6e72bc-152b-4e9a-9725-cc9057b3b160 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049042 Sep 14 09:36:29.378607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2614/3290] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:29.395579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:29.399310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:29.410943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.411438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.411872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.412605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.413062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.413556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.772449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:29.785330 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39393a2c-6577-4411-96ae-c79fad8161c5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.405387 Sep 14 09:36:29.804024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2615/3291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:29 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:29.810561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864f9917-6f8f-434e-8942-3e2f7a854cd7", "name": "network-vif-plugged", "status": "completed", "tag": "5a598588-710d-4056-960c-cf064d05b6aa"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:29.822185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.822900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.823491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.840711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] Creating event network-vif-plugged:5a598588-710d-4056-960c-cf064d05b6aa for instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 on n-h1-851028-12 Sep 14 09:36:29.847256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-09fe2247-88f0-424e-8010-af5e0463f1ce req-cceefeb3-fc04-423d-b37a-1faa09859155 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040420 Sep 14 09:36:29.849675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2616/3292] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:29.857204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:29.859309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:29.866833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.867716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.869530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:29.870558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:29.871769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:29.872397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:30.429381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:30.444307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:30.449406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:30.452844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c458d91-8c13-4271-a852-5ca2231f3a4f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1722 microversion: 2.20 time: 0.599946 Sep 14 09:36:30.455786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2617/3293] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:29 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1722 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:30.462046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:30.463079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:30.471985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:30.472734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:30.473327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:30.474665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:30.475330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:30.478366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:30.485884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:30.767622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:30.785910 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b75c999a-fb2e-46f0-ab6e-d495125fa2cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.327898 Sep 14 09:36:30.788875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2618/3294] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:30 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:30.823048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:30.823963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:30.831426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:30.832617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:30.833244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:30.834122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:30.834984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:30.836258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:31.624010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:31.632998 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-073e673d-8730-4bfd-bf5f-96414cb71ed7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1316 microversion: 2.1 time: 0.822963 Sep 14 09:36:31.634039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2619/3295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:30 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1316 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:31.647639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:31.658898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:31.666195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:31.670282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:31.671032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:31.672011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:31.672647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:31.673246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:31.933456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:31.962944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:31.967532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:31.972431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20a76018-06a2-417e-a872-0f3c10623606 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1722 microversion: 2.20 time: 0.331080 Sep 14 09:36:31.976562 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2620/3296] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:31 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:31.983518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:31.987694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:32.003441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:32.003801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:32.006400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:32.007425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:32.008974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:32.009417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:32.927654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:32.960856 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcad4e8b-c0be-4342-b6b3-1582f62f1b98 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.982239 Sep 14 09:36:32.962366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2621/3297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:31 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:32.980591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:32.981584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:33.000501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:33.003851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:33.004714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:33.006073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:33.006912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:33.007784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:33.744729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:33.755810 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eca3d28d-bc36-4213-95d4-b0fcfd999953 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1466 microversion: 2.1 time: 0.791981 Sep 14 09:36:33.756447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2622/3298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:32 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1466 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:33.778758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-unplugged", "status": "completed", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:33.794519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:33.798437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:33.801064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:33.833828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_external_events [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] Unable to find a host for instance f007a8ed-829d-4abd-a458-1154edefa4c4. Dropping event network-vif-unplugged {{(pid=122444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:36:33.835038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-57ae73e9-d457-4961-9a8d-7e9fafdd013c req-da8b3451-988b-454d-a940-e9aa89f1b65f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.075874 Sep 14 09:36:33.847275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2623/3299] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:36:33.875019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:33.876411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:33.888673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:33.889396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:33.894478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:33.896123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:33.896758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:33.897370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:34.152480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:34.163189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:34.166015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:34.167297 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f72cbe7-3e15-4c11-b598-b62dc1154c1e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1665 microversion: 2.20 time: 0.318739 Sep 14 09:36:34.167926 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2624/3300] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:33 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1665 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:34.434731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:34.435349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:34.443183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:34.444043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:34.444520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:34.445267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:34.446144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:34.446730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.050723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27a8db41-5218-46b4-a465-0e36d3a7bb81 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1619 microversion: 2.1 time: 0.860467 Sep 14 09:36:35.054552 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2625/3301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:34 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1619 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:35.061455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:35.062263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:35.072663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.075665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.076906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.077807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.081134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.081782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.371624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:35.380526 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3ec4263-4f06-4ef9-852e-a33f9f4ac8a6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.324080 Sep 14 09:36:35.381092 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2626/3302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:35 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:35.389746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56c8789d-1f19-4256-a73a-bff5e5f0cc36"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:35.394539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:35.419201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.419873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.420737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:35.421602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:35.422209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:35.422986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:36.073982 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53876762-8c58-42f1-9db2-3b258209fa0d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.688653 Sep 14 09:36:36.084391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2627/3303] 10.222.0.90 () {62 vars in 1364 bytes} [Wed Sep 14 09:36:35 2022] POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments => generated 188 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:36:36.093227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: .version_select at 0x7f693e11f5e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1744073227", "policies": ["affinity"]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:36.151468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:36.165375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:36.255503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:36.267870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:36.306079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2411859a-3273-468f-b7c1-d36af928ba65 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.221883 Sep 14 09:36:36.318153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2628/3304] 10.222.0.90 () {60 vars in 1174 bytes} [Wed Sep 14 09:36:36 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:36.336422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:36.337167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:36.344142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:36.344854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:36.345472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:36.346337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:36.346944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:36.347523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:36.867687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6111d70-aa07-4f0f-806d-5c2028f8cc31 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments/56c8789d-1f19-4256-a73a-bff5e5f0cc36" status: 202 len: 0 microversion: 2.20 time: 0.535849 Sep 14 09:36:36.869803 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2629/3305] 10.222.0.90 () {60 vars in 1457 bytes} [Wed Sep 14 09:36:36 2022] DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments/56c8789d-1f19-4256-a73a-bff5e5f0cc36 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:36:36.876164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:36.876800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:36.884640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:36.885391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:36.885989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:36.887158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:36.891925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:36.893668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:37.109131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:37.128431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af2d6c49-05eb-4609-943f-c9bed2c34953 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.257063 Sep 14 09:36:37.129744 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2630/3306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:36 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:37.135937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1157122115", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cd7a3b94-0a9f-445b-a884-28d912991ead"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:37.204398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:36:37.516292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:37.516795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:37.517289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:37.517687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:37.518241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:37.537813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:37.539220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:37.540247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:37.541773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:37.542399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:37.543196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:37.566538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:37.578015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:37.594340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 2 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:36:37.597124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:37.656016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122444) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 14 09:36:37.684224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:37.693145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:37.757709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:37.765265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:37.772381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:37.796337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=32fcb6bd-24d9-4974-b1aa-5f2158dff3d0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:37.868463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:37.887653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:37.962543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:37.977569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:38.108406 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c83f6dc-dde4-4a27-b623-b8e2d5f7fdb9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.974721 Sep 14 09:36:38.111853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2631/3307] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:36:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:36:38.127515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:38.128950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:38.151591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:38.152773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:38.153688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:38.154709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:38.155372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:38.156259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:38.192340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:38.265631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122444) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:36:38.508739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5bad5959-d2ee-4b54-b9f0-e8e3acb71771 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/action" status: 202 len: 0 microversion: 2.20 time: 0.392052 Sep 14 09:36:38.510147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2632/3308] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:36:38 2022] POST /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:36:38.523701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:38.545016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:38.550546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Searching by: {'deleted': False, 'project_id': 'a7086c1820364472b7621af92fe1ee6f'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:36:38.610856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:38.611863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:38.612771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:38.613816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:38.614481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:38.615161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:38.671523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:36:38.761594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bac27f4b-cae9-4dcc-a598-812398611dc0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.248208 Sep 14 09:36:38.775875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2633/3309] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:36:38 2022] GET /compute/v2.1/servers => generated 1003 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:39.158506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:39.163137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:39.181150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:39.181934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:39.183657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:39.184654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:39.185369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:39.187524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:40.050493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:40.058822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aad9dcf7-5dbf-4316-9fb0-517e603c8919 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 1.281679 Sep 14 09:36:40.059432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2634/3310] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:38 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:40.080015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:40.083750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:40.104605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:40.105205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:40.105864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:40.106798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:40.107477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:40.109141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:41.108486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:41.152402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:41.158025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:41.166017 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be718384-5671-4ef2-8771-d092eca1ee2d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1675 microversion: 2.20 time: 1.092797 Sep 14 09:36:41.188029 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2635/3311] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:40 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1675 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:41.196400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:41.198028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:41.207212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:41.208012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:41.208722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:41.221307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:41.229631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:41.230259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:41.474491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:41.498452 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff786c10-0830-44c9-976b-9428e0d9f746 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1215 microversion: 2.1 time: 0.309264 Sep 14 09:36:41.506111 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2636/3312] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:41 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1215 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:41.521474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:41.522463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:41.536703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:41.537365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:41.540869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:41.542879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:41.543757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:41.545372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:41.938443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:41.947553 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0cf2c55e-e9b3-4826-adbe-0430f74bf8d1 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1509 microversion: 2.1 time: 0.439801 Sep 14 09:36:41.968173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2637/3313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:41 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:42.226422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:42.228470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:42.252027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:42.255989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:42.268680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:42.272121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:42.274846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:42.275357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:42.868476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:42.883255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:42.891812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:42.900325 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e613a90e-48c0-417c-b597-c0b60447436a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.677026 Sep 14 09:36:42.901276 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2638/3314] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:42 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:42.910272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:42.920410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:42.945620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:42.952956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:42.953764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:42.954999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:42.955725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:42.956896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:43.828882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:43.854796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09f2f8d3-5853-4d62-9479-87da261c50a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1279 microversion: 2.1 time: 0.952151 Sep 14 09:36:43.856153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2639/3315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:42 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1279 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:43.862036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:43.863054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:43.878447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:43.879310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:43.880149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:43.881867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:43.883483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:43.884533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.284947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:44.293887 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3766d602-cc66-44c2-a625-f9e4bcc48488 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1486 microversion: 2.1 time: 0.436295 Sep 14 09:36:44.294508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2640/3316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:43 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1486 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:44.300308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:44.301202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:44.322707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.323781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.324502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.325431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.326081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.326706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.501826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:44.510852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:44.512703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:44.513903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc858995-55b5-4314-951a-3733f7aaa6e0 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.218203 Sep 14 09:36:44.526456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2641/3317] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:44 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:44.540394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:44.541122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:44.547579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.548336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.548986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.551083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.552938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.553587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.594205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:36:44.824902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eaaa3864-e256-492a-8f26-bc209d378709 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 204 len: 0 microversion: 2.1 time: 0.288887 Sep 14 09:36:44.828250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2642/3318] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:36:44 2022] DELETE /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:36:44.853370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:44.854111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:44.902916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.903734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.904213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:44.904946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:44.914192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:44.914591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:45.167081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:45.197865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67b85b4d-5eec-4ba8-bdf0-af4923aaf6cb tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1492 microversion: 2.1 time: 0.364889 Sep 14 09:36:45.199102 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2643/3319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:44 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1492 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:45.205183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:45.206297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:45.215739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:45.216813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:45.217481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:45.218641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:45.219785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:45.224097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:45.369077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:45.379708 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95447e2d-d2c4-4818-b08e-85b01a853859 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1277 microversion: 2.1 time: 0.179105 Sep 14 09:36:45.403387 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2644/3320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:45 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:45.546618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:45.547557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:45.565030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:45.569040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:45.569978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:45.572121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:45.575992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:45.576798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.129683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:46.143690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:46.154527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:46.187627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:46.192025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5e6e811-2309-432c-ad65-fa33d1622d5a tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.652532 Sep 14 09:36:46.211515 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2645/3321] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:45 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:46.239950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:46.240914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:46.280371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.292896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.293424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:46.296168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:46.297566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:46.299477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:47.266012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:47.282015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cefb4ca7-22f7-4e7b-b41e-f16cc3ba2ee4 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1492 microversion: 2.1 time: 1.058059 Sep 14 09:36:47.295207 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2646/3322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:46 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1492 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:47.310569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:47.315832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:47.353379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:47.355364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:47.357458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:47.360826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:47.368589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:47.370320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:47.998561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=30 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:48.412502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:48.425343 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-673b83db-b4de-4d73-8beb-1b9501856204 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1277 microversion: 2.1 time: 1.132241 Sep 14 09:36:48.431768 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2647/3323] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:47 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1277 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:48.456277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:48.464505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:48.497083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:48.498979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:48.502737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:48.503513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:48.504030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:48.504454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:48.643023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:49.611539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:49.670071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:49.685551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:49.696345 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aebc933a-696f-4157-b13e-2a806f0212f3 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 1.253793 Sep 14 09:36:49.697044 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2648/3324] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:48 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:49.741006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:49.741902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:49.801634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:49.803658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:49.805069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:49.811229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:49.815424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:49.828350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:49.965057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:49.966307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:49.966972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:49.967671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'fault' on Instance uuid 7017aec0-68bc-4327-9c94-b0272350df49 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:36:50.206556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:50.223834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1ffeb76-3e08-4a1b-b381-413230aea032 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 200 len: 1304 microversion: 2.1 time: 0.523190 Sep 14 09:36:50.224707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2649/3325] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:49 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 1304 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:50.234563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7017aec0-68bc-4327-9c94-b0272350df49", "name": "network-vif-deleted", "tag": "b9abac1d-7fda-473a-80fd-b32e86bac0f7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:50.265217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:50.265892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:50.266496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:50.280774 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] Creating event network-vif-deleted:b9abac1d-7fda-473a-80fd-b32e86bac0f7 for instance 7017aec0-68bc-4327-9c94-b0272350df49 on n-h2-851028-12 Sep 14 09:36:50.286960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-69433f0d-2ca9-4f41-9112-c1e04d71710a req-5eba0583-2039-48e0-92ec-99c8c7d8052b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060072 Sep 14 09:36:50.287839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2650/3326] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:50.297799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:50.298864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:50.307427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:50.308350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:50.309157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:50.310705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:50.311597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:50.312516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:51.256291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:51.289612 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b041967-5b64-4c66-be44-61bdb52302e5 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 0.985610 Sep 14 09:36:51.290295 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2651/3327] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:50 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:51.320322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:51.327394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:51.354927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:51.357138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:51.358391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:51.362033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:51.362727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:51.363328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.008680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:52.030793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:52.039128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:52.045450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2a6cd15-8712-4ac5-a332-a90bc01b401b tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.753127 Sep 14 09:36:52.052283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2652/3328] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:51 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:52.074702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:52.075674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:52.091745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.094291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.095882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.098938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.101558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.103761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.147785 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 HTTP/1.1 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7017aec0-68bc-4327-9c94-b0272350df49'} Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:36:52.149986 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:36:52.155045 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:36:52.156708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:36:52.167953 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2cf96bc4-a3c7-4a42-b0bf-44092640117a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 404 len: 111 microversion: 2.1 time: 0.113744 Sep 14 09:36:52.175354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2653/3329] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:52 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:36:52.322815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:52.324286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:52.351072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.358623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.360466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:52.364569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:52.368249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:52.370340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:53.153740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:53.181293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79bd9dc9-c33d-40e2-8382-16ed6bc9f5d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 0.864981 Sep 14 09:36:53.182751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2654/3330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:52 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:36:53.202311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-88269296", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "919ef16e-d8b7-4e18-a5b5-35fffaf00f82"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:53.331941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] validate_networks() for [('919ef16e-d8b7-4e18-a5b5-35fffaf00f82', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:36:56.730776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:36:56.730776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:36:56.731420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:36:56.732210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:36:56.732919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:36:56.780378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:56.784661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:56.786090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:56.793749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:56.797301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:56.798444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:56.905429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:36:56.962582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:36:56.998989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Getting quotas for user c69251d16928471d9b63bbca256b959d and project c90e7508f17d403d9b6b942934de76cb. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:36:57.080195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:36:57.087886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:36:57.334351 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c956970f-5da1-4894-9944-635c9094639d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.148052 Sep 14 09:36:57.359181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2655/3331] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:36:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:36:57.396681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:57.398069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:57.460639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:57.481667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:57.488431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:57.489853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:57.499396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:57.500006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:58.605764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:58.633593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:58.661592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:36:58.661592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d50428b2-9a3d-48c8-b0ac-e6ede9382158 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 1.280092 Sep 14 09:36:58.661592 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2656/3332] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:36:57 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:36:58.688322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fcb6bd-24d9-4974-b1aa-5f2158dff3d0", "tag": "386e4bfb-9009-422b-8910-98628102b250"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:36:58.756284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:58.767806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:58.770853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:58.829084 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] Creating event network-changed:386e4bfb-9009-422b-8910-98628102b250 for instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 on n-h2-851028-12 Sep 14 09:36:58.852336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7fb2cf2f-5f76-4632-ba37-bd001dcba8f1 req-451988ab-1049-4373-a236-bf196e2519b6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177321 Sep 14 09:36:58.859573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2657/3333] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:36:58.884196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:36:58.896511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:36:58.930670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:58.948745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:58.955434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:36:58.962498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:36:58.962995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:36:58.963435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:00.937527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:00.954200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-765837c0-70a1-4d6b-9fb2-77b41b1c0abe tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 2.088956 Sep 14 09:37:00.976691 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2658/3334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:36:58 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 2112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:01.750845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1449243000", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "202caebc-1780-4b9d-abc4-93d9b2ffb6f8"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:01.997540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] validate_networks() for [('202caebc-1780-4b9d-abc4-93d9b2ffb6f8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:37:04.647994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:04.647994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:04.647994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:04.647994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:04.647994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:04.763033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:04.862536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Getting quotas for project 17c220a3876d4271a4e896b6ad2d2d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:04.884165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Getting quotas for user 5e21b6b9b9384f0b8929564c3002ec1f and project 17c220a3876d4271a4e896b6ad2d2d3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:04.929862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Going to run 3 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:04.939082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:05.053708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=77ddcb5f-96a5-4a6e-8311-005c020be767,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:05.141145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=2208a39f-620f-48e4-bf2a-2b67f18bc1f4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:05.327432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-465fc9c8-99e7-44f8-9c0e-b84023682c56 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.334322 Sep 14 09:37:05.338087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2659/3335] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:37:05.348552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:05.349691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:05.359465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.360529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.361490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:05.363081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.364373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.365330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:05.755703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:05.773559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4147fab-68d3-473a-8607-9a389774d7a0 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1313 microversion: 2.1 time: 0.426775 Sep 14 09:37:05.777164 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2660/3336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:05 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:05.792676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:05.795292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:05.808285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.810834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.811507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:05.812584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:05.813627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:05.814686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:06.159310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:06.189617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:06.198257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:06.204164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35a39709-b888-4e64-9479-68756fb2d4f7 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.419725 Sep 14 09:37:06.206183 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2661/3337] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:05 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:06.545471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "207df2b2-3d56-49c0-bda0-f915a8eedec0", "tag": "33011866-9776-49c5-bc2a-4739801bbb26"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:06.576081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:06.576576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:06.577013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:06.612266 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] Creating event network-changed:33011866-9776-49c5-bc2a-4739801bbb26 for instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 on n-h2-851028-12 Sep 14 09:37:06.626128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0ea6dfcf-fe44-4b34-a9d1-e67af5db774b req-6a5c4ef9-5c73-46c5-a3fd-ed009cfe6cd7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415370 Sep 14 09:37:06.626811 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2662/3338] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:06.641963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:06.643558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:06.662465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:06.664599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:06.665244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:06.667088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:06.668452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:06.670792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:07.037144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:07.052588 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-205e1327-5343-4773-898c-4defb1aacf6e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 0.422006 Sep 14 09:37:07.055153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2663/3339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:06 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:07.599643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-505470510", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "ce03bc09-0be0-4fe8-9f00-ab8291bc7cd2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:07.736634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] validate_networks() for [('ce03bc09-0be0-4fe8-9f00-ab8291bc7cd2', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:37:08.802344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:08.802829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:08.805156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:08.815249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:08.815855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:08.884759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:08.885271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:08.891425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:08.896814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:08.897623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:08.899716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:09.026332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Getting quotas for project 490e7e72894e40fc856e0741387eff09. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:09.059172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Getting quotas for user 2fe341d5635e47bdbb3c8bed79ead871 and project 490e7e72894e40fc856e0741387eff09. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:09.104052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:09.113610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:09.295037 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89e15b25-4434-4d8b-bba4-67ce5470a57c tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237557 Sep 14 09:37:09.298740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2664/3340] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:37:09.319086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:09.339940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:09.345469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:09.384039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:09.384802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:09.385337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:09.386359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:09.389056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:09.389590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:09.460957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:09.581506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c83b808-75ba-4114-b645-5a05c490ce23 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.273603 Sep 14 09:37:09.590955 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2665/3341] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:37:09 2022] GET /compute/v2.1/servers => generated 1018 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:10.029423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fcb6bd-24d9-4974-b1aa-5f2158dff3d0", "name": "network-vif-plugged", "status": "completed", "tag": "386e4bfb-9009-422b-8910-98628102b250"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:10.052133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:10.061925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:10.073223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:10.118487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] Creating event network-vif-plugged:386e4bfb-9009-422b-8910-98628102b250 for instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 on n-h2-851028-12 Sep 14 09:37:10.134079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4a0fde67-7e48-4a0e-93e9-30bfad13ebce req-fb8f85b7-1383-4b97-9776-ae478c30ce01 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.541708 Sep 14 09:37:10.135392 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2666/3342] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:10.165293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:10.166358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:10.173781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:10.174300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:10.174745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:10.175479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:10.192057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:10.193153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:10.197685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:10.934390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:10.949594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58234e06-8b4f-412b-8b23-c263a5888e10 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1313 microversion: 2.1 time: 0.811614 Sep 14 09:37:10.972324 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2667/3343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:10 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1313 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:10.978360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:10.993000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:11.000065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:11.000633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:11.003704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:11.004618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:11.007554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:11.009857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:11.372756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:11.383026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:11.387788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:11.393679 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7feaec3-af3e-47ec-8024-e43f1e3dca9c tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.420078 Sep 14 09:37:11.395924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2668/3344] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:10 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:11.423746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:11.428826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:11.451101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:11.460434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:11.461977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:11.466474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:11.467316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:11.468562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:11.870668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:11.879501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e164572-42f8-4c5e-8411-591d30c33f6f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 0.482223 Sep 14 09:37:11.880696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2669/3345] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:11 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:11.886215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f86279-cb35-4576-985b-115878717474", "tag": "4cc6cfc2-d928-41df-9c2b-17fff7f98be6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:11.899025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:11.899723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:11.900334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:11.923557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] Creating event network-changed:4cc6cfc2-d928-41df-9c2b-17fff7f98be6 for instance 38f86279-cb35-4576-985b-115878717474 on n-h1-851028-12 Sep 14 09:37:11.932515 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-85f0e64c-3afa-447b-ac1b-41b3e8863030 req-2854060b-6024-4a87-a5b8-a3178d327020 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050237 Sep 14 09:37:11.939870 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2670/3346] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:11.975089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:11.983593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:12.007965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.010956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.012202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:12.013196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.014098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.014720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:12.212800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:12.229163 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79ea1179-2692-4dd3-89e3-e53ecdd8cfe0 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1276 microversion: 2.1 time: 0.263926 Sep 14 09:37:12.230415 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2671/3347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:11 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:12.236922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:12.239521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:12.268878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.274035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.276529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:12.281020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.282905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.286166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:12.874131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:12.886215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1dc53e1-d536-4172-baa0-9dcb2b320184 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.654528 Sep 14 09:37:12.888051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2672/3348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:12 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:12.922706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:12.923294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:12.936839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.937620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.938301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:12.939524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:12.940490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:12.941148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:13.753787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:13.764417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4498d76d-3897-4c83-889c-0b466465a00f tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1313 microversion: 2.1 time: 0.874977 Sep 14 09:37:13.771005 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2673/3349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:12 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1313 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:13.776774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207df2b2-3d56-49c0-bda0-f915a8eedec0", "name": "network-vif-plugged", "status": "completed", "tag": "33011866-9776-49c5-bc2a-4739801bbb26"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:13.798751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:13.803857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:13.804710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:13.819844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] Creating event network-vif-plugged:33011866-9776-49c5-bc2a-4739801bbb26 for instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 on n-h2-851028-12 Sep 14 09:37:13.826536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a87b97b5-2b82-431c-b700-08c12b1260b9 req-7e71a185-50de-4995-a942-beaa7055959b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054106 Sep 14 09:37:13.827684 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2674/3350] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:13.833961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:13.835057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:13.843518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:13.844618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:13.845216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:13.846136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:13.846794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:13.847371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:14.441431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:14.455565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:14.461439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:14.463432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ced78a64-4eb6-487a-97f1-beffbbf56a03 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.634372 Sep 14 09:37:14.467081 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2675/3351] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:13 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:14.499188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:14.500248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:14.523017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:14.532741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:14.533378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:14.534314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:14.538419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:14.548394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:15.047978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:15.058226 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-144ba86a-09fc-4779-95d1-2e2c8d98fedf tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1319 microversion: 2.1 time: 0.589537 Sep 14 09:37:15.059522 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2676/3352] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:14 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:15.064599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:15.065447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:15.077855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:15.078372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:15.078851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:15.079876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:15.080369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:15.080793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:15.607805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:15.629123 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0e730af-154d-4bf6-ae74-f4b6ce301f20 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.566520 Sep 14 09:37:15.637197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2677/3353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:15 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:15.664576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:15.666579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:15.677405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:15.684192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:15.686279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:15.688361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:15.689364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:15.690236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.143001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:16.154552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b810096c-4fd4-4b18-932f-e69e9863c7b2 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.515757 Sep 14 09:37:16.155575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2678/3354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:15 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:16.161098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2208a39f-620f-48e4-bf2a-2b67f18bc1f4", "tag": "3d063c9d-e638-4a7a-b846-8b66a5cf3a5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:16.171768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.172553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.173605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.196339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] Creating event network-changed:3d063c9d-e638-4a7a-b846-8b66a5cf3a5e for instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 on n-h2-851028-12 Sep 14 09:37:16.203409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-06e4387b-9d01-44aa-8ccf-d8d78bfcffe2 req-c0b556eb-08e8-42b9-8a6b-d978d39c1495 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046123 Sep 14 09:37:16.204143 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2679/3355] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:16.212774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:16.214086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:16.221358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.222211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.222333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.223042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.223499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.223955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.575862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:16.602947 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-834c141c-79f9-4ec0-b8f1-a9444910f978 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1313 microversion: 2.1 time: 0.396235 Sep 14 09:37:16.625192 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2680/3356] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:16 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:16.638952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77ddcb5f-96a5-4a6e-8311-005c020be767", "tag": "9994242a-4194-4e57-90aa-acd978970dfd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:16.655284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.655766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.656227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.683080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] Creating event network-changed:9994242a-4194-4e57-90aa-acd978970dfd for instance 77ddcb5f-96a5-4a6e-8311-005c020be767 on n-h1-851028-12 Sep 14 09:37:16.689897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c3b96aec-dc18-44bf-9e03-aced5f739f0e req-f08b6a7b-190b-41f6-b268-009e143c73a3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062091 Sep 14 09:37:16.691219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2681/3357] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:16.715588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:16.717327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:16.731664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:16.735152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.735152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.735641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.736725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.739944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.743089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:16.961335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:16.972828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:16.974717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:16.977088 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf8df05b-6ada-4f66-a91b-84386d3d4388 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.274193 Sep 14 09:37:16.978277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2682/3358] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:16 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:16.983431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-plugged", "status": "completed", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}, {"server_uuid": "38f86279-cb35-4576-985b-115878717474", "name": "network-vif-plugged", "status": "completed", "tag": "4cc6cfc2-d928-41df-9c2b-17fff7f98be6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:16.996244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:16.997043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:16.997777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.026264 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Creating event network-vif-plugged:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:37:17.026770 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] Creating event network-vif-plugged:4cc6cfc2-d928-41df-9c2b-17fff7f98be6 for instance 38f86279-cb35-4576-985b-115878717474 on n-h1-851028-12 Sep 14 09:37:17.038398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f6ab2770-f0fa-4023-a186-9562d27cf560 req-4b0668d8-3dc7-438b-894d-90b56bc5747f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057964 Sep 14 09:37:17.039591 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2683/3359] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:17.047569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:17.048893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:17.058075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.060484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.061629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.062811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.063460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.064315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.268962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:17.279740 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33ad9e76-ef6c-4793-a7b2-695fca91cc75 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1469 microversion: 2.1 time: 0.238187 Sep 14 09:37:17.280984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2684/3360] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:17 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1469 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:17.285992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:17.286616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:17.295089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.295600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.296151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.297064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.297871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.298640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.786400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:17.797655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a337878-6a2a-40e9-ac6c-847f76b8086f tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.515354 Sep 14 09:37:17.798259 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2685/3361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:17 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:17.803108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:17.804056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:17.810089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.810655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.811165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.811961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:17.812488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:17.812991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:17.984359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:17.993435 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a5e6662-d61e-4e99-a8b0-40c63444bb8b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.193898 Sep 14 09:37:17.994057 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2686/3362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:17 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:17.999661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:18.000812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:18.009678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.010700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.011356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.012362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.012941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.013941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.018045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:18.164035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.174688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e66d8f90-1469-482a-a34f-06264e04a592 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1469 microversion: 2.1 time: 0.179107 Sep 14 09:37:18.175172 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2687/3363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:17 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:18.182035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:18.182767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:18.189567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.190066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.190502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.191214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.191669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.192159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.339410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.347284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3776962c-590d-46ec-a621-4b98993decd3 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1313 microversion: 2.1 time: 0.170554 Sep 14 09:37:18.347879 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2688/3364] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:18 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:18.353640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:18.354781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:18.360921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.361399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.361839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.362544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.363006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.363424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.517952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.527345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.529077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.530419 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-76f45334-221b-4067-883e-f6f55125f9d5 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.181586 Sep 14 09:37:18.531493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2689/3365] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:18 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:18.535683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:18.541455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.542833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Searching by: {'reservation_id': 'r-rggzb4tz', 'deleted': False, 'project_id': 'a7086c1820364472b7621af92fe1ee6f'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:18.552590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.553075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.554273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.555182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.555607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.556092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.659592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:18.725841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=19 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:18.732983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:18.740099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.740571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.741539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.866777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f67aa2a4-c2dc-4826-a519-2f86f068e7d8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?reservation_id=r-rggzb4tz" status: 200 len: 2931 microversion: 2.1 time: 0.333843 Sep 14 09:37:18.867517 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2690/3366] 10.222.0.90 () {58 vars in 1197 bytes} [Wed Sep 14 09:37:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-rggzb4tz => generated 2931 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:18.872214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898c0caf-9c1c-42ae-9b64-fad2893bb330", "tag": "f19bae99-8bfb-49bc-abca-5b1f546389ba"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:18.882931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.883497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.884081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.895690 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] Creating event network-changed:f19bae99-8bfb-49bc-abca-5b1f546389ba for instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 on n-h2-851028-12 Sep 14 09:37:18.901133 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-560dbb22-80aa-4f0a-85dc-b162c25137f5 req-46316402-beb3-46de-a0e0-ad34898ac6be service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032296 Sep 14 09:37:18.901941 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2691/3367] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:18.906569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe637aab-a485-469d-92ea-04dc745afb61", "tag": "c23a09e7-ebd6-4c97-98d4-0845f16ff0ff"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:18.916654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.917126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.917550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.929639 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] Creating event network-changed:c23a09e7-ebd6-4c97-98d4-0845f16ff0ff for instance fe637aab-a485-469d-92ea-04dc745afb61 on n-h1-851028-12 Sep 14 09:37:18.934560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7e2d2fd4-1342-49c4-8a45-94444483e4fa req-29ebc281-c701-4d39-9d04-6abdc24e1c4c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031572 Sep 14 09:37:18.935347 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2692/3368] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:18.940302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:18.941008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:18.948487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.948980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.949420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:18.950122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:18.950583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:18.951015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:19.272075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:19.286036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31d3c77e-acd4-4770-8f95-f02f93322b78 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.349143 Sep 14 09:37:19.286378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2693/3369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:18 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:19.306603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:19.341078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_groups [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Querying cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) for 2 instances {{(pid=122444) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 09:37:19.343236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:19.343995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:19.344900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:19.374673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11a295fa-9081-4811-b936-8e5d33609462 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups/cd7a3b94-0a9f-445b-a884-28d912991ead" status: 200 len: 266 microversion: 2.1 time: 0.087215 Sep 14 09:37:19.376382 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2694/3370] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:37:19 2022] GET /compute/v2.1/os-server-groups/cd7a3b94-0a9f-445b-a884-28d912991ead => generated 266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:19.384441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:19.385859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:19.392886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:19.394623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:19.395312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:19.398964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:19.399934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:19.400593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:19.743710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:19.769129 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-289c03c7-df62-40ff-b297-b79f0e035868 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.387884 Sep 14 09:37:19.770310 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2695/3371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:19 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:19.781475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:19.782367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:19.790242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:19.791137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:19.791803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:19.792848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:19.793526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:19.794173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.522382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:20.533648 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2b9db21-4027-4ce6-bdfb-c895288ed7ce tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1499 microversion: 2.1 time: 0.761538 Sep 14 09:37:20.534902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2696/3372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:19 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1499 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:20.543370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:20.544267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:20.551245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.551722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.552361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.554207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.554771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.555550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.711555 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-888925ab-e87a-4d42-bf66-d45034195d97 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 200 len: 1622 microversion: 2.1 time: 0.174739 Sep 14 09:37:20.712504 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2697/3373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:20 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 1622 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:20.717923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:20.718954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:20.726398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.727291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.727918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.728813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.729430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.730040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.885336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:20.895164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:20.896975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:20.898757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-363d2ec5-b34d-46fd-b6cc-93f337d4d4de tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1731 microversion: 2.20 time: 0.185059 Sep 14 09:37:20.899363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2698/3374] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:20 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:20.915468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:20.916118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:20.923379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.923955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.924405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:20.925118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:20.925766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:20.926365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.069614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:21.078034 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d9f677c-7252-4ed3-9f0d-a57cb35464df tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.169000 Sep 14 09:37:21.087935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2699/3375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:20 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:21.087935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:21.095260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:21.097913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.098435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.098869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.099568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.100088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.101455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.128494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'flavor' on Instance uuid 38f86279-cb35-4576-985b-115878717474 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:37:21.211716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4757357c-a699-4488-9fec-2a22bce9fedc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "POST /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474/action" status: 202 len: 0 microversion: 2.1 time: 0.129723 Sep 14 09:37:21.212680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2700/3376] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:37:21 2022] POST /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:37:21.219412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:21.221088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:21.231224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.232076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.232693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.233658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.234312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.234939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.415124 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d367f7f-02ac-4015-9964-cec862aa1fb1 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1622 microversion: 2.1 time: 0.200981 Sep 14 09:37:21.415732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2701/3377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:21 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1622 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:21.430663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:21.431471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:21.439290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.439845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.440316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.441070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.441530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.441977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.594940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:21.604754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b665f91d-de52-4771-b27a-3772eb04be90 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.177971 Sep 14 09:37:21.605345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2702/3378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:21 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:21.610352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:21.611221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:21.619458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.620171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.620860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.621894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.622326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.622961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.627455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:21.777039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:21.784872 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1bfbc17-944c-46ef-9f8d-d9acb835f093 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1507 microversion: 2.1 time: 0.178069 Sep 14 09:37:21.785732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2703/3379] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:21 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:21.806411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ddcb5f-96a5-4a6e-8311-005c020be767", "name": "network-vif-plugged", "status": "completed", "tag": "9994242a-4194-4e57-90aa-acd978970dfd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:21.816603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.817355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.817952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.831187 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] Creating event network-vif-plugged:9994242a-4194-4e57-90aa-acd978970dfd for instance 77ddcb5f-96a5-4a6e-8311-005c020be767 on n-h1-851028-12 Sep 14 09:37:21.837929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-888e7b16-84ae-4148-be83-74bd83e61bec req-159ed272-cecd-4176-b8cc-ca0df4656caf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035238 Sep 14 09:37:21.838846 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2704/3380] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:21.844652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: .version_select at 0x7f693e103f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-164822670", "policies": ["anti-affinity"]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:21.866627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:21.872219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:21.920928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:21.927173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_groups'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:21.943999 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10807ce3-a0be-4836-ae9a-0f869eddaf19 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.103474 Sep 14 09:37:21.944895 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2705/3381] 10.222.0.90 () {60 vars in 1174 bytes} [Wed Sep 14 09:37:21 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:21.950029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:21.950675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:21.961675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.962390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.963020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:21.964116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:21.964781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:21.965449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:22.134400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:22.142678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:22.144202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:22.145377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bf8c5a37-bf86-4a77-b050-cd0abdaafc7e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1718 microversion: 2.20 time: 0.199529 Sep 14 09:37:22.145952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2706/3382] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:21 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:22.151022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-928988494", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "43d4618d-f01f-45e3-948a-362c9ba5b4fa"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:22.216828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:37:22.470289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:22.470719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:22.471212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:22.471631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:22.472180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:22.487749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:22.488277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:22.488723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:22.489462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:22.489921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:22.490349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:22.497903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=11 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:22.510943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:22.516462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:22.529499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 2 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:22.531854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:22.586944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:22.594451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:22.601102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:22.648397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:22.655076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:22.674842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=4e8701ba-a845-4561-bc3f-35ef1a1a1fb2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:22.735449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:22.740552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:22.778938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:22.784663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'server_group_members'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:22.832679 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e541a2db-9de1-4c82-a991-6d4fd126e3d9 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.685678 Sep 14 09:37:22.836622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2707/3383] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:37:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 14 09:37:22.838505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:22.838971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:22.845206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:22.845700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:22.846139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:22.846839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:22.847295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:22.847720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:22.989998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:22.998773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9cd6da8-5cfc-42ab-a9e4-8c693789426b tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.164467 Sep 14 09:37:22.999377 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2708/3384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:22 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.004107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.004840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:23.010820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.011309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.011755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.012588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.012998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.013430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.208050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:23.217999 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aefd7620-8e3b-4999-b713-929c62673421 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.217397 Sep 14 09:37:23.218843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2709/3385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:22 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.227162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.227930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:23.236575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.237075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.237517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.238224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.238682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.239117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.394094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:23.403341 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-efb8c044-80ca-445a-967a-db5ee219399b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1490 microversion: 2.1 time: 0.182504 Sep 14 09:37:23.408330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2710/3386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:23 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1490 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.413208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.418880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:23.419765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Searching by: {'deleted': False, 'project_id': 'a7086c1820364472b7621af92fe1ee6f'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:23.437269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.437745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.438184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.438910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.439509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.439962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.470552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:23.499587 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-585fd1c0-bee9-45bd-9387-47ce22396049 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.090045 Sep 14 09:37:23.500219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2711/3387] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:37:23 2022] GET /compute/v2.1/servers => generated 1663 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.504918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.505418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:23.514060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.514551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.515052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.515688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.516319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.516746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.543665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:23.632605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1528a505-af06-4243-ae49-0b2038bae7dd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 204 len: 0 microversion: 2.1 time: 0.131088 Sep 14 09:37:23.633297 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2712/3388] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:23 2022] DELETE /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:23.639137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.639850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:23.646364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.646812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.647371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.648147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.648605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.649028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.716668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:23.724987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6344886-87aa-4a6d-b349-2cb6e6fa7be7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1222 microversion: 2.1 time: 0.090253 Sep 14 09:37:23.726125 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2713/3389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:23 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.730800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:23.731446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:23.737868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.738401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.738861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.739636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.740133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.740560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.888376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:23.904874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18bac974-4ac0-40dc-8c81-f030272c6bfd tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1496 microversion: 2.1 time: 0.177519 Sep 14 09:37:23.906017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2714/3390] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:23 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1496 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:23.910725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2208a39f-620f-48e4-bf2a-2b67f18bc1f4", "name": "network-vif-plugged", "status": "completed", "tag": "3d063c9d-e638-4a7a-b846-8b66a5cf3a5e"}, {"server_uuid": "fe637aab-a485-469d-92ea-04dc745afb61", "name": "network-vif-plugged", "status": "completed", "tag": "c23a09e7-ebd6-4c97-98d4-0845f16ff0ff"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:23.922081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:23.922762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:23.923366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:23.937757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Creating event network-vif-plugged:3d063c9d-e638-4a7a-b846-8b66a5cf3a5e for instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 on n-h2-851028-12 Sep 14 09:37:23.938695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] Creating event network-vif-plugged:c23a09e7-ebd6-4c97-98d4-0845f16ff0ff for instance fe637aab-a485-469d-92ea-04dc745afb61 on n-h1-851028-12 Sep 14 09:37:23.950025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0fcfa351-3b12-4362-b735-38ad5beaad5f req-b5c7e1e7-c626-4be6-9957-35f40e5eba3e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042415 Sep 14 09:37:23.950734 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2715/3391] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:24.025581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:24.026794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:24.038623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.039313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.040057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.041018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.041793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.042496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.219621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:24.228230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73171e3e-7ef2-4a5b-aee5-797580f9bd25 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.209963 Sep 14 09:37:24.230087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2716/3392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:24 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:24.243243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:24.243991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:24.250874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.251281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.251711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.252443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.252896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.253703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.396899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:24.405605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a85b309-916d-49d2-a8bd-95d8be257801 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.166754 Sep 14 09:37:24.406204 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2717/3393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:24 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:24.749722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:24.750366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:24.757194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.757668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.758203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.758924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.759441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.760224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.848922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:24.861634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d1d7912-1114-4c84-9429-953623a4f046 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1278 microversion: 2.1 time: 0.115327 Sep 14 09:37:24.862415 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2718/3394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:24 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:24.932990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:24.933956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:24.941749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.942236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.942684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:24.943427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:24.943877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:24.944832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.277206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:25.286709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82329096-9210-4a3e-a107-8be82ecb1688 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1496 microversion: 2.1 time: 0.358134 Sep 14 09:37:25.290205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2719/3395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:24 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1496 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:25.296179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:25.296797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:25.305647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.306145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.306580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.307284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.307738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.308242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.512558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:25.515415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:25.523849 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d06d8ee-1e58-479a-accf-6ebde7b41358 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.232593 Sep 14 09:37:25.524493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2720/3396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:25 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:25.529179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:25.529784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:25.536652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.537260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.537845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.538998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.539506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.540085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.732847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:25.744471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-906cec84-6715-407b-9edd-11e18344311e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1323 microversion: 2.1 time: 0.218877 Sep 14 09:37:25.745269 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2721/3397] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:25 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:25.868920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f86279-cb35-4576-985b-115878717474", "name": "network-vif-deleted", "tag": "4cc6cfc2-d928-41df-9c2b-17fff7f98be6"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:25.889935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.893491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.894442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.917324 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] Creating event network-vif-deleted:4cc6cfc2-d928-41df-9c2b-17fff7f98be6 for instance 38f86279-cb35-4576-985b-115878717474 on n-h1-851028-12 Sep 14 09:37:25.934295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e4675de7-19e3-49c6-a659-3b733272228c req-1f9ddb6b-9bbb-4d9f-8cc1-9a431c4573ed service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071157 Sep 14 09:37:25.934922 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2722/3398] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:25.954701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:25.965210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:25.981553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.982273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.985560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:25.987077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:25.987730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:25.988330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.326340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:26.342144 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bdb81ed9-0d1b-45c7-917a-94fca0be8011 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.392131 Sep 14 09:37:26.342959 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2723/3399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:25 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:26.349341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898c0caf-9c1c-42ae-9b64-fad2893bb330", "name": "network-vif-plugged", "status": "completed", "tag": "f19bae99-8bfb-49bc-abca-5b1f546389ba"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:26.386230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.386723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.387155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.419217 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] Creating event network-vif-plugged:f19bae99-8bfb-49bc-abca-5b1f546389ba for instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 on n-h2-851028-12 Sep 14 09:37:26.432824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1e52add6-ec33-44bb-b961-734003a15cf5 req-636a3820-d3eb-4c6b-bf5b-8dc2d5050e1a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088603 Sep 14 09:37:26.435450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2724/3400] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:26.446501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:26.447638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:26.504130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.504624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.505060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.505763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.506216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.506677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.597516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.599374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.599935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.602300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lazy-loading 'fault' on Instance uuid 38f86279-cb35-4576-985b-115878717474 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:37:26.718325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69251d16928471d9b63bbca256b959d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90e7508f17d403d9b6b942934de76cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:26.739554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10245cc0-662e-402b-ab59-986b36911c88 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 200 len: 1303 microversion: 2.1 time: 0.302198 Sep 14 09:37:26.740440 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2725/3401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:26 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:26.752185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:26.752903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:26.767734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.768631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.776734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:26.777553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:26.778048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:26.778491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.153326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:27.180879 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-369ce29e-557e-4591-b57e-3dfe3c21b453 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1324 microversion: 2.1 time: 0.439483 Sep 14 09:37:27.181401 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2726/3402] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:26 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:27.200059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:27.201018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:27.207765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.208499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.209108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.210066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.210831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.211454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.422150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:27.431595 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6950a711-f84c-4112-a2ea-0b32afa767b8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 200 len: 1516 microversion: 2.1 time: 0.244866 Sep 14 09:37:27.432410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2727/3403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:27 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:27.436658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b6512b-6ee7-46ec-924d-c728108e92b6", "tag": "aacaf614-227d-455a-892c-46431faa8b9e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:27.451979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.452767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.453535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.466680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] Creating event network-changed:aacaf614-227d-455a-892c-46431faa8b9e for instance c1b6512b-6ee7-46ec-924d-c728108e92b6 on n-h2-851028-12 Sep 14 09:37:27.471488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7eeace52-af95-4f59-a293-3c0e534d2163 req-f867f847-71ae-4a8a-b4a8-a03261c722a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038152 Sep 14 09:37:27.472384 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2728/3404] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:27.479097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:27.479810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:27.486404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.486903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.487456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.488259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.488719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.489554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.725602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:27.742679 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5a44c89-097e-4154-9a05-846b38139e6d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.268649 Sep 14 09:37:27.761628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2729/3405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:27 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:27.766383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:27.767005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:27.769145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:27.775862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.776707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.777158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:27.778203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:27.778974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:27.779202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.020422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:28.033580 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3bf06c49-d190-4f7c-b04a-92e168816afe tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 200 len: 1515 microversion: 2.1 time: 0.270643 Sep 14 09:37:28.035568 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2730/3406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:27 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 1515 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:28.043440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:28.044379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:28.051307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.052573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.053759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.055735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.057499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.058346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.097519 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 HTTP/1.1 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38f86279-cb35-4576-985b-115878717474'} Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:28.100723 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.104561 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.106934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:28.108332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75f47947-4513-4d88-8b02-cff0c142ae4d tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 404 len: 111 microversion: 2.1 time: 0.071279 Sep 14 09:37:28.109447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2731/3407] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:28 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:28.114752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:28.117702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:28.125600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.127320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.129480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.132065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.133773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.134279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.517847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:28.534205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80f5ccb7-0acd-42ce-86a9-a9d7fc45e86b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 200 len: 1515 microversion: 2.1 time: 0.423265 Sep 14 09:37:28.556064 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2732/3408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:28 2022] GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 1515 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:28.561225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:28.561826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:28.568674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.570250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.570608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.575242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.575836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.576394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.592585 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 HTTP/1.1 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38f86279-cb35-4576-985b-115878717474'} Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:28.594287 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2339a9ee-ab4c-48b2-933c-a987768ca9cc tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 404 len: 111 microversion: 2.1 time: 0.038587 Sep 14 09:37:28.601517 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2733/3409] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:28 2022] DELETE /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:28.605421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:28.606050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:28.612518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.613016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.613443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.614166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.614682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.615111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.839405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:28.848645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-71c6c601-41c5-42b5-933d-7c85c4bbd97d tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1519 microversion: 2.1 time: 0.247338 Sep 14 09:37:28.859922 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2734/3410] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:28 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:28.859922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:28.859922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:28.863746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.864286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.864727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.865430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:28.866489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:28.867553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:28.917893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:29.024838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b552da19-055f-432a-a856-3cd8eac4b3f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "DELETE /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 204 len: 0 microversion: 2.1 time: 0.173863 Sep 14 09:37:29.025786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2735/3411] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:28 2022] DELETE /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:29.032565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.033515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 38f86279-cb35-4576-985b-115878717474] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.042102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.042431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.042875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.043729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.044237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.044862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.063334 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 HTTP/1.1 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '38f86279-cb35-4576-985b-115878717474'} Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.065552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. Sep 14 09:37:29.070178 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.072003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 38f86279-cb35-4576-985b-115878717474 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.073052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4039721f-24c5-49b7-8173-ad1295891826 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474" status: 404 len: 111 microversion: 2.1 time: 0.046132 Sep 14 09:37:29.076466 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2736/3412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/38f86279-cb35-4576-985b-115878717474 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:29.078987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.079671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.086540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.087042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.087544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.088373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.088834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.089271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.307949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:29.321197 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-301d36cc-d8ae-49d4-8959-2edaf7cccc99 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.245860 Sep 14 09:37:29.322065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2737/3413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:29.327677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.328259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.336356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.337019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.337466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.338180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.338642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.339067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.376227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] HTTP exception thrown: Action 999 not found Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Request method failure captured: Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330/os-instance-actions/999 HTTP/1.1 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaDAWquYpAUtFaDam76deT-yfT_YZR9t-wWkTCnI9C9ZPYcUg1RCGnzg45x-6BYUSzSDH5Z02pyReorCIi61mC8jLwsBNjpU4rnMXQ7mhFGiyOa0OlxGvmP0dkgoNF4-xIzAm_F3UGAYhu7029USU00x6u0TLNk4g92Isn3VUK9oC54 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_490e7e72894e40fc856e0741387eff09", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/490e7e72894e40fc856e0741387eff09"}]}] Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 2fe341d5635e47bdbb3c8bed79ead871 Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: exception: Action 999 not found Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '898c0caf-9c1c-42ae-9b64-fad2893bb330', 'id': '999'} Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 14 09:37:29.384669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.387799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Returning 404 to user: Action 999 not found {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.387799 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03f97fb8-333f-4db9-b999-68a7463ebe44 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.062984 Sep 14 09:37:29.387799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2738/3414] 10.222.0.90 () {58 vars in 1308 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330/os-instance-actions/999 => generated 66 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:37:29.391703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.392530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.399670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.400201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.400645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.401342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.401794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.402218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.418643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:29.542470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:29.550532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2531abc1-e136-4933-b885-7baef234d23d tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 200 len: 1521 microversion: 2.1 time: 0.162856 Sep 14 09:37:29.551105 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2739/3415] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:29.556171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.556672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.562542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.563032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.563471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.564205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.564662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.565089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.579703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 HTTP/1.1 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7017aec0-68bc-4327-9c94-b0272350df49'} Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:29.581420 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d9c660d-caf8-464d-a807-ab70ba04bfb6 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 404 len: 111 microversion: 2.1 time: 0.030791 Sep 14 09:37:29.586994 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2740/3416] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:29 2022] DELETE /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:29.591641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8701ba-a845-4561-bc3f-35ef1a1a1fb2", "tag": "07349cec-6074-4fe7-9abc-1b2ccc21e64b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:29.601072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.601544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.601976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.613058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] Creating event network-changed:07349cec-6074-4fe7-9abc-1b2ccc21e64b for instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 on n-h1-851028-12 Sep 14 09:37:29.618906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-455ade24-ab48-4d9b-8c75-78f82bd0a29f req-46b2a95c-60cb-4b20-8f01-7248a2998f2a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030640 Sep 14 09:37:29.619501 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2741/3417] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:29.624671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '.version_select at 0x7f693dffc310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.625312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: ec2a614b-f45a-4900-91ba-41bc1882e6a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.630834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] HTTP exception thrown: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Request method failure captured: Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ec2a614b-f45a-4900-91ba-41bc1882e6a7/os-instance-actions HTTP/1.1 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaDAWquYpAUtFaDam76deT-yfT_YZR9t-wWkTCnI9C9ZPYcUg1RCGnzg45x-6BYUSzSDH5Z02pyReorCIi61mC8jLwsBNjpU4rnMXQ7mhFGiyOa0OlxGvmP0dkgoNF4-xIzAm_F3UGAYhu7029USU00x6u0TLNk4g92Isn3VUK9oC54 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_490e7e72894e40fc856e0741387eff09", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/490e7e72894e40fc856e0741387eff09"}]}] Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 2fe341d5635e47bdbb3c8bed79ead871 Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': 'ec2a614b-f45a-4900-91ba-41bc1882e6a7'} Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:29.633151 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Returning 404 to user: Instance ec2a614b-f45a-4900-91ba-41bc1882e6a7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f013a8c7-e104-4337-99da-eccc0330292e tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/ec2a614b-f45a-4900-91ba-41bc1882e6a7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013917 Sep 14 09:37:29.638609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2742/3418] 10.222.0.90 () {58 vars in 1296 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/ec2a614b-f45a-4900-91ba-41bc1882e6a7/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:29.640756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.640756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 7017aec0-68bc-4327-9c94-b0272350df49] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.649255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.649749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.650189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.650896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.651359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.651787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.666234 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 HTTP/1.1 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7017aec0-68bc-4327-9c94-b0272350df49'} Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.667805 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 7017aec0-68bc-4327-9c94-b0272350df49 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cd75bee8-91ba-4505-a665-ff5ba00b3845 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49" status: 404 len: 111 microversion: 2.1 time: 0.033043 Sep 14 09:37:29.672248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2743/3419] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/7017aec0-68bc-4327-9c94-b0272350df49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:29.677513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.678000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.684053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.684531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.684959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.685637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.686082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.686504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.714583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:29.811240 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72f409be-2509-41e4-a3c1-f864cce0c636 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "DELETE /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 204 len: 0 microversion: 2.1 time: 0.134052 Sep 14 09:37:29.812199 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2744/3420] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:29 2022] DELETE /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:29.817733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.818415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.826952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.827453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.827919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.829381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.829381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.829684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.845079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b HTTP/1.1 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3aab17a3-a626-47cd-a176-866f1e66c32b'} Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:29.846925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-208a7a2d-63e5-4461-a520-8fe7cb0b1f3b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 404 len: 111 microversion: 2.1 time: 0.035017 Sep 14 09:37:29.853035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2745/3421] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:29 2022] DELETE /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:29.854202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:29.854818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:29.867937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.020566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:30.032050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ff6f573-c679-4e13-bb4f-71b8c0478a63 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1525 microversion: 2.1 time: 0.180933 Sep 14 09:37:30.032880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2746/3422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:29 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:30.038550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.039625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 3aab17a3-a626-47cd-a176-866f1e66c32b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.047028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.047650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.048321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.049307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.049986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.050640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.072899 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b HTTP/1.1 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3aab17a3-a626-47cd-a176-866f1e66c32b'} Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.074632 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.079638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 3aab17a3-a626-47cd-a176-866f1e66c32b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:30.081659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f45f268c-ea0f-425d-ac24-7ae1ff168a43 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b" status: 404 len: 111 microversion: 2.1 time: 0.046847 Sep 14 09:37:30.082864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2747/3423] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:30 2022] GET /compute/v2.1/servers/3aab17a3-a626-47cd-a176-866f1e66c32b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:30.098754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.099735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.107772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.108418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.109596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.110598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.111442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.112169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.138688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d HTTP/1.1 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '00ef0aac-3742-483b-a475-b041d204373d'} Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:30.140710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.145139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:30.145962 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10413c42-dc8b-475c-a506-f9616518b205 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 404 len: 111 microversion: 2.1 time: 0.056516 Sep 14 09:37:30.150117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2748/3424] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:30 2022] DELETE /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:30.155481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.156342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 00ef0aac-3742-483b-a475-b041d204373d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.163400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.164294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.165059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.166037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.166663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.167277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.184108 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d HTTP/1.1 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '00ef0aac-3742-483b-a475-b041d204373d'} Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.185943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 00ef0aac-3742-483b-a475-b041d204373d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:30.189997 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd8ff01f-2e5b-41bf-97e2-48079eb4299b tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d" status: 404 len: 111 microversion: 2.1 time: 0.036066 Sep 14 09:37:30.191267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2749/3425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:30 2022] GET /compute/v2.1/servers/00ef0aac-3742-483b-a475-b041d204373d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:30.197344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.197846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.204472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.205250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.205684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.206384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.206997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.207610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.224301 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be HTTP/1.1 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9d5ff081-ea27-41e1-a625-4a35dc6318be'} Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:30.226611 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ee65135-2144-4b25-bfa5-10b3db982cb2 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 404 len: 111 microversion: 2.1 time: 0.035574 Sep 14 09:37:30.230794 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2750/3426] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:30 2022] DELETE /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:30.240716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.241562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 9d5ff081-ea27-41e1-a625-4a35dc6318be] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.249601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.250199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.250712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.251589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.252201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.252691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.271402 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be HTTP/1.1 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9d5ff081-ea27-41e1-a625-4a35dc6318be'} Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:30.273819 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 9d5ff081-ea27-41e1-a625-4a35dc6318be could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:30.278106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-761802c7-f0b2-46ea-b4fb-8ff90365fd33 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be" status: 404 len: 111 microversion: 2.1 time: 0.039120 Sep 14 09:37:30.279433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2751/3427] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:30 2022] GET /compute/v2.1/servers/9d5ff081-ea27-41e1-a625-4a35dc6318be => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:37:30.348235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:30.349778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:30.361881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.363207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.364294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:30.365823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:30.366983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:30.368098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:31.002823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:31.013113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a02215f-c1e9-461f-aa2a-6093cc7e4d27 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.669955 Sep 14 09:37:31.025773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2752/3428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:30 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:31.025773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:31.025773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:31.034754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:31.035781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:31.037223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:31.038919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:31.039500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:31.040132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:31.577938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:31.591271 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e153c41d-7a1d-4573-92e6-1c052d3bf25b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 200 len: 1521 microversion: 2.1 time: 0.571757 Sep 14 09:37:31.592390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2753/3429] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:31 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:31.606478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:31.609534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:31.627731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:31.629229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:31.630338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:31.639297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:31.641152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:31.641871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.170285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:32.186040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf277288-e625-44dc-b733-9ee6902cd499 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1525 microversion: 2.1 time: 0.591455 Sep 14 09:37:32.187605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2754/3430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:31 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1525 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:32.206669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:32.210111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:32.234382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.238035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.239611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.241058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.244217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.244957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.703693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:32.718142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86059597-89ac-49a6-b43d-a5809dda6380 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.525630 Sep 14 09:37:32.723883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2755/3431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:32 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:32.729107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77ddcb5f-96a5-4a6e-8311-005c020be767", "name": "network-vif-deleted", "tag": "9994242a-4194-4e57-90aa-acd978970dfd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:32.754486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.757360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.758774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.799141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=31 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:32.802200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] Creating event network-vif-deleted:9994242a-4194-4e57-90aa-acd978970dfd for instance 77ddcb5f-96a5-4a6e-8311-005c020be767 on n-h1-851028-12 Sep 14 09:37:32.807884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cc26a36f-9070-4f9c-ad66-1c4a35b1df59 req-e348cdfe-5e3f-4a08-a41a-dbbe1a1ce4b4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082450 Sep 14 09:37:32.819480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2756/3432] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:32.826070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:32.827026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:32.842244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.842941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.843552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.844459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.846533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.847127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.922903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:32.926937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:32.927566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:32.929254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lazy-loading 'fault' on Instance uuid 77ddcb5f-96a5-4a6e-8311-005c020be767 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:37:33.015602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:33.026796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abdcbf9a-d977-488d-9e40-44685dfcd72f tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 200 len: 1313 microversion: 2.1 time: 0.205666 Sep 14 09:37:33.044934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2757/3433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:32 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:33.215931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:33.216778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:33.224861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:33.225433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:33.226452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:33.227374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:33.228025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:33.228779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:33.320143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe341d5635e47bdbb3c8bed79ead871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '490e7e72894e40fc856e0741387eff09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:33.371812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4955ac18-0a97-4b8d-8510-62dc9f6ada98 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 200 len: 1483 microversion: 2.1 time: 0.160041 Sep 14 09:37:33.377556 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2758/3434] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:33 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 1483 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:33.748690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:33.749565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:33.769665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:33.775063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:33.777293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:33.779085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:33.780364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:33.781822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:33.783167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.049212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.060504 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c342afa5-21f8-4062-b49a-43546f603b13 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.316036 Sep 14 09:37:34.071055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2759/3435] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:33 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:34.092137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.093279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:34.109483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.109868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.110358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.111464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.111874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.112691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.137007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] HTTP exception thrown: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 HTTP/1.1 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '77ddcb5f-96a5-4a6e-8311-005c020be767'} Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.138976 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:34.142893 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.144403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 404 to user: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.146140 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c30531d-9c71-4db5-a02c-e60c7cbff9d1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 404 len: 111 microversion: 2.1 time: 0.073086 Sep 14 09:37:34.146894 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2760/3436] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:34.158905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.164795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.168134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:34.182278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.182765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.183196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.184023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.184460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.184988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.295759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f1efbaf-835a-4a08-9100-33898a4d14f1 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.142630 Sep 14 09:37:34.296807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2761/3437] 10.222.0.90 () {58 vars in 1230 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:37:34.312787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccde1705-9247-4a6c-9589-9ceb53221f03 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccde1705-9247-4a6c-9589-9ceb53221f03 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:37:34.316669 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccde1705-9247-4a6c-9589-9ceb53221f03 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccde1705-9247-4a6c-9589-9ceb53221f03 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009355 Sep 14 09:37:34.325051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2762/3438] 10.222.0.90 () {58 vars in 1182 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:37:34.334375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.340953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.341636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:34.348063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.348413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.348852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.349584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.350042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.350566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.378661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:34.402884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:34.424622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2417f951-e169-4e31-b20e-02903bbe6b08 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.096046 Sep 14 09:37:34.425798 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2763/3439] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers => generated 683 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:37:34.434310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.435201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] [instance: 898c0caf-9c1c-42ae-9b64-fad2893bb330] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:34.444779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.445539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.446298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.447273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.447944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.448547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.467699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] HTTP exception thrown: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Request method failure captured: Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 HTTP/1.1 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaDAWquYpAUtFaDam76deT-yfT_YZR9t-wWkTCnI9C9ZPYcUg1RCGnzg45x-6BYUSzSDH5Z02pyReorCIi61mC8jLwsBNjpU4rnMXQ7mhFGiyOa0OlxGvmP0dkgoNF4-xIzAm_F3UGAYhu7029USU00x6u0TLNk4g92Isn3VUK9oC54 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_490e7e72894e40fc856e0741387eff09", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/490e7e72894e40fc856e0741387eff09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/490e7e72894e40fc856e0741387eff09"}]}] Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 490e7e72894e40fc856e0741387eff09 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1742538602 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 2fe341d5635e47bdbb3c8bed79ead871 Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1742538602-project Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '898c0caf-9c1c-42ae-9b64-fad2893bb330'} Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.469689 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. Sep 14 09:37:34.473393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.475547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] Returning 404 to user: Instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.476778 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81498520-91a6-4267-b374-df9bb58f7a19 tempest-InstanceActionsNegativeTestJSON-1742538602 tempest-InstanceActionsNegativeTestJSON-1742538602-project] 10.222.0.90 "GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330" status: 404 len: 111 microversion: 2.1 time: 0.049764 Sep 14 09:37:34.477907 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2764/3440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers/898c0caf-9c1c-42ae-9b64-fad2893bb330 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:34.483791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.489553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.490297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Removing options 'limit' from query {{(pid=122444) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 14 09:37:34.492082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:34.498796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.499486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.500158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.501419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.502073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.502692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.538304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:34.580709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-faf24ef7-b5bd-4dd0-af88-5011eb46993b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.100968 Sep 14 09:37:34.587963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2765/3441] 10.222.0.90 () {58 vars in 1144 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:34.601389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87d03e88-25ef-41b8-8535-ac553f2972aa tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87d03e88-25ef-41b8-8535-ac553f2972aa tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '-1' Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:37:34.615457 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.620313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87d03e88-25ef-41b8-8535-ac553f2972aa tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.621763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87d03e88-25ef-41b8-8535-ac553f2972aa tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022847 Sep 14 09:37:34.628331 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2766/3442] 10.222.0.90 () {58 vars in 1142 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:37:34.638684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-655a5610-c4e0-47ff-a168-e6032c02bcd7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-655a5610-c4e0-47ff-a168-e6032c02bcd7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: action_args: {} Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'testing' Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 14 09:37:34.643787 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-655a5610-c4e0-47ff-a168-e6032c02bcd7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-655a5610-c4e0-47ff-a168-e6032c02bcd7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.014891 Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2767/3443] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:37:34.658424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b6512b-6ee7-46ec-924d-c728108e92b6", "name": "network-vif-plugged", "status": "completed", "tag": "aacaf614-227d-455a-892c-46431faa8b9e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:34.668189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.668673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.669931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.696573 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] Creating event network-vif-plugged:aacaf614-227d-455a-892c-46431faa8b9e for instance c1b6512b-6ee7-46ec-924d-c728108e92b6 on n-h2-851028-12 Sep 14 09:37:34.710310 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6f73492d-4448-45dd-89a8-de8e2942d365 req-7c08e989-1c0b-4d8c-ad08-912a1c80f1da service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054513 Sep 14 09:37:34.715705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2768/3444] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:34.762185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de1836af-6cc8-4036-bd72-9e732ef25d5e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.798779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de1836af-6cc8-4036-bd72-9e732ef25d5e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.799589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de1836af-6cc8-4036-bd72-9e732ef25d5e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:34.822950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.servers [None req-de1836af-6cc8-4036-bd72-9e732ef25d5e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Flavor 'non_existing_flavor' could not be found {{(pid=122444) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 14 09:37:34.824124 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de1836af-6cc8-4036-bd72-9e732ef25d5e tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.106854 Sep 14 09:37:34.825170 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2769/3445] 10.222.0.90 () {58 vars in 1178 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:37:34.837327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.838036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:34.853255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.855880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.856454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.857465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.858162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.858682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.897814 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 HTTP/1.1 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '14b366f4-6ae2-453b-9717-bb0b842ef3a6'} Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:34.902297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:34.906747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1ea884b-96f1-432d-aeda-5c4bf90a5341 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 404 len: 111 microversion: 2.1 time: 0.077550 Sep 14 09:37:34.910195 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2770/3446] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:34 2022] DELETE /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:34.916003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:34.922733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:34.923490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:34.932450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.932937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.933545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:34.934861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:34.935317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:34.935738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.499652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca254ff2-9663-49c0-958f-4df5f383915a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.588219 Sep 14 09:37:35.504921 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2771/3447] 10.222.0.90 () {58 vars in 1174 bytes} [Wed Sep 14 09:37:34 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:37:35.513185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898c0caf-9c1c-42ae-9b64-fad2893bb330", "name": "network-vif-deleted", "tag": "f19bae99-8bfb-49bc-abca-5b1f546389ba"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:35.534182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.535292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.540754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.562285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] Creating event network-vif-deleted:f19bae99-8bfb-49bc-abca-5b1f546389ba for instance 898c0caf-9c1c-42ae-9b64-fad2893bb330 on n-h2-851028-12 Sep 14 09:37:35.568509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-19208cfe-372f-4da5-9b22-e626fbe9698b req-b06e5600-7453-4e63-a4ee-831e66822901 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062881 Sep 14 09:37:35.570121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2772/3448] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:35.578828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:35.580197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 14b366f4-6ae2-453b-9717-bb0b842ef3a6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:35.587208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.587715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.588196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.588945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.589413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.589848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.606547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 HTTP/1.1 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '14b366f4-6ae2-453b-9717-bb0b842ef3a6'} Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:35.608262 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 14b366f4-6ae2-453b-9717-bb0b842ef3a6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d21add1-1c07-42b2-b5ca-b312628e53b5 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6" status: 404 len: 111 microversion: 2.1 time: 0.035369 Sep 14 09:37:35.616546 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2773/3449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:35 2022] GET /compute/v2.1/servers/14b366f4-6ae2-453b-9717-bb0b842ef3a6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:35.619746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:35.619746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:35.626054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.626562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.627004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.627832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.628327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.628762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.892110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:35.909891 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b64b276a-3315-4ac6-8efc-7bb0770d0d93 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1318 microversion: 2.1 time: 0.294942 Sep 14 09:37:35.911679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2774/3450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:35 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:35.937528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:35.949923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:35.951605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:35.962626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.963714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.964558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:35.966135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:35.967295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:35.968139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.114028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdcba26f-c647-4e01-b6ca-2967a2534c77 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.195260 Sep 14 09:37:36.121990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2775/3451] 10.222.0.90 () {58 vars in 1184 bytes} [Wed Sep 14 09:37:35 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:37:36.121990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.121990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:36.122662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:36.128580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.129082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.129519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.131423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.131423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.131423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.149414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 HTTP/1.1 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6968209c-625c-49f8-abd8-436e9fdede63'} Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:36.151014 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-feba9cf2-e8a2-428f-92be-806a33579a57 tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 404 len: 111 microversion: 2.1 time: 0.036925 Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2776/3452] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:36 2022] DELETE /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:36.158841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.163204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:36.164860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:36.173979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.174848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.175421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.176596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.177268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.177807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.217343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:36.259457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:36.266097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.266583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.267020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.407228 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3910c18b-ad58-4a16-a375-79b9279d4ac9 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.252610 Sep 14 09:37:36.408073 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2777/3453] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 09:37:36 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:36.414149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.415296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] [instance: 6968209c-625c-49f8-abd8-436e9fdede63] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:36.423437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.424318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.424963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.425984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.426647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.427276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.449342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] HTTP exception thrown: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Request method failure captured: Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 HTTP/1.1 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ94ElAIGBKX6u85gdGCdjVHBx4V0Oy6tDxbzzKPCssRzum9fiNSprsb262Nm6lkwC95u95xUkpNTKUC6OcN_-265NrIEDA2daX0XXSZUfQQNiZDt8Naxpd9CFIKsF-_GH5iGzOYdwabty6gIlBUIWkQCxwJQnqFzCr0NN2uJMpJqiA Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c90e7508f17d403d9b6b942934de76cb", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c90e7508f17d403d9b6b942934de76cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c90e7508f17d403d9b6b942934de76cb"}]}] Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c90e7508f17d403d9b6b942934de76cb Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-696083728 Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c69251d16928471d9b63bbca256b959d Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-696083728-project Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6968209c-625c-49f8-abd8-436e9fdede63'} Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.450943 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] Returning 404 to user: Instance 6968209c-625c-49f8-abd8-436e9fdede63 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd37b168-db39-4cec-a010-6d0d448f1d9a tempest-DeleteServersTestJSON-696083728 tempest-DeleteServersTestJSON-696083728-project] 10.222.0.90 "GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63" status: 404 len: 111 microversion: 2.1 time: 0.043589 Sep 14 09:37:36.454731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2778/3454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:36 2022] GET /compute/v2.1/servers/6968209c-625c-49f8-abd8-436e9fdede63 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:36.468882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a340169b-0789-4cb3-9482-d493c4c24ad4 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.474879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a340169b-0789-4cb3-9482-d493c4c24ad4 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:36.477006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a340169b-0789-4cb3-9482-d493c4c24ad4 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021848 Sep 14 09:37:36.488812 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2779/3455] 10.222.0.90 () {58 vars in 1178 bytes} [Wed Sep 14 09:37:36 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:37:36.497580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.504253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:36.504930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Searching by: {'deleted': False, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:36.512943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.513600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.514131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.514877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.515389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.515885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.570409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:36.605372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc1562f0-3253-4d21-ada8-614a1dacad6b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.114691 Sep 14 09:37:36.611249 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2780/3456] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 09:37:36 2022] GET /compute/v2.1/servers => generated 683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:37:36.627863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.628879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:36.638924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.640503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.641454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.644598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.645349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.647477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.684175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:36.807822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91a815e9-10a8-450a-9419-2f25e7e0e755 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 204 len: 0 microversion: 2.1 time: 0.189542 Sep 14 09:37:36.812042 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2781/3457] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:36 2022] DELETE /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:36.822992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.823597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:36.833357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.833970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.834441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.835885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.836563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.837105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.855159 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] HTTP exception thrown: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 HTTP/1.1 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '77ddcb5f-96a5-4a6e-8311-005c020be767'} Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:36.856928 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 404 to user: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56746cfb-1be4-462f-9c5c-b7b1c2987cda tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "DELETE /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 404 len: 111 microversion: 2.1 time: 0.043078 Sep 14 09:37:36.860972 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2782/3458] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:36 2022] DELETE /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:37:36.882150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:36.882150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:36.889723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.889723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.889723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.889723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:36.890428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:36.890428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:36.933682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:37.074202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8169ea58-6bfc-403c-84b4-0213a98d3ada tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 204 len: 0 microversion: 2.1 time: 0.198572 Sep 14 09:37:37.080846 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2783/3459] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:37:36 2022] DELETE /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:37:37.089540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:37.090681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:37.103676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.104536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.105103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.106344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.106909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.107656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.587425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:37.599817 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b17a3b4-38e7-4ff1-97bd-2cd340e7abd8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1468 microversion: 2.1 time: 0.519654 Sep 14 09:37:37.612849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2784/3460] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:37 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1468 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:37.622809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:37.622809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:37.628804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.633054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.633540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.634298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.634766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.635389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.855544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:37.873336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1df70e12-0277-41b5-b6cc-3d9f99b29a0a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 200 len: 1521 microversion: 2.1 time: 0.265031 Sep 14 09:37:37.874094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2785/3461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:37 2022] GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:37.902859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8701ba-a845-4561-bc3f-35ef1a1a1fb2", "name": "network-vif-plugged", "status": "completed", "tag": "07349cec-6074-4fe7-9abc-1b2ccc21e64b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:37.914573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.915063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.915506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.931254 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] Creating event network-vif-plugged:07349cec-6074-4fe7-9abc-1b2ccc21e64b for instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 on n-h1-851028-12 Sep 14 09:37:37.937562 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c07a8383-6fdf-4dec-aa91-c68670953786 req-d6c82e0a-082b-4a1c-b1b0-a3cdbf4c96e3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042967 Sep 14 09:37:37.938469 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2786/3462] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:37.948555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:37.949278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:37.962301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.962820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.963266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.964028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:37.967662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:37.968172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:37.981023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:38.745988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:38.759238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f605f635-1975-48b1-9d7e-b2a5e58dcdf1 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1318 microversion: 2.1 time: 0.816694 Sep 14 09:37:38.759841 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2787/3463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:37 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:38.899524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:38.900183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:38.921121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:38.922717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:38.923201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:38.923975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:38.924448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:38.926871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:39.391294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:39.407686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db03d9eb-3dbc-4353-b035-732075ae10b7 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 200 len: 1521 microversion: 2.1 time: 0.512724 Sep 14 09:37:39.416365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2788/3464] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:38 2022] GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:39.788180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:39.788935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:39.806377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:39.806907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:39.807519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:39.808120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:39.808585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:39.809009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:40.567101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:40.578616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c19b3b60-e1aa-4efa-950d-b66509a8a5dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1318 microversion: 2.1 time: 0.794577 Sep 14 09:37:40.583807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2789/3465] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:39 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:40.591355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:40.592478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:40.602420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:40.603563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:40.604263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:40.606222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:40.607980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:40.608759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:40.817107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e21b6b9b9384f0b8929564c3002ec1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17c220a3876d4271a4e896b6ad2d2d3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:40.827284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f7ab42f-6ffe-401a-aca2-cc2e86328bc8 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 200 len: 1479 microversion: 2.1 time: 0.241734 Sep 14 09:37:40.835402 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2790/3466] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:40 2022] GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 1479 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:41.374170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe637aab-a485-469d-92ea-04dc745afb61", "name": "network-vif-deleted", "tag": "c23a09e7-ebd6-4c97-98d4-0845f16ff0ff"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:41.393052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:41.393713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:41.394302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:41.410692 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] Creating event network-vif-deleted:c23a09e7-ebd6-4c97-98d4-0845f16ff0ff for instance fe637aab-a485-469d-92ea-04dc745afb61 on n-h1-851028-12 Sep 14 09:37:41.420865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a147ea8d-3e6c-437a-bf47-0603f6ce8c9d req-b6442bd7-c660-458a-aadb-25ac502aa73c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.583450 Sep 14 09:37:41.422053 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2791/3467] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:41.607544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:41.608875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:41.623209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:41.626491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:41.627434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:41.629327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:41.632970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:41.635613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:41.955865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:41.966217 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83b46f6e-44ea-49ac-8381-f56d1c1fd9ff tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1468 microversion: 2.1 time: 0.363362 Sep 14 09:37:41.967441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2792/3468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:41 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1468 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:41.972320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:41.980840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: fe637aab-a485-469d-92ea-04dc745afb61] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:41.994855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:41.995546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:41.996105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:41.998477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:41.999135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:41.999853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.020984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] HTTP exception thrown: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 HTTP/1.1 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'fe637aab-a485-469d-92ea-04dc745afb61'} Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.024299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. Sep 14 09:37:42.027836 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.029616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 404 to user: Instance fe637aab-a485-469d-92ea-04dc745afb61 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:42.030855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87100dfa-4c4f-42ab-901f-915ab424ef1b tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61" status: 404 len: 111 microversion: 2.1 time: 0.062204 Sep 14 09:37:42.033055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2793/3469] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:41 2022] GET /compute/v2.1/servers/fe637aab-a485-469d-92ea-04dc745afb61 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:42.039343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:42.045410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:42.046398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Searching by: {'reservation_id': 'r-f7u0tp6z', 'deleted': False, 'project_id': 'a7086c1820364472b7621af92fe1ee6f'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 09:37:42.052967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.054116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.054635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.055610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.056203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.057841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.225286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 09:37:42.316019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:42.328484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.328985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.329428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.862704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9bc0fe2e-24b5-4b49-9ebb-39d07b7698aa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/detail?reservation_id=r-f7u0tp6z" status: 200 len: 2929 microversion: 2.1 time: 0.830006 Sep 14 09:37:42.863525 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2794/3470] 10.222.0.90 () {58 vars in 1197 bytes} [Wed Sep 14 09:37:42 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f7u0tp6z => generated 2929 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:42.875416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:42.876114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 77ddcb5f-96a5-4a6e-8311-005c020be767] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:42.902065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.902586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.903035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.903783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:42.910909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:42.911423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:42.935307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] HTTP exception thrown: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 HTTP/1.1 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '77ddcb5f-96a5-4a6e-8311-005c020be767'} Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.937044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 404 to user: Instance 77ddcb5f-96a5-4a6e-8311-005c020be767 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dec42368-bf6a-4a3a-ac7f-fddaef35ed60 tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767" status: 404 len: 111 microversion: 2.1 time: 0.074089 Sep 14 09:37:42.940607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2795/3471] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:42 2022] GET /compute/v2.1/servers/77ddcb5f-96a5-4a6e-8311-005c020be767 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:43.172101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1040247021", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:43.267280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:43.267280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:43.267704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:43.268373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:43.268861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:43.292885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.293986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.294883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.296047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.296759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.297481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.328572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Getting quotas for project e453176087b74f8b9bfb3da103b2ec51. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:43.346738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Getting quotas for user eb1159d1a99d409cb9bfa8acfe72b1fc and project e453176087b74f8b9bfb3da103b2ec51. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:43.365332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:43.369200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:43.435736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8908ff1-216b-433c-80cc-bf7436a11ee2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.490116 Sep 14 09:37:43.437406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2796/3472] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:37:43.443226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:43.463047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_groups [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Querying cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) for 2 instances {{(pid=122444) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 14 09:37:43.464877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.465624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.466272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.493416 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e05272a-6fbe-483d-ba37-33cfdc920c73 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/os-server-groups/43d4618d-f01f-45e3-948a-362c9ba5b4fa" status: 200 len: 270 microversion: 2.1 time: 0.054735 Sep 14 09:37:43.494312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2797/3473] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:37:43 2022] GET /compute/v2.1/os-server-groups/43d4618d-f01f-45e3-948a-362c9ba5b4fa => generated 270 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:43.500310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:43.500876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] [instance: 2208a39f-620f-48e4-bf2a-2b67f18bc1f4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:43.508574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.509083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.509537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.510281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.510984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.511343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.530222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] HTTP exception thrown: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Request method failure captured: Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 HTTP/1.1 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaC4-s-qzoOvi-DGY_9LSDZ_GLqT-zK_pfzMyqC-ttGxqNjcMQMjw3kJJG4TQviwYqmJ_NlDrBC7uyAMh6A2h_H35ECK31z04V0b094tO9Ep6yJA2MVWySBVdB70qn8iUrWh02xtqq91wlYMiUQ836qwVpFoWUasoZ5ZKtnH72p0G-Q Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_17c220a3876d4271a4e896b6ad2d2d3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/17c220a3876d4271a4e896b6ad2d2d3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/17c220a3876d4271a4e896b6ad2d2d3d"}]}] Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 17c220a3876d4271a4e896b6ad2d2d3d Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1687489188 Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 5e21b6b9b9384f0b8929564c3002ec1f Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ListServersNegativeTestJSON-1687489188-project Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2208a39f-620f-48e4-bf2a-2b67f18bc1f4'} Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:43.536998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:43.541299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] Returning 404 to user: Instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:43.550312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d6ef043-32f4-4d62-bcbb-5e5ed777fa9a tempest-ListServersNegativeTestJSON-1687489188 tempest-ListServersNegativeTestJSON-1687489188-project] 10.222.0.90 "GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4" status: 404 len: 111 microversion: 2.1 time: 0.044192 Sep 14 09:37:43.555180 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2798/3474] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:43 2022] GET /compute/v2.1/servers/2208a39f-620f-48e4-bf2a-2b67f18bc1f4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:37:43.568502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:43.571229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:43.744547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:43.755421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:43.756978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:43.758370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58eddd0e-8b73-466e-9ccf-3ef4d596db65 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1281 microversion: 2.47 time: 0.205904 Sep 14 09:37:43.772414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2799/3475] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:43 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1281 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:43.772414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2208a39f-620f-48e4-bf2a-2b67f18bc1f4", "name": "network-vif-deleted", "tag": "3d063c9d-e638-4a7a-b846-8b66a5cf3a5e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:43.805311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.806158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.806846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.829212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] Creating event network-vif-deleted:3d063c9d-e638-4a7a-b846-8b66a5cf3a5e for instance 2208a39f-620f-48e4-bf2a-2b67f18bc1f4 on n-h2-851028-12 Sep 14 09:37:43.835481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-185932d3-661d-4e6e-9b94-b23f21c90072 req-ed883672-88f6-4eb7-a7ba-24d16215b317 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074631 Sep 14 09:37:43.836476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2800/3476] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:43.842508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:43.843462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:43.852895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.853600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.853864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:43.854610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:43.855515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:43.855515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.170241 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d45176a8-ef92-4059-b55e-6321d1b03bad tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1621 microversion: 2.1 time: 0.331746 Sep 14 09:37:44.171191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2801/3477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:43 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1621 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:44.201416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:44.203391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:44.213737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.214483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.215413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.216665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.218477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.219266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.648676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b67e4b7e-de86-4008-a064-3172d081d17b tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 200 len: 1621 microversion: 2.1 time: 0.445546 Sep 14 09:37:44.660339 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2802/3478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:44 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 1621 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:44.792053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:44.792690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:44.809430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.810208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.812485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:44.815531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:44.816993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:44.821759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:45.026169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:45.037356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:45.044908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:45.050333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd86a5c1-f2fb-4e40-b0c2-2c278d2f773b tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1333 microversion: 2.47 time: 0.263021 Sep 14 09:37:45.052168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2803/3479] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:44 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1333 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:45.066960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1303333773", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "864f9917-6f8f-434e-8942-3e2f7a854cd7"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:45.143056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:37:45.680273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:45.680967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:45.681159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:45.681821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:45.682648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:45.692802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:45.693383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:45.694506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:45.695628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:45.696773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:45.697451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:45.722639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:45.730930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:45.764698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:45.770855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:45.809225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:45.856893 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85d65d1a-c11d-454d-a281-270e88855509 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798267 Sep 14 09:37:45.858669 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2804/3480] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:37:45.872556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8096cf79-4d05-41b8-adb9-bf4169e5c17a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:45.877015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8096cf79-4d05-41b8-adb9-bf4169e5c17a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:46.073915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8096cf79-4d05-41b8-adb9-bf4169e5c17a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:46.082652 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8096cf79-4d05-41b8-adb9-bf4169e5c17a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1217 microversion: 2.1 time: 0.215784 Sep 14 09:37:46.097746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2805/3481] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:45 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:46.105849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:46.109148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:46.124547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:46.125327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:46.126028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:46.128445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:46.128949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:46.129400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:46.262067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:46.272712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:46.275251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:46.277673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-799f6691-c59d-486f-9382-e090a9e49c62 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1339 microversion: 2.47 time: 0.179641 Sep 14 09:37:46.278788 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2806/3482] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:46 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:47.114803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:47.116004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:47.160023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:47.160554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:47.163683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:47.169468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:47.169993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:47.170442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:47.342035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:47.351216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3d64436-e4b8-4ac9-847c-229984800550 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1269 microversion: 2.1 time: 0.242086 Sep 14 09:37:47.351740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2807/3483] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:47 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1269 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:47.364287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:47.364693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:47.377110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:47.377819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:47.378423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:47.379380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:47.380360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:47.381372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:47.464055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG neutronclient.v2_0.client [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=122443) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 14 09:37:47.464904 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 901.144147 Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.find_resource_by_id(resource, name_or_id, Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack raise exceptions.NotFound(message=not_found_message) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'tempest-securitygroup--1332296004' Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack raise client_exc(message=error_message, Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-dfd9f17f-565d-4c83-9f03-2e0c74eef388'] Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Traceback (most recent call last): Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return req.get_response(self.application) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack self._log_req(req, res, start) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack self.force_reraise() Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack raise self.value Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack res = req.get_response(self.application) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return request.get_response(self.application) Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:37:47.503614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack response = req.get_response(self._app) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack response = self.app(environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return resp(environ, start_response) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return method(req=request, **action_args) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return f(*args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return func(*args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack [Previous line repeated 10 more times] Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self._create_instance( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack security_groups = self._check_requested_secgroups( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return neutronv20.find_resourceid_by_name_or_id( Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return find_resource_by_name_or_id(client, resource, name_or_id, Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return client.find_resource(resource, name_or_id, project_id, Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 14 09:37:47.508444 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self._find_resource_by_name( Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 457, in _find_resource_by_name Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack data = obj_lister(**params) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1063, in list_security_groups Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.list('security_groups', self.security_groups_path, Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack res = self.get(path, params=params) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack raise exception.Unauthorized() Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Sep 14 09:37:47.512544 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack Sep 14 09:37:47.518176 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] http://10.222.0.90/compute/v2.1/servers returned with HTTP 401 Sep 14 09:37:47.518176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:47.518176 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 09:37:47.518176 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:37:47 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.90) Sep 14 09:37:47.519676 n-d-851028-12 devstack@n-api.service[122443]: CRITICAL nova [None req-12205b7b-9403-4dbf-a1d7-ca09c743fb5e tempest-ServersTestBootFromVolume-900595143 tempest-ServersTestBootFromVolume-900595143-project] Unhandled error: OSError: write error Sep 14 09:37:47.519676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova OSError: write error Sep 14 09:37:47.519676 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova Sep 14 09:37:47.520162 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 677/3484] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:22:46 2022] POST /compute/v2.1/servers => generated 0 bytes in 901200 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Sep 14 09:37:47.522794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:47.537270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:47.540544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:47.542434 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c6b97c0-18f8-4754-bda5-4e4915473c3c tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1339 microversion: 2.47 time: 0.189410 Sep 14 09:37:47.543633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2808/3485] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:47 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:48.381061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:48.381847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:48.400079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.400573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.401590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:48.402328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.402764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.403185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:48.529393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:48.545853 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-166d80ab-f982-4713-9bd3-ace92237fc7b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1275 microversion: 2.1 time: 0.169800 Sep 14 09:37:48.547335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 678/3486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:48 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:48.592275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:48.593546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:48.605501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.607361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.609880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:48.614152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.615302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.616174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:48.803748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:48.820442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:48.826868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:48.836227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e304bbb1-77bc-4be4-b2ad-c661a4c5a1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1360 microversion: 2.47 time: 0.244805 Sep 14 09:37:48.837997 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2809/3487] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:48 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1360 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:48.868561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1637068673"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:48.872192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:48.891206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.912424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.915188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:48.917382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:48.918122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:48.919288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.415807 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4173088f-a901-4f01-8e3b-5550d340a1a6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "POST /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e/action" status: 202 len: 52 microversion: 2.47 time: 0.553882 Sep 14 09:37:49.416630 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 679/3488] 10.222.0.90 () {62 vars in 1319 bytes} [Wed Sep 14 09:37:48 2022] POST /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e/action => generated 52 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:37:49.434356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:49.435118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:49.453161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.453701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.454190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.454950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.468475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.468964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.476579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:49.568021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:37:49.571926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:49.572661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:49.593766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.594271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.594693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.595594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.596098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.596532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.770754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8793e536-33e8-4d8a-a3f5-e800f390b1e2 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 204 len: 0 microversion: 2.47 time: 0.345014 Sep 14 09:37:49.776784 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2810/3489] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:37:49 2022] DELETE /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:37:49.790118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:49.792495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:49.807287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.810047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.811546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:49.814324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:49.815148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:49.817362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:50.133402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:50.151967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:50.153808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:50.155248 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8106023c-7ee3-4de0-8283-ced25a6fd447 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1366 microversion: 2.47 time: 0.374687 Sep 14 09:37:50.174727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2811/3490] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:49 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:50.535244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:50.544141 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ed4d993-5f37-4c8b-a6c9-03efd2138280 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 0.977493 Sep 14 09:37:50.581247 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 680/3491] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:49 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:37:51.202525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:51.203844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:51.222486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:51.229858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:51.230325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:51.231092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:51.234072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:51.234557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:51.419172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:51.427626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:51.429815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:51.431053 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22ef9428-956c-49bb-af66-89fb8f9b7fc4 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1366 microversion: 2.47 time: 0.232945 Sep 14 09:37:51.431680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2812/3492] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:51 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:51.608262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:51.609096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:51.639975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:51.641925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:51.644686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:51.645694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:51.646161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f7a169-6843-4bf0-b673-101e1fdc1127", "tag": "36fec756-c63b-445e-b978-e32182880b81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:51.646317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:51.646588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:51.669397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:51.670076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:51.673525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:51.723735 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] Creating event network-changed:36fec756-c63b-445e-b978-e32182880b81 for instance c0f7a169-6843-4bf0-b673-101e1fdc1127 on n-h2-851028-12 Sep 14 09:37:51.748299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ad5f548e-bffa-45c7-9530-0b12be2de702 req-a64eb83b-eee0-4c8a-a8c8-00b9a805db8d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106585 Sep 14 09:37:51.753265 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2813/3493] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:37:52.086248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:52.097620 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5231f6a2-dd39-44ad-9241-756b7c349fe2 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 0.498606 Sep 14 09:37:52.103856 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 681/3494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:51 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:52.465171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:52.466067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:52.473614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:52.474420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:52.475686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:52.477443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:52.478262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:52.478904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:52.605105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:52.638816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:52.644131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb1159d1a99d409cb9bfa8acfe72b1fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e453176087b74f8b9bfb3da103b2ec51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:52.645436 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abe08090-79b2-49bd-bc5b-a270e5c432c6 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 200 len: 1366 microversion: 2.47 time: 0.186615 Sep 14 09:37:52.668592 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2814/3495] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:52 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:37:53.125311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:53.125910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:53.153623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:53.154339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:53.156847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:53.158312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:53.161278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:53.161947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:53.680449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:53.681618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] [instance: 2ec29c7b-4322-4ebd-901d-04f31651b00e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:53.698425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:53.698932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:53.699543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:53.700462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:53.701081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:53.701512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:53.762361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] HTTP exception thrown: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Request method failure captured: Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e HTTP/1.1 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaDlmRvim-PuVIMoDSKEYt0S6zSB9iyyX6gcRLykC2Q076hqv9ClLYbAqLKx0cdU0_0O8K3Bz2_VjkNuyqBrLKLpJgbC9K8fAb8ZIPZ8o96vFtecsne1f5wt2cAbSCjHT7DuE-HQoBbuANGwplPpGIXSAd8Y48FYLuNQBiCqryPmFBc Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.47 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e453176087b74f8b9bfb3da103b2ec51 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAaction247Test-1123686081 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e453176087b74f8b9bfb3da103b2ec51", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e453176087b74f8b9bfb3da103b2ec51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e453176087b74f8b9bfb3da103b2ec51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e453176087b74f8b9bfb3da103b2ec51"}]}] Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAaction247Test-1123686081 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e453176087b74f8b9bfb3da103b2ec51 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAaction247Test-1123686081 Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAaction247Test-1123686081-project Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: eb1159d1a99d409cb9bfa8acfe72b1fc Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAaction247Test-1123686081-project Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2ec29c7b-4322-4ebd-901d-04f31651b00e'} Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:53.765044 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. Sep 14 09:37:53.769008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:37:53.792305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] Returning 404 to user: Instance 2ec29c7b-4322-4ebd-901d-04f31651b00e could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:37:53.793986 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-944a0549-6c36-4b0d-ac03-f06e5d34cf05 tempest-ServersAaction247Test-1123686081 tempest-ServersAaction247Test-1123686081-project] 10.222.0.90 "GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e" status: 404 len: 111 microversion: 2.47 time: 0.118962 Sep 14 09:37:53.799704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2815/3496] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:37:53 2022] GET /compute/v2.1/servers/2ec29c7b-4322-4ebd-901d-04f31651b00e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:37:53.900281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:53.911867 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5117103b-b019-4786-9892-a0e8d4784a2f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 0.791217 Sep 14 09:37:53.915978 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 682/3497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:53 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:54.943156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:54.944358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:54.962948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:54.963839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:54.964581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:54.967558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:54.968443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:54.969078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:55.595191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:55.609583 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de0cdf68-5ec8-4892-8e6b-b4835374cdf0 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 0.670257 Sep 14 09:37:55.617330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2816/3498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:54 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:56.625237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-457953757", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "22f49fae-1694-46b5-bd85-f44f9bf8cef2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:56.656934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:56.657692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:56.696503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=20 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:56.701006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=20 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:37:56.724574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:56.727764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:56.732334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] validate_networks() for [('22f49fae-1694-46b5-bd85-f44f9bf8cef2', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:37:56.733069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:56.735936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:56.739503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:56.740037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:57.326555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:57.339870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6115032-bbd9-4823-b16b-cb61cec0e806 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 0.687052 Sep 14 09:37:57.345066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2817/3499] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:56 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:58.374534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:58.376240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:58.395224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:58.406857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:58.407609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:58.408991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:58.412663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:58.413363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:58.687408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:37:58.687924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:37:58.688373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:37:58.688947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:37:58.689372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:37:58.701113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:58.701882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:58.702501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:58.703443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:58.704174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:58.704951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:58.729077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Getting quotas for project 461dbd105e344f559bf121a33ba706ec. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:37:58.736199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Getting quotas for user 116f4549c3b1478cb37a3f523f3cf39c and project 461dbd105e344f559bf121a33ba706ec. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:37:58.753827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:37:58.757828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:37:58.892746 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3824b94b-c642-411e-a8b6-31fea43ef500 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.485928 Sep 14 09:37:58.900192 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 683/3500] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:37:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:37:58.911813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cedc99f-8eb2-4e52-9d1b-b2aceef273a3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:37:58.913114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9cedc99f-8eb2-4e52-9d1b-b2aceef273a3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:37:59.024392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9cedc99f-8eb2-4e52-9d1b-b2aceef273a3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:59.055174 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9cedc99f-8eb2-4e52-9d1b-b2aceef273a3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1216 microversion: 2.1 time: 0.137562 Sep 14 09:37:59.059979 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 684/3501] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:58 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:37:59.391641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f7a169-6843-4bf0-b673-101e1fdc1127", "name": "network-vif-plugged", "status": "completed", "tag": "36fec756-c63b-445e-b978-e32182880b81"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:37:59.413270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:37:59.413768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:37:59.415683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:37:59.452765 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] Creating event network-vif-plugged:36fec756-c63b-445e-b978-e32182880b81 for instance c0f7a169-6843-4bf0-b673-101e1fdc1127 on n-h2-851028-12 Sep 14 09:37:59.465854 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-baa485d7-6d2d-4aae-8080-c743674fd03c req-e3c91730-fccb-44c5-b3fd-7007cc33b4b4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084969 Sep 14 09:37:59.466891 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 685/3502] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:37:59.742459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:37:59.754832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7488e34c-c0ad-40dd-8d55-1a54e162a17e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 1.384453 Sep 14 09:37:59.772503 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2818/3503] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:37:58 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:00.086570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:00.087182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:00.121759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:00.123223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:00.125210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:00.129408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:00.138575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:00.140138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:00.560979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:00.578403 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-524c4615-9c66-4478-ac1d-6a7fd54103ec tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1220 microversion: 2.1 time: 0.496999 Sep 14 09:38:00.582840 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 686/3504] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:00 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1220 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:00.783430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:00.784257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:00.809927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:00.812019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:00.820104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:00.822131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:00.827037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:00.834678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:01.605164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:01.605977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:01.612405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:01.621567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:01.622206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:01.622988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:01.623470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:01.623921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:01.851046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:01.871143 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2edd8ff7-6a03-4412-b15d-5dee62858d13 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1274 microversion: 2.1 time: 0.270831 Sep 14 09:38:01.904402 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 687/3505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:01 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:02.302647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:02.324705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0cd130e1-1fea-4b78-89f3-b37b76006981 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1317 microversion: 2.1 time: 1.539736 Sep 14 09:38:02.325516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2819/3506] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:00 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1317 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:02.907782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:02.908516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:02.924946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:02.925387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:02.925839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:02.926572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:02.927039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:02.927473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:03.140335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:03.189492 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17f8fc5b-1d4c-4d27-b260-7db5bc7be15c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1274 microversion: 2.1 time: 0.289318 Sep 14 09:38:03.190865 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 688/3507] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:02 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:03.356486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:03.357482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:03.378720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:03.379204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:03.379722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:03.380508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:03.380955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:03.381930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:03.875723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:03.887277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:03.894235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:03.895170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:03.895827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:03.897396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:03.898252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:03.898902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:03.977449 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e8098b02-4354-4757-9936-d708befb43d9 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.106259 Sep 14 09:38:03.978116 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 689/3508] 10.222.0.90 () {60 vars in 1343 bytes} [Wed Sep 14 09:38:03 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:04.102852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:04.103739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:04.111695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.112946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.113795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.114814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.115766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.116567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.176955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:38:04.253612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:04.285721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fe887d8-53d7-4d65-b016-5c0fb04660d4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1467 microversion: 2.1 time: 0.937282 Sep 14 09:38:04.292433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2820/3509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:03 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1467 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:04.310644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:04.311917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:04.345608 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a75ac4c-73bd-42b5-aa65-fbfb44004029 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 204 len: 0 microversion: 2.20 time: 0.247073 Sep 14 09:38:04.348547 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 690/3510] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:38:04 2022] DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:38:04.357820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.358527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:04.364718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.367740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.369100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:04.370542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.376614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.377694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.389405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.592975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:04.616899 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8355c229-fd74-4af2-b48d-36bf705c94e1 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1274 microversion: 2.1 time: 0.322181 Sep 14 09:38:04.619406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2821/3511] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:04 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1274 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:04.638577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:04.639549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:04.655619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.656472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.657139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.658035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:04.658850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:04.659471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:04.913613 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbbb4297-616b-4feb-8536-22ef4ca0f5a0 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1620 microversion: 2.1 time: 0.563553 Sep 14 09:38:04.922125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 691/3512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:04 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1620 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:05.207528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1419750514", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["864f9917-6f8f-434e-8942-3e2f7a854cd7"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:05.333681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:05.781612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:05.782051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:05.782526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:05.782941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:05.784299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:05.805331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:05.805883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:05.806335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:05.807139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:05.807601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:05.808064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:05.862506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:05.876906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:05.896032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:05.901414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:05.919380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:05.929403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:05.936867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:05.943492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39db59e5-c18d-49de-9d08-f6247dda234f tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1724 microversion: 2.20 time: 1.322404 Sep 14 09:38:05.966544 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2822/3513] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:04 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1724 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:38:05.989449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:05.990358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:06.006754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:06.009075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:06.010132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:06.018074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:06.019277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:06.023361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:06.038582 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-370e6758-5d5b-4625-a63b-4c8a089d45c6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836311 Sep 14 09:38:06.039350 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 692/3514] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:06.062743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a7a66536-7960-44d4-98a9-e4aa1bb3c709 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:06.063393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a7a66536-7960-44d4-98a9-e4aa1bb3c709 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:06.310865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a7a66536-7960-44d4-98a9-e4aa1bb3c709 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:06.327251 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a7a66536-7960-44d4-98a9-e4aa1bb3c709 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1217 microversion: 2.1 time: 0.274128 Sep 14 09:38:06.341407 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 693/3515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:06 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1217 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:06.986012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:06.986645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:07.017965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:07.023106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:07.023382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:07.027772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:07.028308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:07.028753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:07.528925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:07.580360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-797abc1f-2c30-4daf-b02f-f74cd804b4d3 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 1.608639 Sep 14 09:38:07.616510 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2823/3516] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:05 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:07.638708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:07.653703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:07.671798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:07.674985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:07.682803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:07.686661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:07.687881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:07.689777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:08.090988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:08.109288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:08.128150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2eab753-6fb9-4a64-bb8d-ecb6e47140ca tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1213 microversion: 2.1 time: 0.508973 Sep 14 09:38:08.134991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2824/3517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:07 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1213 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:08.156144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:08.158156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:08.159660 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff5d0439-a82f-4ab6-81e3-da94fe16a4ac tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1724 microversion: 2.20 time: 1.179234 Sep 14 09:38:08.160915 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 694/3518] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:06 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1724 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:38:08.625391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:08.626792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:08.638717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:08.640467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:08.642850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:08.646929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:08.648866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:08.651769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:08.957629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-unplugged", "status": "completed", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:09.005227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:09.005770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:09.006420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:09.079078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] Creating event network-vif-unplugged:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:38:09.087765 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-61f58dd1-e975-4322-a348-8f1974e13554 req-e7f6dafd-9662-4314-b95f-42e498989068 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136065 Sep 14 09:38:09.091910 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 695/3519] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:38:09.180803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:09.183282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:09.209425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:09.213418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:09.217132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:09.220859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:09.222789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:09.223596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:09.276915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:09.566576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:09.581122 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbd6dc52-51e4-4d6e-8ccb-32c91ea046db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.960282 Sep 14 09:38:09.596483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2825/3520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:08 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:09.609225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:09.609855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:09.628656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:09.629253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:09.629683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:09.630423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:09.634232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:09.634915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:09.665217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:09.921010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:09.935102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:09.936674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:09.943359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e0f9971-d37e-496a-bac8-a234b6e530e4 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1656 microversion: 2.20 time: 0.345451 Sep 14 09:38:09.945108 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2826/3521] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:09 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1656 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:38:10.316922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:10.348007 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d8a0857f-0610-4b88-bbef-7bfa43a5891d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1275 microversion: 2.1 time: 1.182399 Sep 14 09:38:10.350419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 696/3522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:09 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1275 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:10.608056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:10.608676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:10.625555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:10.626052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:10.626496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:10.627212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:10.627667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:10.628126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:10.982193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:10.983329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:11.005787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.006747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.008502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.011512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.012049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.012503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.276354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:11.291796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:11.293291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:11.294534 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0ba40518-76b5-4eba-8840-018fee42f196 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1656 microversion: 2.20 time: 0.320086 Sep 14 09:38:11.297387 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 697/3523] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:10 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1656 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:38:11.376862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:11.377789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:11.395701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.396240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.396744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.397479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.397956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.398373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.510521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:11.536731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24325f51-abe9-431c-ab76-af77982079b5 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.932887 Sep 14 09:38:11.544049 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2827/3524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:10 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:11.553969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fb735f-01d5-4ac9-8e79-85dd0844203b", "tag": "34897fcb-761b-4912-badd-ddd19ef91f2c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:11.565208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.566021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.566795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.583627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] Creating event network-changed:34897fcb-761b-4912-badd-ddd19ef91f2c for instance a2fb735f-01d5-4ac9-8e79-85dd0844203b on n-h1-851028-12 Sep 14 09:38:11.590388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f85be6bb-5d40-4cb1-969a-6c75b93f5ec6 req-9972dab3-339b-4649-b8a4-a1f651d8548d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044650 Sep 14 09:38:11.591243 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2828/3525] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:11.651935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:11.666061 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9c76dc1-18a3-412f-8d1d-687963b1643b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1275 microversion: 2.1 time: 0.292058 Sep 14 09:38:11.674004 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 698/3526] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:11 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1275 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:11.889876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f007a8ed-829d-4abd-a458-1154edefa4c4", "name": "network-vif-deleted", "tag": "92e4313d-7d6b-4492-ad64-8b2b413fd870"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:11.934629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:11.935120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:11.935549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:11.981701 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] Creating event network-vif-deleted:92e4313d-7d6b-4492-ad64-8b2b413fd870 for instance f007a8ed-829d-4abd-a458-1154edefa4c4 on n-h2-851028-12 Sep 14 09:38:12.011149 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9fea6961-45a0-4223-926a-d927119e76ae req-3f3f8138-9833-46c8-a6c5-129073b1fc5e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125110 Sep 14 09:38:12.011773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2829/3527] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:12.339777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:12.340917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:12.371348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:12.375610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:12.378607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:12.379595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:12.382527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:12.384505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:12.449852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-417523812", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:12.525670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:12.533233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:12.534146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:12.534651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lazy-loading 'fault' on Instance uuid f007a8ed-829d-4abd-a458-1154edefa4c4 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:38:12.566879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] validate_networks() for [('cf547488-52e4-4c17-aaa9-de542e807a98', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:12.607279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:12.622268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:12.623856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '116e4c7e83ce4e62b00dd7ce80aab5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b2d5efe3d2479fae21e38e09675e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:12.626297 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e6e5b65-227f-4199-960f-62914638cc4d tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 200 len: 1371 microversion: 2.20 time: 0.292182 Sep 14 09:38:12.637194 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2830/3528] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:12 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:38:12.655353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:12.657181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:12.664312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:12.665861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:12.666560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:12.667650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:12.668498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:12.669168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:13.118385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:13.140765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35ad6f66-6d35-4011-994c-9a79543f8639 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.501820 Sep 14 09:38:13.142259 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2831/3529] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:12 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:13.149115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:13.152175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:13.178295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:13.182852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:13.184059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:13.185030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:13.186567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:13.191546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:13.653045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:13.665703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ba2f2a4-3000-4d31-99b4-023bd7528338 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 0.521982 Sep 14 09:38:13.668145 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2832/3530] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:13 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:13.673907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:13.682923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:13.700187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:13.700830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:13.701336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:13.702175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:13.702701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:13.703201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:13.738221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 HTTP/1.1 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f007a8ed-829d-4abd-a458-1154edefa4c4'} Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:13.740623 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:13.746007 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:13.748718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:13.749804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9652b5ed-aa92-40e1-8348-cc6506b1c28e tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 404 len: 111 microversion: 2.20 time: 0.079728 Sep 14 09:38:13.751117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2833/3531] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:13 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:38:13.768932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7983087c-7218-4b7c-8554-004c3f11d252 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '.version_select at 0x7f693e35d430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:13.810376 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7983087c-7218-4b7c-8554-004c3f11d252 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192329653" status: 204 len: 0 microversion: 2.20 time: 0.054340 Sep 14 09:38:13.811094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2834/3532] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1192329653 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:38:14.188176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:14.189379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:14.201934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.205969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.206680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:14.207628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.208561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.209273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:14.454576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:14.455077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:14.455650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:14.456359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:14.456786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:14.476475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.476986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.477440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:14.478187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.478650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.479083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:14.539071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:14.545653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for user ce2585d18cd04594b7f8ba9df37c5641 and project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:14.572012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:14.581303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:14.697487 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b53bab10-b274-4772-869b-5178f5af3386 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.484493 Sep 14 09:38:14.708354 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 699/3533] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:14.717351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:14.718402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:14.757830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.758379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.758837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:14.767957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:14.768591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:14.769051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:15.024953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:15.035203 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d90d8ad7-2d31-4129-9ebf-891aea94f5fc tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.864858 Sep 14 09:38:15.041215 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2835/3534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:14 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:15.060429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ded3471a-3512-44c1-9866-c29c60e69eb4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:15.060973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ded3471a-3512-44c1-9866-c29c60e69eb4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:15.199881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ded3471a-3512-44c1-9866-c29c60e69eb4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:15.221916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ded3471a-3512-44c1-9866-c29c60e69eb4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1221 microversion: 2.1 time: 0.171253 Sep 14 09:38:15.223081 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2836/3535] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:15 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:15.495820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1383269074", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:15.608132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] validate_networks() for [('cddd25f6-377c-4af3-ba14-f3857c01c9d2', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:15.723534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:15.751937 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb375023-3796-4bd2-8cd2-55a967574c9c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 1.042115 Sep 14 09:38:15.755417 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 700/3536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:14 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:15.768071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-387164166", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:15.813149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:15.948585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] validate_networks() for [('cf547488-52e4-4c17-aaa9-de542e807a98', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:17.492449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:17.492997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:17.493378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:17.493879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:17.494414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:17.503665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:17.537113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:17.537939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:17.538571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:17.539771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:17.540637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:17.540937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:17.646157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Getting quotas for project 412ee460776a4060afcee7dd2217fb58. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:17.664715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Getting quotas for user 540eb30f57dc4ff7ade977e26cecebad and project 412ee460776a4060afcee7dd2217fb58. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:17.714126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:17.719071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:17.878388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1af1f826-d240-46ec-9e8e-608d19a62f5a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.654121 Sep 14 09:38:17.882569 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2837/3537] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:17.897703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:17.898907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:17.913419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:17.915846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:17.918326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:17.923590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:17.924658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:17.926320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:18.440938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:18.465655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67b28b90-9ff9-4e77-b496-a40a3e1434ad tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.581691 Sep 14 09:38:18.466478 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2838/3538] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:17 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:18.471550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:18.473314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:18.480713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:18.481510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:18.482112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:18.482995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:18.483599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:18.484301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:18.791631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:18.792177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:18.793336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:18.793994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:18.794507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:18.814781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:18.815589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:18.816501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:18.821554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:18.822203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:18.822752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:18.887245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:18.904188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for user ce2585d18cd04594b7f8ba9df37c5641 and project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:18.943846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:18.950999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:19.108164 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd34c6c9-356e-47e0-8e44-9e2950ab9529 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.351490 Sep 14 09:38:19.119346 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 701/3539] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:19.131074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:19.137081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:19.181552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:19.182266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:19.183227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:19.184204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:19.193046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:19.193652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:19.378936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:19.400214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9ec2854-254e-4ae4-8f50-1b7900a2fdb1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1213 microversion: 2.1 time: 0.279243 Sep 14 09:38:19.401229 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 702/3540] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:19 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:19.436904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebd6f826-a7d0-4864-a4a9-0db29a739786", "tag": "66a7146c-18f9-49f6-a42e-b604316b39a0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:19.483215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:19.484866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:19.485967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:19.487228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:19.511883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a451accf-92ee-4439-a094-c0d3f91e5877 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 1.035174 Sep 14 09:38:19.523932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2839/3541] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:18 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:19.524157 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] Creating event network-changed:66a7146c-18f9-49f6-a42e-b604316b39a0 for instance ebd6f826-a7d0-4864-a4a9-0db29a739786 on n-h2-851028-12 Sep 14 09:38:19.538190 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3216eca3-7c38-4154-9161-2a557c50b25d req-7830f0c8-65ec-4c45-b4bc-f8ae656d71e9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118580 Sep 14 09:38:19.539934 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 703/3542] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:19.547163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:19.548251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:19.556450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:19.557442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:19.558040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:19.559112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:19.559770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:19.560518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:19.564019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dce46e0d-2944-441e-a00d-426abd5dc423 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:19.569984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dce46e0d-2944-441e-a00d-426abd5dc423 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:19.726739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:19.737328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-904301c6-96b1-4e2c-bcf8-f0ba4cfd962a tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.195949 Sep 14 09:38:19.739418 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 704/3543] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:19 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:19.825745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dce46e0d-2944-441e-a00d-426abd5dc423 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:19.839186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dce46e0d-2944-441e-a00d-426abd5dc423 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1221 microversion: 2.1 time: 0.320549 Sep 14 09:38:19.839833 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2840/3544] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:19 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1221 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:20.429894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:20.431577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:20.450844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.454946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.457444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:20.462826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.464291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.466584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:20.539244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:20.540876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:20.579715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.583826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.588134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:20.591303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.598200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.598966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:20.644279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:20.661913 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af768d04-6eac-4119-8505-bef65b236bc1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1287 microversion: 2.1 time: 0.237615 Sep 14 09:38:20.664181 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 705/3545] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1287 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:20.762042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:20.762819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:20.788533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.789406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.792208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:20.793104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:20.795115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:20.796825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.192331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:21.206476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4213ca3b-b579-42f3-afee-e4fcc8a68ffa tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 0.671189 Sep 14 09:38:21.221293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2841/3546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:20 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:21.248581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:21.250077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:21.301584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.303609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.305295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.307425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.310673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.311142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.496646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:21.508616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b243138-b237-42f8-8b4f-406f8179dfd8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1273 microversion: 2.1 time: 0.285746 Sep 14 09:38:21.512127 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2842/3547] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:21 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:21.567830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:21.570124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:21.580517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.582016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.582673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.583652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.584412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.585113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.604578 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 HTTP/1.1 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f007a8ed-829d-4abd-a458-1154edefa4c4'} Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:21.606656 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.612707 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.617645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:21.618812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03a433ce-e65b-47db-aa00-2dc8f29e2075 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 404 len: 111 microversion: 2.20 time: 0.055017 Sep 14 09:38:21.619969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2843/3548] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:38:21 2022] DELETE /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:38:21.626132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:21.630747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:21.632992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f007a8ed-829d-4abd-a458-1154edefa4c4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:21.639815 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4ddf4a4-cd6e-4185-ac32-b0be9f33828b tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.877309 Sep 14 09:38:21.640562 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 706/3549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:20 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:21.648549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.649630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.652498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.653466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.654185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.654820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.674033 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 HTTP/1.1 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f007a8ed-829d-4abd-a458-1154edefa4c4'} Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.676207 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. Sep 14 09:38:21.679925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:38:21.682312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f007a8ed-829d-4abd-a458-1154edefa4c4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:21.683726 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e315e96-da52-49f2-96e1-e566f8c0faa8 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4" status: 404 len: 111 microversion: 2.20 time: 0.060041 Sep 14 09:38:21.684865 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2844/3550] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:21 2022] GET /compute/v2.1/servers/f007a8ed-829d-4abd-a458-1154edefa4c4 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:38:21.690388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:21.691287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:21.699448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.700367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.701061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:21.701960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:21.702570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:21.714782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.043934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:22.066778 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-635b7bc2-8f79-4c31-a88e-54e03a328d18 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1275 microversion: 2.1 time: 0.380155 Sep 14 09:38:22.068924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 707/3551] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:21 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1275 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:22.239949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:22.240786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:22.253395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.256977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.257699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.259282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.262943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.263392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.535476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:22.538417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:22.557771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.558278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.558747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.559467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.565579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.566331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.722227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:22.730976 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85184fd9-96c4-4895-8b3b-ccf162c96fef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1279 microversion: 2.1 time: 0.201807 Sep 14 09:38:22.731574 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 708/3552] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:22 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:22.749001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58fe86fb-6e35-4e56-9852-86ce499a6c41", "tag": "44fd8a0d-62ad-4618-864a-9dd2c7bc5cce"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:22.767525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.768057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.768483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.798506 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] Creating event network-changed:44fd8a0d-62ad-4618-864a-9dd2c7bc5cce for instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 on n-h1-851028-12 Sep 14 09:38:22.814155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:22.821518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-42eaf256-38ae-4e1a-b699-9651fb84924e req-d8e44981-12e3-4409-9f20-dea60f1eca02 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084123 Sep 14 09:38:22.822570 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 709/3553] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:22.829063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:22.830036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c942a5df-c12e-4436-a60a-849636b14153 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 0.594850 Sep 14 09:38:22.833092 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2845/3554] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:22 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:22.845669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:22.874625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.875530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.876327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:22.877291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:22.881947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:22.884507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.059146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fb735f-01d5-4ac9-8e79-85dd0844203b", "name": "network-vif-plugged", "status": "completed", "tag": "34897fcb-761b-4912-badd-ddd19ef91f2c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:23.105907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.108787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.109819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.144395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] Creating event network-vif-plugged:34897fcb-761b-4912-badd-ddd19ef91f2c for instance a2fb735f-01d5-4ac9-8e79-85dd0844203b on n-h1-851028-12 Sep 14 09:38:23.161615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6bd63382-2ed5-4414-9c06-a45936afa35f req-94eaa8e9-b92d-4893-ba12-031fb17e9bbe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108849 Sep 14 09:38:23.164527 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2846/3555] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:23.223801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:23.229487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:23.291740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.292513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.297059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.304162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.306689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.308787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.766208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:23.767134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:23.779431 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18277709-fbfb-4c49-a4ce-848a7f7fad69 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.954356 Sep 14 09:38:23.784405 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 710/3556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:22 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:23.788465 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a4d6a6d-8afe-4d48-b8eb-698d4fe4901f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.621014 Sep 14 09:38:23.791338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2847/3557] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:23.800908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:23.805740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:23.828995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.829849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.830440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.838672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.839373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.841304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.860301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:23.861143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:23.874022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.874528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.874991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:23.879086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:23.880004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:23.880637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:24.117583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:24.127409 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2db17659-82f8-4150-ae0a-5fb42f9f82c6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1279 microversion: 2.1 time: 0.341701 Sep 14 09:38:24.136540 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 711/3558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:23 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1279 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:24.674662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:24.688463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-566299dd-1516-4b30-a1fe-cd9b4fc1101b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 0.833925 Sep 14 09:38:24.690596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2848/3559] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:23 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:24.814672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:24.815668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:24.826386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:24.827269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:24.838450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:24.843398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:24.844368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:24.845442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:24.846072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:24.846660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:24.850545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:24.853341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:24.855715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:24.858802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:24.860431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:24.863575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.338446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:25.367790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-847bac2e-ae95-4e62-9d39-27092df318db tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1316 microversion: 2.1 time: 0.556958 Sep 14 09:38:25.370295 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 712/3560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:24 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:25.382417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:25.383214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:25.389854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:25.392421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:25.393098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:25.394247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.397601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:25.398407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:25.399177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.401942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab1f69c8-5893-43d2-a14c-d0d4d475f436 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.579801 Sep 14 09:38:25.421620 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2849/3561] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:24 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:25.426674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd6f826-a7d0-4864-a4a9-0db29a739786", "name": "network-vif-plugged", "status": "completed", "tag": "66a7146c-18f9-49f6-a42e-b604316b39a0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:25.465821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:25.466970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:25.467429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.511457 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] Creating event network-vif-plugged:66a7146c-18f9-49f6-a42e-b604316b39a0 for instance ebd6f826-a7d0-4864-a4a9-0db29a739786 on n-h2-851028-12 Sep 14 09:38:25.555839 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a52c2205-2e93-4a77-852e-ad5ac5b9ba43 req-792f1de6-0113-4358-9e4d-401c63ca0098 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113359 Sep 14 09:38:25.557151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2850/3562] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:25.716146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:25.717112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:25.731169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:25.732356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:25.733342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.735237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:25.741748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:25.742445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:25.757090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:25.855792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:25.867741 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3bbbfeb1-fd18-4e73-9455-cfa67324742f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.495917 Sep 14 09:38:25.872418 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 713/3563] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:25 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:26.188765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:26.200732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02b99177-fc8f-427b-af72-5404ccf78934 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1317 microversion: 2.1 time: 0.488760 Sep 14 09:38:26.201845 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2851/3564] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:25 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:26.313715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5", "tag": "d6fa8af8-09fb-4955-9173-8beb92dd8f2a"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:26.333581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.334533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.335641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.347317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:26.373663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.383140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.384385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.399437 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] Creating event network-changed:d6fa8af8-09fb-4955-9173-8beb92dd8f2a for instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 on n-h2-851028-12 Sep 14 09:38:26.417479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-08247468-c353-461d-9d49-c55b730f775b req-262b4ba4-2751-4ed1-9ccd-158d15bec27c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108746 Sep 14 09:38:26.424109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 714/3565] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:26.430859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:26.431495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:26.436789 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] Creating event network-changed:b4e96758-6513-4caa-8c42-e20b291c98dc for instance a9eebd67-2f50-426f-a198-2dc13af1ccca on n-h1-851028-12 Sep 14 09:38:26.455129 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-09d4d3c4-d71d-4602-aa55-6217b618ff05 req-ad66eea4-df95-46c2-9250-5a67b815f609 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112529 Sep 14 09:38:26.469291 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2852/3566] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:26.469480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.469480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.469480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.469480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.469795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.470168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.480943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:26.481666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:26.500134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.500649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.501092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.501829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.502291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.502733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.790416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:26.806448 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f4b7474-d7ab-4136-b164-80c5a932051c tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1504 microversion: 2.1 time: 0.379385 Sep 14 09:38:26.807505 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 715/3567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:26 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1504 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:26.831875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:26.832692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:26.841190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.842040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.842697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.843643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.844524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.849677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.860036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:26.916625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ffe82f1f-c751-4114-b511-b2468adaa50f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips" status: 200 len: 108 microversion: 2.1 time: 0.088891 Sep 14 09:38:26.932282 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 716/3568] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:38:26 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips => generated 108 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:26.937863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:26.958473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:26.974492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.975476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.976040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:26.976765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:26.977224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:26.977654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.247272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:27.262535 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59d0919d-6397-4e8a-9e4c-4b552b4221e6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.783368 Sep 14 09:38:27.264665 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2853/3569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:26 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:27.280386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.281720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.295825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.299234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.300630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.301531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.302187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.303798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.361139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-014f773c-4e04-4ae8-bed5-5b922556120f tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips" status: 200 len: 108 microversion: 2.1 time: 0.093873 Sep 14 09:38:27.363349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2854/3570] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:38:27 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips => generated 108 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:27.380685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.383062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.401649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.403283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.404366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.405947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.407030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.408559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.523241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:27.534147 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9381756-0351-48b2-a3ac-d6eb06500b52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.600012 Sep 14 09:38:27.535978 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 717/3571] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:26 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:27.552424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.553158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.565159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.565662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.566111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.566844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.567304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.567737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.600281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:27.604528 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb5bb637-61f4-4334-993d-7b375bc91ce4 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips/tempest-ServerAddressesTestJSON-234460523-network" status: 200 len: 93 microversion: 2.1 time: 0.067070 Sep 14 09:38:27.605463 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 718/3572] 10.222.0.90 () {58 vars in 1398 bytes} [Wed Sep 14 09:38:27 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b/ips/tempest-ServerAddressesTestJSON-234460523-network => generated 93 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:38:27.623166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.624065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.633025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.633894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.635273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.636190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.636817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.637398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.654518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b HTTP/1.1 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'f933d22d-e5d8-4d9f-843f-a1edf164822b'} Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:27.656728 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.661311 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.663083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:27.664383 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bada4d3b-c710-43e1-a923-b1f1880f0616 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 404 len: 111 microversion: 2.20 time: 0.057792 Sep 14 09:38:27.677385 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 719/3573] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:38:27 2022] DELETE /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:38:27.687269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.688638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.698956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.699754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.700570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.701461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.702081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.703410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.748937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:38:27.949906 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9de2a1b-21db-4029-9992-b4b51a5c9a5e tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 204 len: 0 microversion: 2.1 time: 0.270188 Sep 14 09:38:27.950666 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 720/3574] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:38:27 2022] DELETE /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:38:27.957570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:27.958613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] [instance: f933d22d-e5d8-4d9f-843f-a1edf164822b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:27.965945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.966835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.967514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.969384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:27.970100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:27.970862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:27.989985 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] HTTP exception thrown: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Request method failure captured: Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b HTTP/1.1 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIZ9KVQnSmTqH6VNMAYrPjB_wK7nr2VpIEeGxeT_4ukV6HEGvna8RRAwX1C-3HjZxqEkEUBRpfaDqPu7cTHKr53c3yhwx2MfRTPKIFvPBcNczcn4Mktvb4sFVXHr1mxwPjLX4YzvpZ82_uSVYjAnWdtOk4ow7_fhG2hEQDBGQbBDo4Nk Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.20 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_21b2d5efe3d2479fae21e38e09675e60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/21b2d5efe3d2479fae21e38e09675e60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/21b2d5efe3d2479fae21e38e09675e60"}]}] Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 21b2d5efe3d2479fae21e38e09675e60 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2116805843 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 116e4c7e83ce4e62b00dd7ce80aab5a2 Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2116805843-project Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'f933d22d-e5d8-4d9f-843f-a1edf164822b'} Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.992503 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. Sep 14 09:38:27.996450 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:27.998748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] Returning 404 to user: Instance f933d22d-e5d8-4d9f-843f-a1edf164822b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:27.999874 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3da08dc4-69ff-4cb8-959d-37a029e4d000 tempest-AttachVolumeShelveTestJSON-2116805843 tempest-AttachVolumeShelveTestJSON-2116805843-project] 10.222.0.90 "GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b" status: 404 len: 111 microversion: 2.20 time: 0.047796 Sep 14 09:38:28.000713 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 721/3575] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:38:27 2022] GET /compute/v2.1/servers/f933d22d-e5d8-4d9f-843f-a1edf164822b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:38:28.005681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:28.006920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:28.014399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.015163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.015818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.016804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.017476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.018143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.153183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:28.171274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-511df38d-6359-4082-9ebc-281a644a948c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1465 microversion: 2.1 time: 0.803729 Sep 14 09:38:28.171274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2855/3576] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:27 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1465 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:28.202103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:28.205981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:28.218153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.227142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.228068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.229005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.230767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.231551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.500569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72f498eb-7179-493c-a90c-8c35aaa4a856 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1618 microversion: 2.1 time: 0.305340 Sep 14 09:38:28.519190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2856/3577] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:28 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1618 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:28.546164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:28.547357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:28.576961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.577466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.577906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.578627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.579085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.580858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.689955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:28.707078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-914e5b28-892d-4ea5-87a6-d03be5544e04 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1510 microversion: 2.1 time: 0.705055 Sep 14 09:38:28.707680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 722/3578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:28 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1510 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:28.715496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:28.721861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:28.751761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.752399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.752920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.753715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:28.754252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:28.754755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:28.859332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:28.899646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:28.919676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-732c434e-d568-4b78-9ec8-eaf9afee3bd7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.395060 Sep 14 09:38:28.922167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=28 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:28.924826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2857/3579] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:28 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:28.940093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-167587750", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "864f9917-6f8f-434e-8942-3e2f7a854cd7"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:29.055762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:29.507703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:29.524899 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d6bbd4e4-3795-4b1c-989e-661de81ea835 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.815318 Sep 14 09:38:29.525149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:29.525596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:29.526343 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 723/3580] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:28 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:29.540112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:29.540112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:29.540112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:29.548809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.549363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.549807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:29.550576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.551030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.551494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:29.608646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:29.614595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Getting quotas for user 0cfe36c848644e96a8b93a01084209e1 and project a7086c1820364472b7621af92fe1ee6f. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:29.629787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:29.633205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:29.683542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33e03157-3d57-4b8d-aefc-19458aa597dd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755677 Sep 14 09:38:29.691206 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2858/3581] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:29.697774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d48f4a0-9ca5-46ed-becb-0b717ada2c1b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:29.698400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d48f4a0-9ca5-46ed-becb-0b717ada2c1b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:29.735746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:29.738220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:29.753450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.758307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.759415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:29.760684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.761529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.762544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:29.807726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d48f4a0-9ca5-46ed-becb-0b717ada2c1b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:29.817560 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d48f4a0-9ca5-46ed-becb-0b717ada2c1b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1216 microversion: 2.1 time: 0.124803 Sep 14 09:38:29.838087 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 724/3582] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:29 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:29.946881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:29.947504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:29.961504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.962026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.962480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:29.963220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:29.963682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:29.964143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:30.043589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:30.056565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1dea7e9d-57ca-4e6b-aeb5-26b7172ef893 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1510 microversion: 2.1 time: 0.321360 Sep 14 09:38:30.057804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2859/3583] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:29 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:30.297351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fe86fb-6e35-4e56-9852-86ce499a6c41", "name": "network-vif-plugged", "status": "completed", "tag": "44fd8a0d-62ad-4618-864a-9dd2c7bc5cce"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:30.313233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:30.313717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:30.324233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:30.337370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] Creating event network-vif-plugged:44fd8a0d-62ad-4618-864a-9dd2c7bc5cce for instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 on n-h1-851028-12 Sep 14 09:38:30.343877 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ebb14c09-f9e9-4327-95e3-74f436218ed9 req-badf9008-7d7a-4a40-bb53-9cab37ee1652 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 Sep 14 09:38:30.345234 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2860/3584] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:30.466678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:30.478102 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17e29abd-a2ed-4386-a1ca-6d39d6f906fa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.536450 Sep 14 09:38:30.478772 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 725/3585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:29 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:30.554051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:30.554853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:30.571301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:30.572974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:30.573614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:30.575109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:30.576049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:30.576831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:30.845691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:30.846425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:30.858604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:30.859110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:30.859545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:30.860277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:30.860978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:30.864739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.059653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:31.075456 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0764191d-1190-4502-b171-f28bd1959937 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1268 microversion: 2.1 time: 0.233479 Sep 14 09:38:31.076130 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 726/3586] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:30 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:31.109182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:31.110378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:31.111937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:31.119235 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5a8cfea-4451-4778-b0ba-7a6654155424 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.570010 Sep 14 09:38:31.121700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:31.122391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:31.123026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.123962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:31.124615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:31.125200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.138799 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2861/3587] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:30 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:31.284506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fb735f-01d5-4ac9-8e79-85dd0844203b", "name": "network-vif-deleted", "tag": "34897fcb-761b-4912-badd-ddd19ef91f2c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:31.296151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:31.297071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:31.297676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.305880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:31.312974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] Creating event network-vif-deleted:34897fcb-761b-4912-badd-ddd19ef91f2c for instance a2fb735f-01d5-4ac9-8e79-85dd0844203b on n-h1-851028-12 Sep 14 09:38:31.321294 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9b165e88-009b-4655-8c6f-d9419ed29354 req-ed487feb-072e-431c-8057-2b3618387791 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040634 Sep 14 09:38:31.322213 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2862/3588] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:38:31.325660 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd23fb85-f9c1-4bbe-a8e8-273f4f259d31 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1468 microversion: 2.1 time: 0.225956 Sep 14 09:38:31.347957 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 727/3589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:31 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:31.503880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:31.505111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:31.512926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:31.513422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:31.514316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.515240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:31.515704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:31.516214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:31.728992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:31.738458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3304f779-f454-4004-863c-f4f55c632cb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.239368 Sep 14 09:38:31.739768 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2863/3590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:31 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:32.104721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:32.105487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:32.117754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.124852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.125824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.126937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.127650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.128337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.147625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:32.148297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:32.167888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.173732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.173985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.174757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.175503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.175990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.216094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:32.227699 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a963ae90-6c09-429a-80f2-d4bea2d75bc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1276 microversion: 2.1 time: 0.127094 Sep 14 09:38:32.229267 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 728/3591] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:32 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:32.373753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:32.374923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:32.389688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.390607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.392792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.395107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.396961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.400820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.512249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.512812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.513228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.514963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lazy-loading 'fault' on Instance uuid a2fb735f-01d5-4ac9-8e79-85dd0844203b {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:38:32.563415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116f4549c3b1478cb37a3f523f3cf39c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '461dbd105e344f559bf121a33ba706ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:32.575458 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afda6ab1-7fdb-494a-98d6-1564181de593 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 200 len: 1306 microversion: 2.1 time: 0.206657 Sep 14 09:38:32.591546 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 729/3592] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:32 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 1306 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:32.772744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:32.775615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:32.793220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.794721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.806045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.810656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:32.812050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:32.812950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:32.989308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:33.000590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46256fa1-7335-486b-858d-93789c3f7ac9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.858179 Sep 14 09:38:33.004455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2864/3593] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:32 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:33.129235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:33.143976 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-429068ed-4c39-4231-bf04-4d1819ba77b5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.377043 Sep 14 09:38:33.155923 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 730/3594] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:32 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:33.262088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:33.263259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:33.283468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:33.283995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:33.284432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:33.285141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:33.285595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:33.286025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:33.599480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:33.600808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] [instance: a2fb735f-01d5-4ac9-8e79-85dd0844203b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:33.604523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:33.612890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:33.614968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:33.616076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69554d4a-b708-48d8-a56c-7a097bc5b73a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1274 microversion: 2.1 time: 0.361365 Sep 14 09:38:33.616796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2865/3595] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:33 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:33.616973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:33.618159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:33.621488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:33.622033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:33.656406 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] HTTP exception thrown: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Request method failure captured: Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b HTTP/1.1 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaD05NMP7m9Xsq2DeFP-eHgn9YBoCtMXZu1Az8gh4gMGxUh3Kb2fexFTpGLxxUa1IRYWlEkwJpt5SErPKmtnXDkUdnO8Aez18byWKcjMw4iezkzhXNykdRAR9I_vGOVkNVfmTLFSKav3tcX045Yaxcfb6fAAsp6JQx2hpK2ArQR7lWM Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 461dbd105e344f559bf121a33ba706ec Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerAddressesTestJSON-704669532 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_461dbd105e344f559bf121a33ba706ec", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/461dbd105e344f559bf121a33ba706ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/461dbd105e344f559bf121a33ba706ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/461dbd105e344f559bf121a33ba706ec"}]}] Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerAddressesTestJSON-704669532 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 461dbd105e344f559bf121a33ba706ec Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerAddressesTestJSON-704669532 Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerAddressesTestJSON-704669532-project Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 116f4549c3b1478cb37a3f523f3cf39c Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerAddressesTestJSON-704669532-project Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a2fb735f-01d5-4ac9-8e79-85dd0844203b'} Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:33.658781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. Sep 14 09:38:33.663550 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:33.664695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] Returning 404 to user: Instance a2fb735f-01d5-4ac9-8e79-85dd0844203b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:33.666350 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d087efdc-fe00-45ac-94b2-a5b072d36e28 tempest-ServerAddressesTestJSON-704669532 tempest-ServerAddressesTestJSON-704669532-project] 10.222.0.90 "GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b" status: 404 len: 111 microversion: 2.1 time: 0.070717 Sep 14 09:38:33.667104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 731/3596] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:33 2022] GET /compute/v2.1/servers/a2fb735f-01d5-4ac9-8e79-85dd0844203b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:38:33.839492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5", "name": "network-vif-plugged", "status": "completed", "tag": "d6fa8af8-09fb-4955-9173-8beb92dd8f2a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:33.850448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:33.851315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:33.852036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:33.877554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] Creating event network-vif-plugged:d6fa8af8-09fb-4955-9173-8beb92dd8f2a for instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 on n-h2-851028-12 Sep 14 09:38:33.889619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-95bda9a3-5797-4581-b468-a74164c6a19d req-f7d917c8-c757-459b-8273-94bb4ca802f5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054062 Sep 14 09:38:33.891245 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2866/3597] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:34.034240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:34.034860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:34.042006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.042504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.042941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.043918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.044385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.044822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.177342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:34.178739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:34.191056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.191554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.192023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.192768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.193225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.207803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.303780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:34.321078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9d3ec21-cc9e-4be2-b57e-5a8a8790f431 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.290417 Sep 14 09:38:34.322568 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 732/3598] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:34 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:34.645746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:34.646605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:34.656403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.656915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.657352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.665986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:34.676026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9040f426-3fd7-45cb-9aa1-63176cf0e722 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.505288 Sep 14 09:38:34.677022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:34.679000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:34.679455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:34.681486 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2867/3599] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:34 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:34.798955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:34.812659 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f3fbf9b-6794-41f9-a0ba-172215ffefe4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1274 microversion: 2.1 time: 0.173168 Sep 14 09:38:34.817812 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 733/3600] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:34 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:35.370731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:35.371366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:35.404638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.406392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.407043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:35.408426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.409267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.410294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:35.721561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:35.723159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:35.734208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.735291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.736035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:35.738582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.739354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.740122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:35.781740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:35.880390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:35.897296 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a303c05-8384-4578-8682-525e94ff804b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1321 microversion: 2.1 time: 0.538401 Sep 14 09:38:35.918839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2868/3601] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:35 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:35.932377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:35.934007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:35.942406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.943556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.944954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:35.946561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:35.947276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:35.948026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:36.022604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:36.039618 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fadfa509-3998-41ef-b87d-f849842dfc0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.332457 Sep 14 09:38:36.041396 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 734/3602] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:35 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:36.048293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "name": "network-vif-plugged", "status": "completed", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:36.060854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:36.061615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:36.062180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:36.074573 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] Creating event network-vif-plugged:b4e96758-6513-4caa-8c42-e20b291c98dc for instance a9eebd67-2f50-426f-a198-2dc13af1ccca on n-h1-851028-12 Sep 14 09:38:36.082153 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-163ff048-7050-40ce-ab78-ed9f63a4ec8a req-d8113854-d3dd-479d-bcf2-d6ae4f850dd9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Sep 14 09:38:36.083721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 735/3603] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:36.440928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:36.449208 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb830f17-dae0-432f-8bf8-2ae9be0024e8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.528440 Sep 14 09:38:36.450057 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2869/3604] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:35 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:36.934358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:36.936722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:36.946776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:36.948088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:36.949078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:36.949999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:36.950653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:36.951422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.070362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:37.070987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:37.077258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.078125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.078975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.080050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.080748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.081670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.254601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:37.273643 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-534ae853-6c03-4504-a08b-a6d75896e4d2 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1516 microversion: 2.1 time: 0.344741 Sep 14 09:38:37.277468 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 736/3605] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:36 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1516 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:37.308030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:37.312882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:37.322542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.323239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.324006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.325114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.326317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.326864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.373500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'flavor' on Instance uuid 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:38:37.436769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:37.458920 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46428ec0-62a8-40b0-948f-b3285bd20573 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1317 microversion: 2.1 time: 0.396526 Sep 14 09:38:37.472492 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2870/3606] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:37 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:37.482596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:37.488472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:37.499960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.509031 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d89718e6-e36b-489a-b270-34d4bc505364 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action" status: 200 len: 32 microversion: 2.1 time: 0.206481 Sep 14 09:38:37.509992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.510148 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 737/3607] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:38:37 2022] POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:38:37.510750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.511509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.511997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.512427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.524801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:37.527773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:37.546559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:37.548436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.549017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.550332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.555205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:37.556418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:37.556889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:37.894455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:37.905149 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db315f21-6642-4e27-91ca-40bf2a627a43 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.431297 Sep 14 09:38:37.926512 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2871/3608] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:37 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:38.005019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d09b2ac-3a5a-4068-8810-27d21d0b9c24", "tag": "079a7c32-909b-41ab-ad4b-4c63974dbdbd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:38.011056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:38.017992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:38.018555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:38.018998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:38.020874 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35fca633-6cff-4ee1-b2ea-89c179b4e155 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.504065 Sep 14 09:38:38.038498 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 738/3609] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:37 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:38.051731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] Creating event network-changed:079a7c32-909b-41ab-ad4b-4c63974dbdbd for instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 on n-h1-851028-12 Sep 14 09:38:38.058919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6d002c89-7151-4164-9157-4f6188ca5137 req-d1b9f110-0102-4d8f-9517-61aa6eb925af service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062824 Sep 14 09:38:38.059265 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2872/3610] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:38:38.486943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:38.488157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:38.492187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:38.524158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:38.527162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:38.528127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:38.533518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:38.534195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:38.534936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:38.935640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:38.936498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:38.954328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:38.958662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:38.966215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:38.966969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:38.967977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:38.968791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:38.969859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:39.034069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:39.045714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97484b8d-881a-465c-9b85-671158c297ed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.562728 Sep 14 09:38:39.055999 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 739/3611] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:38 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:39.064676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:39.068474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:39.091705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:39.092644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:39.093699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:39.100368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:39.101559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:39.102174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:39.391314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:39.395204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:39.405127 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1731299d-b310-4d19-9331-b9181be2f10c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.473674 Sep 14 09:38:39.407060 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21b8f3f1-3365-4164-b032-42d85faa742c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.354861 Sep 14 09:38:39.408134 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2873/3612] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:38 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:39.408898 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 740/3613] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:39 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:39.434811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-997101703", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:39.532213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] validate_networks() for [('cddd25f6-377c-4af3-ba14-f3857c01c9d2', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:39.580617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:39.624693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:40.213807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:40.214465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:40.214687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:40.215563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:40.216208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:40.254385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.255877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.259085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.262761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.264907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.264907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.307758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Getting quotas for project 412ee460776a4060afcee7dd2217fb58. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:40.323366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Getting quotas for user 540eb30f57dc4ff7ade977e26cecebad and project 412ee460776a4060afcee7dd2217fb58. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:40.339537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:40.342191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:40.445429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:40.447323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:40.456967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:40.457489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39705171-475a-4f56-beaa-5373572a7c1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047867 Sep 14 09:38:40.458375 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2874/3614] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:40.462899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.467546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.468834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.471396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.473990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.476288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.497190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:40.497851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:40.527101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.527615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.528096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.528828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:40.529294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:40.529726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:40.882050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:40.894900 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-784b612f-794d-4127-b9ed-64eb4bc6bd79 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.456018 Sep 14 09:38:40.896077 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 741/3615] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:40 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:40.901202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b77ade12-8605-4e02-ab1c-78569380ff32 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:40.902219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b77ade12-8605-4e02-ab1c-78569380ff32 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:40.979523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b77ade12-8605-4e02-ab1c-78569380ff32 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:40.987481 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b77ade12-8605-4e02-ab1c-78569380ff32 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1216 microversion: 2.1 time: 0.090084 Sep 14 09:38:40.992299 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 742/3616] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:40 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:41.073613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:41.088569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc4194bc-6a3c-44cb-8f5d-3907423fdb92 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.606812 Sep 14 09:38:41.089411 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2875/3617] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:40 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:41.933222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:41.934639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:41.944631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:41.945599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:41.946602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:41.948426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:41.949924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:41.950885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:42.019449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:42.020820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:42.038836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:42.041034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:42.041582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:42.042986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:42.043480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:42.046915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:42.170209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:42.181725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb0d0f44-d998-4ce7-818c-94b6644d7ba4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1268 microversion: 2.1 time: 0.172941 Sep 14 09:38:42.182464 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2876/3618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:42 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:42.211148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:42.214441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:42.229247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:42.231673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:42.232661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:42.234421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:42.235124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:42.236136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:42.370533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:42.403184 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1ce17e3a-55cd-4dcb-bfbd-781262efcba4 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.482272 Sep 14 09:38:42.413384 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 743/3619] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:41 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:42.454599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:42.465646 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-453d1c26-ff71-4200-b5c6-23376d7c5c04 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.280006 Sep 14 09:38:42.466371 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2877/3620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:42 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:43.206604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:43.207302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:43.218210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.219360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.222523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.223592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.228322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.229226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.323817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1126568080", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:43.348862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:43.360940 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4785f00-6cca-4d13-8434-f6d9116ed2fb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1274 microversion: 2.1 time: 0.157622 Sep 14 09:38:43.362768 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 744/3621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:43 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:43.415209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] validate_networks() for None {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:43.442832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:43.445326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:43.453198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.454010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.454677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.455719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.456667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.457890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.725574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:43.738620 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f663100d-adf1-459d-83ca-ecf09b08f472 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.303831 Sep 14 09:38:43.744298 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 745/3622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:43 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:43.765628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:43.766310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:43.775359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.776595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.777049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.777785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.779002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.779760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.869110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:43.869538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:43.870016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:43.870429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:43.870818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:43.909801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.910812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.911672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.912874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:43.914680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:43.915127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:43.962754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Getting quotas for project b380b75f35f543e7a09fabaf873a15f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:43.985589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Getting quotas for user bc6dd5d197de4e888960d41bd82f03ba and project b380b75f35f543e7a09fabaf873a15f3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:44.016380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:44.020308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:44.075683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:44.090107 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a3a509f6-90a7-48d7-89cf-8966147a5307 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.336630 Sep 14 09:38:44.090633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 746/3623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:43 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:44.129716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54e123f2-6448-4b00-9a84-b91b87c05574 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811657 Sep 14 09:38:44.131367 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2878/3624] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:44.149620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e55dac9-5815-4037-a909-8934afff1f2a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:44.151855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7e55dac9-5815-4037-a909-8934afff1f2a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:44.258930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7e55dac9-5815-4037-a909-8934afff1f2a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:44.269402 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7e55dac9-5815-4037-a909-8934afff1f2a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1214 microversion: 2.1 time: 0.131067 Sep 14 09:38:44.273640 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 747/3625] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:44 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:44.392156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:44.392959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:44.404939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:44.405456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:44.405892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:44.406612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:44.418981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:44.419458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:44.754037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d09b2ac-3a5a-4068-8810-27d21d0b9c24", "name": "network-vif-plugged", "status": "completed", "tag": "079a7c32-909b-41ab-ad4b-4c63974dbdbd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:44.788727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:44.789350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:44.790037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:44.814916 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] Creating event network-vif-plugged:079a7c32-909b-41ab-ad4b-4c63974dbdbd for instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 on n-h1-851028-12 Sep 14 09:38:44.829282 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4a63ac1c-f18f-479e-93d0-6b5a2bcb5544 req-9b3feb53-7bd7-4fe1-8f17-2995d8c6bcb6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079257 Sep 14 09:38:44.833546 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 748/3626] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:38:44.847916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:44.850026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:44.857658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:44.858531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:44.859236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:44.860225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:44.860923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:44.861622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:45.117317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:45.130333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aad31bb4-5e6b-4380-b846-91db19e04ebf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.739957 Sep 14 09:38:45.136785 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2879/3627] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:44 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:45.142035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:45.145074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:45.171933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:45.172578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:45.172889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:45.174198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:45.176632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:45.179456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:45.179978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:45.185511 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-411b4e8e-675a-4ad0-a88e-0be2b7e77376 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.349543 Sep 14 09:38:45.197034 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 749/3628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:44 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:45.300658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:45.302121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:45.309862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:45.310349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:45.311043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:45.312029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:45.312711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:45.313431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:45.429383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:45.448031 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64d74f8c-e5e9-4dc8-888a-07f889c42297 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1266 microversion: 2.1 time: 0.150905 Sep 14 09:38:45.449503 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 750/3629] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:45 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:45.694636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:45.706015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-800e7009-423e-44ea-9de9-08416596d9aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.567837 Sep 14 09:38:45.708252 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2880/3630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:45 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:45.980712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf30564-dde0-40dd-b32c-c9cf6c3625d2", "tag": "57763bd1-8afa-4641-a8e4-2307aa8dbc45"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:45.998809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.004657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.005380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.034590 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] Creating event network-changed:57763bd1-8afa-4641-a8e4-2307aa8dbc45 for instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 on n-h1-851028-12 Sep 14 09:38:46.040790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0354c934-9b68-48ed-8ef0-207ea2ef0b4b req-64e5ffe7-b46b-4391-a333-30dbba216995 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064670 Sep 14 09:38:46.041973 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 751/3631] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:46.159172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:46.160939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:46.176494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.182796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.191227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.192685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.194342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.194997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.225379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:46.226615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:46.250823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.252130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.253381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.255006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.256989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.257728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.623354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:46.640497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c52aaf50-4731-43a3-82bf-70613d01beed tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.487567 Sep 14 09:38:46.642233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2881/3632] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:46 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:46.651856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:46.654464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:46.679709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.682530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.683210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.684303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.685002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.685904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.731797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:46.747484 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1d6e6698-eb1f-40c5-ad52-ac85617ef0ae tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1316 microversion: 2.1 time: 0.528988 Sep 14 09:38:46.748913 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 752/3633] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:46 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:46.769234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:46.773802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:46.793274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.794680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.795387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.798035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:46.798848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:46.799808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:46.841126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:46.841335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:46.864854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b3a3127-7e7e-4adf-9878-fb8dd2387193 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1272 microversion: 2.1 time: 0.219311 Sep 14 09:38:46.868796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2882/3634] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:46 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:47.041929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:47.052716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6eb0bbe7-f33e-457d-9193-f0254bd7af72 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.302210 Sep 14 09:38:47.064266 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 753/3635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:46 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:47.673502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:47.674734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:47.698743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:47.702116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:47.702798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:47.703840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:47.704960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:47.705582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:47.779410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:47.788351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:47.808541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:47.809141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:47.809594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:47.810361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:47.816308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:47.817450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.192646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:48.204847 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d414888a-5f7d-4cb4-96ae-32156c8cb49d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.539410 Sep 14 09:38:48.206089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2883/3636] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:47 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:48.212298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:48.213174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:48.220902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.222224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.222869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.224388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.225246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.226530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.305283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:48.325611 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4469fff7-6613-48d6-82bc-dce9032d3983 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1466 microversion: 2.1 time: 0.550321 Sep 14 09:38:48.349193 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 754/3637] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:47 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1466 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:48.357435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:48.358572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:48.367268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.368071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.368722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.369784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.370405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.371001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.626815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:48.638907 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94d340f4-3706-4a65-8fb1-fadc121289fa tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.430969 Sep 14 09:38:48.643585 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2884/3638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:48 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:48.657991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:48.660981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:48.679056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.679596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.680082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.682419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:48.684572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:48.688525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:48.794920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:48.814430 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c40c5bd3-fb9b-48a7-af1b-73ace57f0ecb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.463437 Sep 14 09:38:48.829486 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 755/3639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:48 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:49.085898 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ea31d27-6f8b-4216-805c-eb42f67700e7 tempest-ServersOnMultiNodesTest-1416543973 tempest-ServersOnMultiNodesTest-1416543973-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1619 microversion: 2.1 time: 0.440689 Sep 14 09:38:49.087024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2885/3640] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:48 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1619 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:49.111283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:49.111795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:49.123202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.123720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.124202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.124933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.125411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.126028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.161452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb4e37c-7add-4bb9-97b1-cc44e429f327", "tag": "37c8b85a-55ee-40b3-8b2e-20e33bb410c8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:49.178942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.187433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.190109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.220304 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] Creating event network-changed:37c8b85a-55ee-40b3-8b2e-20e33bb410c8 for instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 on n-h2-851028-12 Sep 14 09:38:49.232320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:38:49.236247 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e95180f1-313b-4124-9f27-c012540416b1 req-ed626c77-ddd3-44c8-a36c-9afda3feaa0a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078436 Sep 14 09:38:49.237178 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2886/3641] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:49.253677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:49.258849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:49.277519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.278469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.279313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.280642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.281443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.282974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.507225 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-367b4e87-7687-409f-9cc7-e542cdc3f333 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 204 len: 0 microversion: 2.1 time: 0.398710 Sep 14 09:38:49.510919 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 756/3642] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:38:49 2022] DELETE /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:38:49.518742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:49.519639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:49.526716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.527270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.527718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.528530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.528991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.529422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.799231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:49.819807 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53189ce4-badf-45bf-ab31-c16e2e38efc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.575075 Sep 14 09:38:49.833719 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2887/3643] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:49 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:49.845664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:49.846558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:49.857590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.858451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.859154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.860383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.862181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.863128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.882492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:49.897564 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6d2ffc52-2b18-4259-816d-7ffdf2ae8fde tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1472 microversion: 2.1 time: 0.383517 Sep 14 09:38:49.902647 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 757/3644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:49 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:49.910768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:49.911660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:49.932818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.933921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.934554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:49.936772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:49.937431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:49.938035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:50.142682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:50.151788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c235891-1f09-4c7f-9620-af89c1e1f832 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.247860 Sep 14 09:38:50.152642 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 758/3645] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:49 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:50.204973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:50.214632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f708327-1c5e-4817-bac1-29629a9ff7d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.374262 Sep 14 09:38:50.215223 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2888/3646] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:49 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:50.847688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:50.848605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:50.859416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:50.859824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:50.860293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:50.861012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:50.861477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:50.861914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:50.931288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:50.932842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:50.940848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:50.941524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:50.942118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:50.943012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:50.943869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:50.944601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:51.242037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:51.265022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5092e28-329a-40b1-b5d8-94bfb7637ed6 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1472 microversion: 2.1 time: 0.337672 Sep 14 09:38:51.267722 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2889/3647] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:50 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:51.292348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:51.293344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:51.303398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:51.305193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:51.306083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:51.307342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:51.309926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:51.310837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:51.599704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:51.611231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:51.613949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d99bc5c-ea44-4dd0-8863-d859689967e5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.332673 Sep 14 09:38:51.614781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2890/3648] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:51 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:51.631263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:51.632992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:51.640598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:51.641360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:51.642420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:51.643427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:51.644207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:51.644858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:51.699483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:51.710025 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c956179b-d7eb-402c-9090-70e13fae36e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.866735 Sep 14 09:38:51.713133 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 759/3649] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:50 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:51.987686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:52.012206 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e8be654-d11c-4d4f-bbc4-42f584d5f4d7 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.395608 Sep 14 09:38:52.014332 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2891/3650] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:51 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:52.083300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d09b2ac-3a5a-4068-8810-27d21d0b9c24", "name": "network-vif-deleted", "tag": "079a7c32-909b-41ab-ad4b-4c63974dbdbd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:52.098003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.098804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.099542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.116092 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] Creating event network-vif-deleted:079a7c32-909b-41ab-ad4b-4c63974dbdbd for instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 on n-h1-851028-12 Sep 14 09:38:52.126864 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-24b765a5-0a2e-43f3-8c1c-1bd5f1aab439 req-17380017-5226-464d-b598-a37ffd38bfc5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046165 Sep 14 09:38:52.131528 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 760/3651] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:52.294798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:52.298682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:52.317977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.319549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.321396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.322274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.322977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.323503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.365263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.366490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.367536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.368616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:38:52.440246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:52.449873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-543b0325-3dcf-44a1-afdf-61be117af925 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 200 len: 1306 microversion: 2.1 time: 0.160018 Sep 14 09:38:52.469001 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2892/3652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:52 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 1306 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:52.662423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:52.664434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:52.705696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.707459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.708374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.710606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.711640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.712472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.734869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:52.735491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:52.747982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.748753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.749359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:52.750363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:52.750989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:52.751580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.117786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:53.128588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:53.129314 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-838be937-90a6-40e6-b0fd-d5300e5ec518 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.398344 Sep 14 09:38:53.144151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2893/3653] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:52 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:53.144151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:53.144151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:53.152592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.153211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.153661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.155744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.156373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.156904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.159967 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-27cc3071-3a73-484b-af89-4081f7226f85 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.513600 Sep 14 09:38:53.179069 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 761/3654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:52 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:53.415106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:53.424840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcb43b6e-d0e6-4daa-8c03-95d6c0fad0f6 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.291958 Sep 14 09:38:53.428418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2894/3655] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:53 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:53.474885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:53.475543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 8d09b2ac-3a5a-4068-8810-27d21d0b9c24] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:53.491451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.493086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.493798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.494855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.495363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.496116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.527733 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 HTTP/1.1 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '8d09b2ac-3a5a-4068-8810-27d21d0b9c24'} Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:53.529823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. Sep 14 09:38:53.533658 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:53.535910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance 8d09b2ac-3a5a-4068-8810-27d21d0b9c24 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:53.537094 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4101b69b-bf78-4827-8f6c-2532389e5f88 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24" status: 404 len: 111 microversion: 2.1 time: 0.066332 Sep 14 09:38:53.538203 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 762/3656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:53 2022] GET /compute/v2.1/servers/8d09b2ac-3a5a-4068-8810-27d21d0b9c24 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:38:53.550812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:53.551867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:53.571976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.572524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.572983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.573736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.574198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.574629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.646752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:38:53.860356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88e335ca-218b-4ea5-9741-76a8e7416098 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 204 len: 0 microversion: 2.1 time: 0.316927 Sep 14 09:38:53.861302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2895/3657] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:38:53 2022] DELETE /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:38:53.869656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:53.870973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:53.879654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.886475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.887131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:53.888133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:53.888784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:53.889191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.155710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:54.157231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:54.161835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:54.171433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:54.190427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.190948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.191392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.192985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.194669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.195121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.266927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:54.273723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:54.289502 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ddbd25a3-e243-49cf-aea5-4fb231574246 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1471 microversion: 2.1 time: 0.423734 Sep 14 09:38:54.293657 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 763/3658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:53 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1471 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:54.301625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:54.302590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:54.313812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.314603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.317555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.326261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.326916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.327463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.518818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:54.529688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-374915da-f2e1-42fd-b0d2-584dbcb10d35 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.378603 Sep 14 09:38:54.530472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2896/3659] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:54 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:54.538196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:54.540002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:54.548406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.549309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.549924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.551045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:54.551654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:54.552391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:54.638533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:54.658149 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-09158029-b63c-445a-a5a4-3ffe1859f922 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.362640 Sep 14 09:38:54.676977 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 764/3660] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:54 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:54.735580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:54.746681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9ec264d-babb-40bd-a332-957d148a8387 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.214107 Sep 14 09:38:54.759932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2897/3661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:54 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:55.249298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-426930392", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:55.309123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] validate_networks() for [('d41fa8d0-46d6-4c7d-bba4-394590fa7dfa', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:38:55.323615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:55.324064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:55.331411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.332204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.332644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.333353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.334420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.335537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.501075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:55.516467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1cf925a-f4a1-4198-9002-276cf3e09e4e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1471 microversion: 2.1 time: 0.197965 Sep 14 09:38:55.517701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2898/3662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:55 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:55.563807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:55.564660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:55.578028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.578538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.578979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.579696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.585085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.585743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.781906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:55.790924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f4869d23-0ffe-4dc0-b382-c38529b462e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.231718 Sep 14 09:38:55.791710 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2899/3663] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:55 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:55.798382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:55.799327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:55.807049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.807930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.808646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.809474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:55.810012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:55.810522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:55.985989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:55.995554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0431371-094e-4fe9-a0bc-c46d167eb9a8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.202043 Sep 14 09:38:56.011488 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2900/3664] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:55 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:56.011488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:56.011488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:56.012004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:38:56.012004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:38:56.012004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:38:56.012004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:38:56.012004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:38:56.012340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.012340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.012340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.012340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.013093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.014612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.023440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.023952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.024934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.026284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.026927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.028739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.054743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Getting quotas for project 8f25af5085a145e5978493c83c691e03. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:38:56.060897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Getting quotas for user 569e41fc56684e52a0db170403751151 and project 8f25af5085a145e5978493c83c691e03. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:38:56.076122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:38:56.080124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:38:56.191973 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94f6b1a0-7f3f-41da-9075-86ee660845ad tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219069 Sep 14 09:38:56.192956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 765/3665] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:38:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:38:56.206564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31f7f9b0-81b2-401e-918f-8ccc5677b0be tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:56.207468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-31f7f9b0-81b2-401e-918f-8ccc5677b0be tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:56.281576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:56.292153 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0643562d-df36-4b10-b05c-4dd49112dec3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.292561 Sep 14 09:38:56.294592 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2901/3666] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:55 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:56.299452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-31f7f9b0-81b2-401e-918f-8ccc5677b0be tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:56.306754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31f7f9b0-81b2-401e-918f-8ccc5677b0be tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1223 microversion: 2.1 time: 0.106189 Sep 14 09:38:56.308045 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 766/3667] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:56 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:56.544450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:56.546047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:56.573446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.574039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.575107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.577735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.585875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.606602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.649805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebd6f826-a7d0-4864-a4a9-0db29a739786", "name": "network-vif-deleted", "tag": "66a7146c-18f9-49f6-a42e-b604316b39a0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:56.677328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.679486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.679841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.703616 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] Creating event network-vif-deleted:66a7146c-18f9-49f6-a42e-b604316b39a0 for instance ebd6f826-a7d0-4864-a4a9-0db29a739786 on n-h2-851028-12 Sep 14 09:38:56.728544 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a8ed41ad-727e-4672-ad80-b79adc5cfa15 req-9b1c03db-2037-4466-844f-a1d47a6e442a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083263 Sep 14 09:38:56.733290 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 767/3668] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:56.836360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:56.840947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:56.842835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:56.851286 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-98c2ea5c-2db1-4176-b918-a6af4dfce25c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1429 microversion: 2.1 time: 0.311228 Sep 14 09:38:56.852101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2902/3669] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:56 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1429 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:56.867415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.870242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.874424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:56.875648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:56.876361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:56.877008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.025675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:57.026741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:57.042328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.045052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.045927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.048118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.050905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.051625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.185721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:57.203070 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e2bd10b-572a-47f7-8d78-dec24c052691 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.389842 Sep 14 09:38:57.204233 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 768/3670] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:56 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:57.332563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:57.334902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:57.345573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.348048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.349004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.350862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.351630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.352874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.414335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:57.425553 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9bbcb9b-1d2d-4221-9986-438df37c7ce8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.404473 Sep 14 09:38:57.425839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2903/3671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:57 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:38:57.433530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:57.434554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:57.441323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.442121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.442808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.444179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.444934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.445980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.620295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:57.631719 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a42ba8f5-9d4b-4d25-8552-f25d95cdfd50 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.309384 Sep 14 09:38:57.648808 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 769/3672] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:57 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:57.653997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf30564-dde0-40dd-b32c-c9cf6c3625d2", "name": "network-vif-plugged", "status": "completed", "tag": "57763bd1-8afa-4641-a8e4-2307aa8dbc45"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:57.664426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.665244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.665901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.681919 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] Creating event network-vif-plugged:57763bd1-8afa-4641-a8e4-2307aa8dbc45 for instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 on n-h1-851028-12 Sep 14 09:38:57.688597 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9ecce724-964b-464d-9fd2-1d471e231b2b req-1a37effb-f8ac-4350-87eb-1775b7d66ea0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037906 Sep 14 09:38:57.689718 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 770/3673] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:38:57.701132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:57.711421 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c2db08e-0f59-49d2-8373-fdf79ad906bc tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1219 microversion: 2.1 time: 0.282309 Sep 14 09:38:57.712209 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2904/3674] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:57 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:57.877672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:57.878370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:57.893700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.894044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.913463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:57.914248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:57.914723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:57.915150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.012042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.012546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.012987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.013446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid ebd6f826-a7d0-4864-a4a9-0db29a739786 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:38:58.093197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:58.113229 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5cf6ecbc-329c-45c6-8f5f-8779d1672e1f tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 200 len: 1307 microversion: 2.1 time: 0.239722 Sep 14 09:38:58.121299 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 771/3675] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:57 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:58.238428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:58.239281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:58.252365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:58.261506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.262438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.263192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.266112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.266908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.267658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.324978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:58.470327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:58.472474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:58.503042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.506279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.510999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.520933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.522750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.527401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.609125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:58.678617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:58.687593 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ce61a36-ed98-48d9-8462-830be39eb4aa tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1316 microversion: 2.1 time: 0.454675 Sep 14 09:38:58.690482 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2905/3676] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:58 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:58.714356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:58.714984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:58.738317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.739345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.740201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.742018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.742750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.743457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.886735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:58.896885 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-810ddc4d-196b-4bf9-9033-6f3d3050a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.436779 Sep 14 09:38:58.899383 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 772/3677] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:58 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:58.905408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:58.906378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:58.918410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.919413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.920231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:58.921188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:58.921867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:58.922514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.055924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:59.068787 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cef80123-5203-4ad4-87e5-6b9e0ef8f387 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1275 microversion: 2.1 time: 0.167499 Sep 14 09:38:59.072050 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 773/3678] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:58 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:59.113708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:59.132082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43210a24-79c2-4284-9b46-9be5e1200ecb tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.439345 Sep 14 09:38:59.133200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2906/3679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:58 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:59.138857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:59.139801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: ebd6f826-a7d0-4864-a4a9-0db29a739786] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:59.148860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.149691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.150356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.151735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.152490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.153206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.170514 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 HTTP/1.1 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ebd6f826-a7d0-4864-a4a9-0db29a739786'} Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:38:59.172694 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. Sep 14 09:38:59.176600 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:38:59.180521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance ebd6f826-a7d0-4864-a4a9-0db29a739786 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:38:59.181636 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f49012a-68d8-41ba-9140-6d17ab230849 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786" status: 404 len: 111 microversion: 2.1 time: 0.048406 Sep 14 09:38:59.183023 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 774/3680] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:59 2022] GET /compute/v2.1/servers/ebd6f826-a7d0-4864-a4a9-0db29a739786 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:38:59.194672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:59.195257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:59.206663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.207436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.212850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.213654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.215666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.216377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.309614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:38:59.498917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c821c3d-7ae0-40a5-b14a-4dfc6fea8730 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 204 len: 0 microversion: 2.1 time: 0.311431 Sep 14 09:38:59.502894 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2907/3681] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:38:59 2022] DELETE /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:38:59.509601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:59.511034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:59.522777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:38:59.525637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.528418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.531553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.532457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.533048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.537100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.736718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:59.736718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:59.751841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.752466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.753147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.753946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.754410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.754844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.795479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:38:59.805651 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-72bbc35a-340e-4db7-8399-1dc697e003a8 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1473 microversion: 2.1 time: 0.301354 Sep 14 09:38:59.806250 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 775/3682] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:59 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:38:59.820197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb4e37c-7add-4bb9-97b1-cc44e429f327", "name": "network-vif-plugged", "status": "completed", "tag": "37c8b85a-55ee-40b3-8b2e-20e33bb410c8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:38:59.837183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.838152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.839522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.863062 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] Creating event network-vif-plugged:37c8b85a-55ee-40b3-8b2e-20e33bb410c8 for instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 on n-h2-851028-12 Sep 14 09:38:59.871108 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4773390e-7212-4c95-81d7-addf76e66529 req-99847a26-582d-432a-bc66-d1f0eddd014f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059934 Sep 14 09:38:59.871829 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 776/3683] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:38:59.926142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:38:59.927303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:38:59.937302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.938806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.939852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:38:59.941003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:38:59.941541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:38:59.942290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.026279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:00.037909 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ca24d11-f1a6-4bf4-ab7b-04284244d6dd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1506 microversion: 2.1 time: 0.306892 Sep 14 09:39:00.040629 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2908/3684] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:59 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:00.070328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:00.071823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:00.079168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.079661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.080131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.080867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.081320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.082005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.126540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:00.156907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:00.166224 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9dccdfc-b571-4e75-b847-9d785552ec4e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.244482 Sep 14 09:39:00.167378 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 777/3685] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:38:59 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:00.173635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:00.174405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:00.181284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.182031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.182478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.183190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.183656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.184124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.246395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8e82711-7e9d-4f2b-965a-c77d1383406f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 204 len: 0 microversion: 2.1 time: 0.182842 Sep 14 09:39:00.247451 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2909/3686] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:00 2022] DELETE /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:39:00.252906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:00.253850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:00.261096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.262427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.262999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.263877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.264460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.264955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.265475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:00.276454 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-23d33b89-daa7-48b2-b349-cc1f20bd3493 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1281 microversion: 2.1 time: 0.107670 Sep 14 09:39:00.277234 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 778/3687] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:00 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:00.283663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:00.284384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:00.293682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.294482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.295123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.296073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.296647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.297271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.529858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:00.533042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:00.546862 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee3507a2-4df9-4e7c-b083-753bcce39c07 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.296952 Sep 14 09:39:00.548085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2910/3688] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:00 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:00.577280 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca3baa82-1c4c-4d23-bb26-0113ccf04a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1512 microversion: 2.1 time: 0.298452 Sep 14 09:39:00.577976 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 779/3689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:00 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:00.831219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:00.832858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:00.842102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.842750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.843189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:00.844275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:00.855779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:00.856694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.023502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:01.031769 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a445d43c-b058-457d-ba42-2760bff80340 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1473 microversion: 2.1 time: 0.205802 Sep 14 09:39:01.032509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2911/3690] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:00 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1473 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:01.190976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:01.191589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:01.198206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.198672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.199102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.199786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.200263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.200713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.305335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:01.305970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:01.313013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.313763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.314133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.314863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.315328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.315788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.348016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:01.357873 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-435a3586-0d31-44ba-aaf9-46d361babaea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.170777 Sep 14 09:39:01.359207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 780/3691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:01 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:01.470829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:01.479868 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f631ca2-5abd-4e32-91dc-d113dfafafbf tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.179095 Sep 14 09:39:01.480498 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2912/3692] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:01 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:01.574973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:01.575876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:01.585331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.585999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.586445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.587367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.588348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.589088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.604210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:01.605252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:01.622637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.623486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.623952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.624678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:01.625129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:01.629413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:01.802890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:01.812025 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ef28db3-3ae1-49bd-8400-029e604d8c3d tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1314 microversion: 2.1 time: 0.240862 Sep 14 09:39:01.813177 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 781/3693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:01 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:01.953279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:01.978568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9eeb120-1ed3-4e55-9f87-08abc631705f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1512 microversion: 2.1 time: 0.378912 Sep 14 09:39:01.982885 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2913/3694] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:01 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:02.057489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:02.058571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:02.065435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.066214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.066875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.069201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.069908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.070559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.384191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:02.385421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:02.395286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.396788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.397752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.398859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.399538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.400399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.628848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:02.640564 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0900e2e-5e7b-4f5e-94b1-176e6b78b688 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1473 microversion: 2.1 time: 0.588201 Sep 14 09:39:02.641878 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 782/3695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:02 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1473 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:02.653217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:02.653976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:02.676867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.680083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.680886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.683595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.685802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.687671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.724859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:02.736424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51bc782b-f6a2-4104-b48c-4e91df7c13e4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.357599 Sep 14 09:39:02.746286 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2914/3696] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:02 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:02.838842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:02.839547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:02.846845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.852672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.853406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:02.854338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:02.854960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:02.855925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.131436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:03.140193 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-109abcb0-239e-4610-b571-6084e47fda0d tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.497085 Sep 14 09:39:03.142498 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 783/3697] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:02 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:03.154759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf30564-dde0-40dd-b32c-c9cf6c3625d2", "name": "network-vif-deleted", "tag": "57763bd1-8afa-4641-a8e4-2307aa8dbc45"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:03.180040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.180901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.184252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.216723 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] Creating event network-vif-deleted:57763bd1-8afa-4641-a8e4-2307aa8dbc45 for instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 on n-h1-851028-12 Sep 14 09:39:03.230120 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-699cc090-f196-4d1b-a3e4-e8106b6b1007 req-2818281d-deeb-43d4-8d30-5923f80a6f8f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086121 Sep 14 09:39:03.234476 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 784/3698] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:03.248285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:03.255012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:03.262005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:03.299842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.300634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.304626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.305906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.307363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.308395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.316337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-110c8d02-95c1-4498-8499-be532ef87e5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1462 microversion: 2.1 time: 0.482103 Sep 14 09:39:03.317742 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2915/3699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:02 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1462 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:03.345496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbfb53fe-26d8-4576-963c-81ca712f0545", "device": "/dev/sdb"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:03.353553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.354399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.355182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.355888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'fault' on Instance uuid cdf30564-dde0-40dd-b32c-c9cf6c3625d2 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:03.356056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:03.390549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.392497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.394185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.395971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.399038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.401473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.430093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:03.441331 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31d1db9e-d091-418d-bc05-c53d6691d9b7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1306 microversion: 2.1 time: 0.204999 Sep 14 09:39:03.442577 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 785/3700] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:03 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1306 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:03.674517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:03.675422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:03.698084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.698856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.700684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.702190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.706236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.707717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.827536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:03.841284 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d70f26e8-a0aa-487a-8205-0e2b4c8fc894 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1431 microversion: 2.1 time: 0.177619 Sep 14 09:39:03.842927 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 786/3701] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:03 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1431 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:03.848685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f7a169-6843-4bf0-b673-101e1fdc1127", "name": "network-vif-deleted", "tag": "36fec756-c63b-445e-b978-e32182880b81"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:03.861654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.863314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.863997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.881224 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] Creating event network-vif-deleted:36fec756-c63b-445e-b978-e32182880b81 for instance c0f7a169-6843-4bf0-b673-101e1fdc1127 on n-h2-851028-12 Sep 14 09:39:03.900502 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c1f42bb3-5be8-4e1b-a719-93590b429d65 req-017c20ae-fbfe-4435-8796-1231e41dde67 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055478 Sep 14 09:39:03.904648 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 787/3702] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:03.921466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:03.922885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:03.934586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.936180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.937116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.938996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:03.939678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:03.940399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:03.943710 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-827b8ae9-fdca-4c6c-ba12-ce39751c77a2 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "POST /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605887 Sep 14 09:39:03.945131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2916/3703] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:39:03 2022] POST /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327/os-volume_attachments => generated 194 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:04.168995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:04.169711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:04.186150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.189467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.190110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.191012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.192450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.197616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.232210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:04.309962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:04.326293 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3b7f320-668b-4cc2-ae2d-13584a25cda7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.415160 Sep 14 09:39:04.330797 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 788/3704] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:03 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:04.468961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:04.469837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:04.476830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.477663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.478300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.479268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.480052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.480694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.521719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.522762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.523459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.524180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'fault' on Instance uuid cdf30564-dde0-40dd-b32c-c9cf6c3625d2 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:04.603126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:04.612107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:04.617729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad49203a-f925-4121-a9bf-cde2526856fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 200 len: 1306 microversion: 2.1 time: 0.151447 Sep 14 09:39:04.619427 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 789/3705] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:04 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 1306 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:04.624449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9662cc7-96df-4be1-b2fc-c3434c86a9eb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.459546 Sep 14 09:39:04.626375 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2917/3706] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:04 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:04.890045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:04.894279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:04.936441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.937510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.938169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:04.939191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:04.940050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:04.940780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.007222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.008016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.008618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.009245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid c0f7a169-6843-4bf0-b673-101e1fdc1127 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:05.013342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:05.097116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:05.106456 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d50d809a-1fbf-467d-b763-01ec083f3099 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 200 len: 1307 microversion: 2.1 time: 0.238948 Sep 14 09:39:05.122233 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 790/3707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:04 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:05.249729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd401c9-3332-4b2f-b6e0-4030c5f62216", "tag": "f8237e67-f8b1-43e2-a1a0-3e8777eace7c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:05.261690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.262427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.263275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.279697 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] Creating event network-changed:f8237e67-f8b1-43e2-a1a0-3e8777eace7c for instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 on n-h1-851028-12 Sep 14 09:39:05.289405 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fc6fe988-b181-4fc1-8492-40b61af6791c req-e34ad427-6c63-45a9-9b45-39892fd00e5f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043051 Sep 14 09:39:05.290432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2918/3708] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:05.355582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:05.356233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:05.363115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.363617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.364109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.364829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.366184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.366626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.642961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:05.644917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:05.651796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.652464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.653007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.653847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.654412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.654948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.677207 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 HTTP/1.1 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cdf30564-dde0-40dd-b32c-c9cf6c3625d2'} Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:05.680296 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:05.685364 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:05.687054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:05.688076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fa17225e-0beb-426f-8ab6-8d5d66576899 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 404 len: 111 microversion: 2.1 time: 0.049628 Sep 14 09:39:05.688748 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2919/3709] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:05 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:05.693820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:05.694533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:05.701009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.701805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.702317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.703143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.703879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.704358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.855749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:05.864851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e8d712a-7a56-49b9-bff0-c24463e9a532 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.174798 Sep 14 09:39:05.866395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2920/3710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:05 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:05.880264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:05.880264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:05.880264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.880264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.880264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.880933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:05.881553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:05.882113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:05.904834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:05.915159 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af28a7f9-c0e7-43da-b71a-61defbd08d0c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.563551 Sep 14 09:39:05.916138 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 791/3711] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:05 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:06.064252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:06.072663 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6be9ce6-1252-4331-b415-121d619415a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.204924 Sep 14 09:39:06.073762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2921/3712] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:05 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:06.132984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.133815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c0f7a169-6843-4bf0-b673-101e1fdc1127] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.142221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:06.147076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.148452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.150940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.151879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.153730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.154505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.209687 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 HTTP/1.1 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'c0f7a169-6843-4bf0-b673-101e1fdc1127'} Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:06.211371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance c0f7a169-6843-4bf0-b673-101e1fdc1127 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:06.216231 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77e6f8e7-cec3-47b6-ae5b-80cfa0ce8b37 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127" status: 404 len: 111 microversion: 2.1 time: 0.085383 Sep 14 09:39:06.222855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.223362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.232442 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 792/3713] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/c0f7a169-6843-4bf0-b673-101e1fdc1127 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:06.243236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.245130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.247054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.252317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.253005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.253647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.295635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:06.327165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-141fd2e9-4211-4c5c-8816-72a8bbfe35e7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-141fd2e9-4211-4c5c-8816-72a8bbfe35e7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 163 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": 12345, "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 12345 Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:06.335186 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-141fd2e9-4211-4c5c-8816-72a8bbfe35e7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-141fd2e9-4211-4c5c-8816-72a8bbfe35e7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024565 Sep 14 09:39:06.340564 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 793/3714] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:06 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:06.344593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:06.350669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.351458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.362017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.363483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.364476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.366657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.367487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.369444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.464691 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-209afc75-c63c-40d6-bb10-7d11979fce12 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 204 len: 0 microversion: 2.1 time: 0.245484 Sep 14 09:39:06.465279 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2922/3715] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:06 2022] DELETE /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:06.477518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.478686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.488256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.489119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.489819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.492029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.493224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.493895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.533217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:06.672250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:06.675753 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f9cc848-0dde-4909-8288-ba992e776073 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 204 len: 0 microversion: 2.1 time: 0.204126 Sep 14 09:39:06.676829 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2923/3716] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:06 2022] DELETE /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:39:06.684672 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f54eb50f-e3a6-4e48-acbf-0bdb86e66251 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.340786 Sep 14 09:39:06.685566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.685700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 794/3717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:06.686176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.717694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.718586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.721915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.722417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.722857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.723630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.724188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.724819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.731075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.731669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.732213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.733031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.733557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.734058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.935974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:06.951510 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6ffb4fa-a043-4e63-9473-76babf3557e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.240947 Sep 14 09:39:06.952692 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 795/3718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:06.958500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:06.959407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:06.966573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.969955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.970770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.971715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:06.972516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:06.973261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:06.981266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:06.989565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d5c3546-a4fa-4d5a-b446-6ccbe0a6041e tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1474 microversion: 2.1 time: 0.308146 Sep 14 09:39:06.990820 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2924/3719] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:07.012334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:07.013089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:07.020326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:07.023226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:07.023226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:07.023226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:07.023226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:07.023929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:07.262384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:07.263146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:07.274069 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-222da407-a191-4b2f-a993-8a26c61c0d36 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.319605 Sep 14 09:39:07.274934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58eaa4d1-9467-4ca2-a9dc-b6a8044fe67b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.269760 Sep 14 09:39:07.279031 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2925/3720] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:07.283506 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 796/3721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:06 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:08.018029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:08.019024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:08.027722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.028503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.029815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.031436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.032249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.033154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.305150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:08.307187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:08.319239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.320100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.320762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.338593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.339355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.340079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.359066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:08.375028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-469406ad-1846-467f-b962-4713ea12fdcd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1474 microversion: 2.1 time: 0.360906 Sep 14 09:39:08.376043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2926/3722] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:08 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:08.392256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:08.393787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:08.408225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.415272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.416070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.417572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:08.418233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:08.418881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:08.942637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:08.959763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b931e0bb-5055-4cad-8aeb-9aff768c907e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 0.581927 Sep 14 09:39:08.962694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2927/3723] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:08 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:09.225566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:09.238331 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80ff66d9-532a-43cc-896b-6c6d3090291f tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.939797 Sep 14 09:39:09.253610 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 797/3724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:08 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:09.407421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:09.409475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:09.424961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:09.426013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:09.429584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:09.431411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:09.432808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:09.438174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:09.695403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:09.716287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48bf0923-fa92-4dc4-aa3a-2b00c32e43bd tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1474 microversion: 2.1 time: 0.318352 Sep 14 09:39:09.736559 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2928/3725] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:09 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:09.994038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:09.999360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:10.020875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.028346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.031250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.032137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.032827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.033474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.094712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8701ba-a845-4561-bc3f-35ef1a1a1fb2", "name": "network-vif-deleted", "tag": "07349cec-6074-4fe7-9abc-1b2ccc21e64b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:10.170412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.171206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.176188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.219209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] Creating event network-vif-deleted:07349cec-6074-4fe7-9abc-1b2ccc21e64b for instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 on n-h1-851028-12 Sep 14 09:39:10.261883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d25505fd-9842-44d7-9f45-39e23d595542 req-d2ffcdcf-d711-466e-ac36-ced02d6a063f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175159 Sep 14 09:39:10.264873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2929/3726] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:10.290608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:10.292155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:10.332232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.338442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.339070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.342190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.344320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.346331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.753894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:10.790020 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb882cfa-0a16-415d-842d-34cadb81153e tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.518342 Sep 14 09:39:10.791418 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2930/3727] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:10 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:10.800176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:10.801021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:10.808990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.809797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.810406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.811338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.811992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.813064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.923999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:10.924813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:10.925415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:10.926135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:10.983502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:10.997695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9696cfa7-1baa-4d96-9d61-f5af33640fad tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 200 len: 1308 microversion: 2.1 time: 0.204810 Sep 14 09:39:10.998785 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2931/3728] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:10 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:11.007273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97521246-a766-4c7a-a5b6-232eca2b8938 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-974545414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ed7fa5c2-b2e4-4a3d-982a-72e12101caba", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:11.045681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:11.060520 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9de1ef3-d382-455a-98fe-d30c78a503d5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1522 microversion: 2.1 time: 1.078496 Sep 14 09:39:11.061835 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 798/3729] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:09 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1522 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:11.146145 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-97521246-a766-4c7a-a5b6-232eca2b8938 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97521246-a766-4c7a-a5b6-232eca2b8938 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 357 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-974545414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ed7fa5c2-b2e4-4a3d-982a-72e12101caba", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: exception: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-974545414', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ed7fa5c2-b2e4-4a3d-982a-72e12101caba'}], 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:11.166228 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. Sep 14 09:39:11.171210 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:11.179009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97521246-a766-4c7a-a5b6-232eca2b8938 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Block Device ed7fa5c2-b2e4-4a3d-982a-72e12101caba is not bootable. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:11.181795 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97521246-a766-4c7a-a5b6-232eca2b8938 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.181718 Sep 14 09:39:11.182526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2932/3730] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:11.191542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:11.192509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:11.200400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.200893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.201496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.202392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.202999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.203633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.433391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:11.454392 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a20323b-db8d-4f9c-9c02-4a0f2652b4e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.254891 Sep 14 09:39:11.455558 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 799/3731] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:11 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:11.485417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:11.486259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:11.494219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.495054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.495508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.496430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.496916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.497517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.520599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:11.684628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:11.696066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8203cc61-7c62-4bd1-adee-498911116ffb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.217507 Sep 14 09:39:11.697381 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2933/3732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:11 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:11.725625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd401c9-3332-4b2f-b6e0-4030c5f62216", "name": "network-vif-plugged", "status": "completed", "tag": "f8237e67-f8b1-43e2-a1a0-3e8777eace7c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:11.739019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.739769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.740550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.756170 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] Creating event network-vif-plugged:f8237e67-f8b1-43e2-a1a0-3e8777eace7c for instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 on n-h1-851028-12 Sep 14 09:39:11.762875 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d7cd6416-154c-482c-8382-53891b208a06 req-b67873e3-95e3-4d2c-b8b8-e174b579d267 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044918 Sep 14 09:39:11.764143 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 800/3733] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:11.837616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:11.839215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:11.863959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.868033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.872347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:11.875020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:11.878625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:11.879489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.051601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.052596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.066672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.068918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.069363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.072321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.073437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.076887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.119347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:12.120488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 HTTP/1.1 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4e8701ba-a845-4561-bc3f-35ef1a1a1fb2'} Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.123926 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. Sep 14 09:39:12.128808 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.133052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8608456a-54d8-4958-ad19-685b57d186d1 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.303053 Sep 14 09:39:12.134229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2934/3734] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:11 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:12.139472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance 4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:12.141192 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-73bfacd5-44fe-4d0c-85e6-2333ce01aec7 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2" status: 404 len: 111 microversion: 2.1 time: 0.095321 Sep 14 09:39:12.142087 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 801/3735] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:12 2022] GET /compute/v2.1/servers/4e8701ba-a845-4561-bc3f-35ef1a1a1fb2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:12.157501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.158129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.168717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.169304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: c1b6512b-6ee7-46ec-924d-c728108e92b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.177646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.178370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.181415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.183793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.188056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.188938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.190479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.191070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.192501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.193983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.195638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.196176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.248496 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 HTTP/1.1 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'c1b6512b-6ee7-46ec-924d-c728108e92b6'} Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.250243 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance c1b6512b-6ee7-46ec-924d-c728108e92b6 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0d43229-0701-48b1-9ba4-cfe52b8dd827 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6" status: 404 len: 111 microversion: 2.1 time: 0.104077 Sep 14 09:39:12.255628 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 802/3736] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:12 2022] GET /compute/v2.1/servers/c1b6512b-6ee7-46ec-924d-c728108e92b6 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:12.261891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb447fc0-6bd5-4a5a-985f-a22262f62aec tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.292236 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bb447fc0-6bd5-4a5a-985f-a22262f62aec tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:39:12.405446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:12.413825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4024cced-c66b-4986-819f-6c3a91c24601 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1502 microversion: 2.1 time: 0.276985 Sep 14 09:39:12.414248 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2935/3737] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:12 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:12.438028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b6512b-6ee7-46ec-924d-c728108e92b6", "name": "network-vif-deleted", "tag": "aacaf614-227d-455a-892c-46431faa8b9e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:12.449042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.449531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.449967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.463345 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] Creating event network-vif-deleted:aacaf614-227d-455a-892c-46431faa8b9e for instance c1b6512b-6ee7-46ec-924d-c728108e92b6 on n-h2-851028-12 Sep 14 09:39:12.468489 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a0fd7b1f-4bb4-4f5a-b5b0-70ce5b090c98 req-c3c740f8-2911-4288-a5b1-fb23c3a2d4bf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041589 Sep 14 09:39:12.468957 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2936/3738] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:12.477970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.478768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.486464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.487173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.487619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.488352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.489002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.489553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.636693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:12.645485 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3509802-9928-4557-a18e-ab90fda86586 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1515 microversion: 2.1 time: 0.175119 Sep 14 09:39:12.646199 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2937/3739] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:12 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:12.669294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:12.673022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 89b4471f-3bab-4a10-bdc1-0221a4ab6519] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.680298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/89b4471f-3bab-4a10-bdc1-0221a4ab6519/action HTTP/1.1 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 14 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: {"rescue": {}} Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '89b4471f-3bab-4a10-bdc1-0221a4ab6519', 'body': {'rescue': {}}} Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.688064 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 404 to user: Instance 89b4471f-3bab-4a10-bdc1-0221a4ab6519 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32de924b-e56f-4f40-89b5-8fa6e290456a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/89b4471f-3bab-4a10-bdc1-0221a4ab6519/action" status: 404 len: 111 microversion: 2.1 time: 0.024841 Sep 14 09:39:12.698109 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2938/3740] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:12 2022] POST /compute/v2.1/servers/89b4471f-3bab-4a10-bdc1-0221a4ab6519/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:12.701071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:12.701810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.711147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.711642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.712118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.712823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.713281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.713706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.787957 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-665a949b-8aac-46de-aab7-9b517deca1bf tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action" status: 202 len: 0 microversion: 2.1 time: 0.090401 Sep 14 09:39:12.791795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2939/3741] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:12 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:39:12.797265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:12.797963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:12.805288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.805777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.806211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.806925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:12.807358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:12.807779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:12.975860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:12.985647 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-859fbe39-3d7a-4db2-9ede-0280ae8cd0d3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1520 microversion: 2.1 time: 0.191945 Sep 14 09:39:12.986510 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2940/3742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:12 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:13.163825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.164481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.176845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.181427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.183253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.184595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.191274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.192425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.305132 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-bb447fc0-6bd5-4a5a-985f-a22262f62aec tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 41936. Sep 14 09:39:13.314875 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb447fc0-6bd5-4a5a-985f-a22262f62aec tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/43d4618d-f01f-45e3-948a-362c9ba5b4fa" status: 204 len: 0 microversion: 2.1 time: 1.057548 Sep 14 09:39:13.315628 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 803/3743] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:39:12 2022] DELETE /compute/v2.1/os-server-groups/43d4618d-f01f-45e3-948a-362c9ba5b4fa => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:13.326610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.331535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.350828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.351660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.352337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.353224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.353834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.354439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.397709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:13.425480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:13.437684 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1220e2c5-63d6-4c31-ab28-c8f713660e5c tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1323 microversion: 2.1 time: 0.280367 Sep 14 09:39:13.452345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2941/3744] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:13 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:13.517795 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-54255b72-7f5f-41a3-8b2a-5c8e019bc24b tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 204 len: 0 microversion: 2.1 time: 0.194783 Sep 14 09:39:13.519111 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 804/3745] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:13 2022] DELETE /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:13.534946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.535805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.554538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:13.582742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.583568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.591293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.593850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.594943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.596327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.654177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:13.657150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb235b89-7784-4e79-a16b-07f71478c4ce tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-389951523", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "destination_type": "local"}, {"source_type": "volume", "uuid": "6222b2d3-6d60-43b7-ae9a-ad7e8bfa874a", "destination_type": "invalid"}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb235b89-7784-4e79-a16b-07f71478c4ce tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 494 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-389951523", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "destination_type": "local"}, {"source_type": "volume", "uuid": "6222b2d3-6d60-43b7-ae9a-ad7e8bfa874a", "destination_type": "invalid"}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-389951523', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6222b2d3-6d60-43b7-ae9a-ad7e8bfa874a', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'invalid' Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:13.668122 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 14 09:39:13.674834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:13.681982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bb235b89-7784-4e79-a16b-07f71478c4ce tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:13.681982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bb235b89-7784-4e79-a16b-07f71478c4ce tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.032443 Sep 14 09:39:13.682586 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 805/3746] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:13 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:13.691698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.694261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.706583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.707367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.712674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.713703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.714331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.715082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.755702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e7eba5a-00ef-4d88-93ef-44bdd15d097d tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 204 len: 0 microversion: 2.1 time: 0.228779 Sep 14 09:39:13.756398 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2942/3747] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:13 2022] DELETE /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:13.765181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.766104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.774020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.774517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.774955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.775662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.776589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.777028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.922209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:13.933121 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6e6745f1-b993-4188-b214-27941c8d6945 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.247425 Sep 14 09:39:13.933731 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 806/3748] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:13 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:13.948202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:13.956637 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0bf11ecb-80a1-4289-8e5b-ed053649ccba tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1475 microversion: 2.1 time: 0.195735 Sep 14 09:39:13.957794 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2943/3749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:13 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:13.959883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:13.960548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:13.966819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.967304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.967736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:13.968472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:13.968927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:13.969360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.011412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.012791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.019524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.020107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.020545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.021458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.022025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.022224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.124169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.135928 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ddf213b-82c7-489d-8003-85842c6db764 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.180565 Sep 14 09:39:14.136542 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 807/3750] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:13 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:14.192344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.209325 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b1dea07-0511-45e3-a0c9-dd749e35735d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1500 microversion: 2.1 time: 0.201229 Sep 14 09:39:14.210751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2944/3751] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:14.233496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:14.236394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.248923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.249541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.250048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.250836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.251389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.251954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.279406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98cc0836-9176-4897-b774-f9a682e97c4f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-439376779", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:14.279784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'flavor' on Instance uuid 58fe86fb-6e35-4e56-9852-86ce499a6c41 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98cc0836-9176-4897-b774-f9a682e97c4f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 491 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-439376779", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-439376779', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.284315 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-98cc0836-9176-4897-b774-f9a682e97c4f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-98cc0836-9176-4897-b774-f9a682e97c4f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011564 Sep 14 09:39:14.288056 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2945/3752] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:14 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:39:14.297077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.297975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.304607 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Cannot 'rescue' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state paused Sep 14 09:39:14.306576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.307127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action HTTP/1.1 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 14 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: {"rescue": {}} Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'rescue' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state paused Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '58fe86fb-6e35-4e56-9852-86ce499a6c41', 'body': {'rescue': {}}} Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 in vm_state paused. Cannot rescue while the instance is in this state. Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state paused Sep 14 09:39:14.307533 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state paused Sep 14 09:39:14.311736 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.312625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.312625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.312625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.312625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.313990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 409 to user: Cannot 'rescue' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state paused {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:14.315109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ea411b88-5f81-4c41-9a3a-ff7abde21d2e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action" status: 409 len: 144 microversion: 2.1 time: 0.085991 Sep 14 09:39:14.316052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 808/3753] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:14 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:14.324913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:14.325587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.332696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.333192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.334468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.335223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.335687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.336146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.446305 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-035ccf3e-7f1d-4ca6-b167-3ddedd92acab tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action" status: 202 len: 0 microversion: 2.1 time: 0.125104 Sep 14 09:39:14.446974 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 809/3754] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:14 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:39:14.462675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.464184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.471611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.472152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.472598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.473317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.473773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.474227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.481285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:14.523316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.534365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8985cffb-8f00-4795-b296-b1793f7062fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.241472 Sep 14 09:39:14.534971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2946/3755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:14.544249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.545293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.557632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.558262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.558821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.559756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.560367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.560988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.655815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.691367 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8add7d24-1e03-4192-919f-8579a77766cc tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1507 microversion: 2.1 time: 0.236816 Sep 14 09:39:14.696308 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 810/3756] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:14.703819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.704917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:14.715730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.716312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.716724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.717554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:14.717949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:14.718417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:14.731734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.741570 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-793e8027-c59c-4832-a36e-809e9f36c367 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1519 microversion: 2.1 time: 0.204917 Sep 14 09:39:14.742169 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2947/3757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:14.885043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:14.894102 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4612b89-50ff-40c9-87f0-dcae804e539e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.196356 Sep 14 09:39:14.895197 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 811/3758] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:14.969479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-917cf901-f14a-4932-9073-b9cc2f3c1202 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1532222977", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-917cf901-f14a-4932-9073-b9cc2f3c1202 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 243 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1532222977", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1532222977', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'd41fa8d0-46d6-4c7d-bba4-394590fa7dfa'}]}}} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:14.975781 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:14.979997 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:14.985738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-917cf901-f14a-4932-9073-b9cc2f3c1202 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:14.987293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-917cf901-f14a-4932-9073-b9cc2f3c1202 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.024059 Sep 14 09:39:14.988735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2948/3759] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:14 2022] POST /compute/v2.1/servers => generated 175 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:39:14.995305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:14.995305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.003981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.004152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.004271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.004482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: 79e3beca-ebf5-4433-a154-3e26afac1a36] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.004754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.005835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.006323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.006743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.013197 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] HTTP exception thrown: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/79e3beca-ebf5-4433-a154-3e26afac1a36/metadata HTTP/1.1 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '79e3beca-ebf5-4433-a154-3e26afac1a36'} Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.020199 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 404 to user: Instance 79e3beca-ebf5-4433-a154-3e26afac1a36 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9cb550db-5dd4-4b6e-be77-21feedc748bd tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/79e3beca-ebf5-4433-a154-3e26afac1a36/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025355 Sep 14 09:39:15.026559 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2949/3760] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/79e3beca-ebf5-4433-a154-3e26afac1a36/metadata => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:15.062905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-d869-4ce2-9076-53acb3e2dd81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-d869-4ce2-9076-53acb3e2dd81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 416 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.067227 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.070715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-d869-4ce2-9076-53acb3e2dd81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.075794 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7720ee15-d869-4ce2-9076-53acb3e2dd81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012844 Sep 14 09:39:15.075794 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2950/3761] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:15.079964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.080593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.092288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.093274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.094242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.095336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.096126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.112647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.208813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:15.217845 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aaa9db70-92b0-4dba-9b76-bd09770bbb28 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1475 microversion: 2.1 time: 0.231519 Sep 14 09:39:15.218442 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 812/3762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:14 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1475 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:15.223372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-736dee1b-906e-48af-b319-ec930cc1e7fb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-877906797", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-736dee1b-906e-48af-b319-ec930cc1e7fb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 498 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-877906797", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-877906797', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd41fa8d0-46d6-4c7d-bba4-394590fa7dfa'}]}}} Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:39:15.228089 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-736dee1b-906e-48af-b319-ec930cc1e7fb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-736dee1b-906e-48af-b319-ec930cc1e7fb tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.010207 Sep 14 09:39:15.231083 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 813/3763] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:15.337312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-633a625c-67f7-46a2-b259-9d7f51f57e23 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1121345306", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-633a625c-67f7-46a2-b259-9d7f51f57e23 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 500 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1121345306", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1121345306', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd41fa8d0-46d6-4c7d-bba4-394590fa7dfa'}]}}} Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:39:15.341681 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-633a625c-67f7-46a2-b259-9d7f51f57e23 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-633a625c-67f7-46a2-b259-9d7f51f57e23 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010223 Sep 14 09:39:15.344720 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 814/3764] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:39:15.366471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:15.392079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ecba0b2-6e4d-4624-a46d-b48bd3ff842c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.314675 Sep 14 09:39:15.392079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2951/3765] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:15.403502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80790c44-65d0-4ef9-bff6-e4bf88e2cde4 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-539711977", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80790c44-65d0-4ef9-bff6-e4bf88e2cde4 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 753 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-539711977", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-539711977', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd41fa8d0-46d6-4c7d-bba4-394590fa7dfa'}]}}} Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:15.407810 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:15.410478 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:15.413834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.413834 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.413834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80790c44-65d0-4ef9-bff6-e4bf88e2cde4 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.413834 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80790c44-65d0-4ef9-bff6-e4bf88e2cde4 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.013367 Sep 14 09:39:15.419043 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 815/3766] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 1197 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 14 09:39:15.421132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.421764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.429492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.430171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.430513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.431121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.432745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.433198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.473955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b03afca1-ec60-44a7-9458-7f2ce2cf6085 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-402683757", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b03afca1-ec60-44a7-9458-7f2ce2cf6085 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 1265 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-402683757", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "d41fa8d0-46d6-4c7d-bba4-394590fa7dfa"}]}} Sep 14 09:39:15.479500 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-402683757', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'd41fa8d0-46d6-4c7d-bba4-394590fa7dfa'}]}}} Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.482013 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:15.483394 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:15.485538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 14 09:39:15.485538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.486989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b03afca1-ec60-44a7-9458-7f2ce2cf6085 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.487824 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b03afca1-ec60-44a7-9458-7f2ce2cf6085 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018060 Sep 14 09:39:15.494566 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 816/3767] 10.222.0.90 () {60 vars in 1148 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 2221 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 14 09:39:15.500243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.500945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: fc531eb7-dbf9-4e41-87f6-acaa785ee052] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.511757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] HTTP exception thrown: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/fc531eb7-dbf9-4e41-87f6-acaa785ee052/metadata/test2 HTTP/1.1 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': 'fc531eb7-dbf9-4e41-87f6-acaa785ee052', 'id': 'test2'} Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.513952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.517957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:15.517957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:15.517957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. Sep 14 09:39:15.517957 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.519510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 404 to user: Instance fc531eb7-dbf9-4e41-87f6-acaa785ee052 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.520903 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5438029-4ca1-4788-b446-57a5c5ca1e52 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/fc531eb7-dbf9-4e41-87f6-acaa785ee052/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024832 Sep 14 09:39:15.531744 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 817/3768] 10.222.0.90 () {58 vars in 1281 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/fc531eb7-dbf9-4e41-87f6-acaa785ee052/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:15.537499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.538609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.547949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.550429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.550875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.551645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.552167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.552659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.589893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:15.653035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:15.662404 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7aa0f4c-b40d-410b-9c12-050f53165a64 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.245433 Sep 14 09:39:15.663387 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2952/3769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:15.688322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d44542a-fa7e-47d8-80a0-1a785ed48a06 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 204 len: 0 microversion: 2.1 time: 0.153789 Sep 14 09:39:15.689281 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 818/3770] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:15 2022] DELETE /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:15.698053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.698801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.705432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.705981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.706720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.708174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.709280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.709735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.721474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.722972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:15.723445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.728494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:15.734962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.735458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.735915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.736996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.737623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.738212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.894686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:15.906434 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b378485b-4962-4ac3-af3f-f37f1fad4cac tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1525 microversion: 2.1 time: 0.213124 Sep 14 09:39:15.907040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2953/3771] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1525 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:15.923284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:15.924502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5915c158-6b20-4e6a-bd92-fcce22f4046d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639711664", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": -1, "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:15.935024 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d964e98e-bf44-4ab1-8559-381a31138ec3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1515 microversion: 2.1 time: 0.219382 Sep 14 09:39:15.935930 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 819/3772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1515 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:15.938516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5915c158-6b20-4e6a-bd92-fcce22f4046d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Flavor -1 could not be found. Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5915c158-6b20-4e6a-bd92-fcce22f4046d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 206 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639711664", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": -1, "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: exception: Flavor -1 could not be found. Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1639711664', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': -1, 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.940703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 14 09:39:15.945574 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:15.948016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5915c158-6b20-4e6a-bd92-fcce22f4046d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:15.949087 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5915c158-6b20-4e6a-bd92-fcce22f4046d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.039347 Sep 14 09:39:15.949881 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2954/3773] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:15 2022] POST /compute/v2.1/servers => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:39:15.962294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:15.963327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:15.970888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.971395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.971841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:15.972593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:15.973053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:15.973485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.147519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:16.157850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52452c1c-4e84-4d8f-8907-5aa632a80309 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.200431 Sep 14 09:39:16.159121 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 820/3774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:15 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:16.187480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.189562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.197172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.197852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.198467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.199549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.200207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.200640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.243554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.244599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.254710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.255131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.255563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.256672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.257983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.258791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.396778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:16.405717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a8953b2e-0f6b-475e-87d6-1d6f67764632 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.222880 Sep 14 09:39:16.406314 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2955/3775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:16 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:16.531077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:16.550179 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e3dbe8a5-f05b-4845-9104-efd7596eccc3 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1475 microversion: 2.1 time: 0.310041 Sep 14 09:39:16.551222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 821/3776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:16 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1475 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:16.618463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d46b285b-f457-47e3-bdd5-be083f944427 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705049404", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d46b285b-f457-47e3-bdd5-be083f944427 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 173 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1705049404", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1705049404', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi -1 Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:16.623416 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d46b285b-f457-47e3-bdd5-be083f944427 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d46b285b-f457-47e3-bdd5-be083f944427 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.014930 Sep 14 09:39:16.627485 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2956/3777] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:16 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:16.636278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.636933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.644185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.644702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.645320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.646370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.646962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.647394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.944406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:16.945162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:16.967924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.968924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.969715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.970626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:16.971247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:16.972072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:16.999270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:17.015171 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff8f5c4f-c3f2-43e3-b75a-11a5b366fb50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.382603 Sep 14 09:39:17.015333 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 822/3778] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:16 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:17.042915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:17.043794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:17.051558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.052757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.053796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.054955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.056135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.057234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.225085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:17.243551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e84a68fa-cbc1-40e3-a4de-3bc742cbf331 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1525 microversion: 2.1 time: 0.308711 Sep 14 09:39:17.261590 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2957/3779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:16 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1525 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:17.576972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:17.577628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:17.584854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.585462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.585904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.586679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.587128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.587608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.611298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:17.624736 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-021f5e97-de3d-4454-afcf-58c46b637d4b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.585384 Sep 14 09:39:17.626440 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 823/3780] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:17 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:17.796237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:17.811338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa6cb946-42ba-4db5-a211-f202b836a135 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1475 microversion: 2.1 time: 0.238422 Sep 14 09:39:17.813344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2958/3781] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:17 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:17.832985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0b118e3-cb1b-4204-92e2-16e1189da91c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-492903175", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:17.846056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b0b118e3-cb1b-4204-92e2-16e1189da91c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0b118e3-cb1b-4204-92e2-16e1189da91c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 215 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-492903175", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-492903175', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:17.848263 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 14 09:39:17.852771 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:17.855914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0b118e3-cb1b-4204-92e2-16e1189da91c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:17.857779 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0b118e3-cb1b-4204-92e2-16e1189da91c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.040162 Sep 14 09:39:17.858600 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 824/3782] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:17 2022] POST /compute/v2.1/servers => generated 123 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:17.871273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:17.871948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:17.879996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.880798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.881424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:17.882927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:17.883791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:17.886725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.126497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:18.140155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2007f09-df35-494c-9732-f91054f4ed9d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.275410 Sep 14 09:39:18.141483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2959/3783] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:17 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:18.173188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:18.174196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:18.196583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.197082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.197529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.198245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.198966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.199559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.201428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fcb6bd-24d9-4974-b1aa-5f2158dff3d0", "name": "network-vif-deleted", "tag": "386e4bfb-9009-422b-8910-98628102b250"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:18.214378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.215025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.215568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.233389 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] Creating event network-vif-deleted:386e4bfb-9009-422b-8910-98628102b250 for instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 on n-h2-851028-12 Sep 14 09:39:18.239220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-acec9b71-ccf9-499f-a4a2-ceef51d08999 req-81402686-5465-48d1-92a2-d1bea3ea76f0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055598 Sep 14 09:39:18.241901 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2960/3784] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:39:18.270272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:18.271126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:18.280173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.281004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.281611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.291066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.291570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.292050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.675842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:18.698083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1799687d-d381-4dd9-9488-5b9993b43022 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.516147 Sep 14 09:39:18.698771 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 825/3785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:18 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:18.712100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:18.720921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afc15d3b-f38f-4638-85c0-e98b7cbda185 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1525 microversion: 2.1 time: 0.456030 Sep 14 09:39:18.723380 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2961/3786] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:18 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1525 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:18.753262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:18.761055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:18.769123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.769910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.770695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.772032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.772786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.773409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.821445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'flavor' on Instance uuid 58fe86fb-6e35-4e56-9852-86ce499a6c41 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:18.842713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:18.843822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:18.866187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.867728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.872266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.873354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.876954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:18.878042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:18.998683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:18.999767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.000542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.002951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:19.035384 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-36dadd80-0fc7-4698-b706-d28ce832892e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action" status: 200 len: 32 microversion: 2.1 time: 0.310578 Sep 14 09:39:19.041193 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 826/3787] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:18 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action => generated 32 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:39:19.043977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1910274116", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-key-645513717", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:19.210553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: ERROR sqlalchemy.pool.impl.QueuePool Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: Exception ignored in: . at 0x7f693f299b80> Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: Traceback (most recent call last): Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: connection_record.checkin() Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: pool.dispatch.checkin(connection, self) Sep 14 09:39:19.223034 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 14 09:39:19.226603 n-d-851028-12 devstack@n-api.service[122443]: fn(*args, **kw) Sep 14 09:39:19.226603 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 14 09:39:19.226759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4aa790a0-ffaa-4687-aa94-73791926d906 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 200 len: 1309 microversion: 2.1 time: 0.388612 Sep 14 09:39:19.251765 n-d-851028-12 devstack@n-api.service[122443]: time.sleep(0) Sep 14 09:39:19.251765 n-d-851028-12 devstack@n-api.service[122443]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 14 09:39:19.256546 n-d-851028-12 devstack@n-api.service[122443]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 14 09:39:19.256546 n-d-851028-12 devstack@n-api.service[122443]: AssertionError: do not call blocking functions from the mainloop Sep 14 09:39:19.282028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2962/3788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:18 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 1309 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:19.298797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:19.299427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:19.304012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] validate_networks() for [('cddd25f6-377c-4af3-ba14-f3857c01c9d2', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:39:19.334096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.336060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.337728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.338665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.342392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.343102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.715134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:19.724501 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86663a9b-0770-4ed1-aa2d-18af3144950a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.441358 Sep 14 09:39:19.725380 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2963/3789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:19 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:19.758953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:19.760369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:19.772989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.774484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.775427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.777224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.778163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.779008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.837664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:19.838674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:19.839639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:19.840640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lazy-loading 'fault' on Instance uuid bfd401c9-3332-4b2f-b6e0-4030c5f62216 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:19.914118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e41fc56684e52a0db170403751151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f25af5085a145e5978493c83c691e03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:19.928368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9313c080-49d9-440f-ae14-94c862cf48f8 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 200 len: 1313 microversion: 2.1 time: 0.175645 Sep 14 09:39:19.933359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2964/3790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:19 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:20.210259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Invalid key_name provided. Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 246 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1910274116", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-key-645513717", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid key_name provided. Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1910274116', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'key_name': 'tempest-key-645513717', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-645513717 not found for user 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.212159 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.216367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid key_name provided. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:20.221422 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46c83828-e98a-4ba3-8268-11d64744050c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.175730 Sep 14 09:39:20.222125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 827/3791] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 1185 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 14 09:39:20.235661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.237195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.253050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.253883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.255824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.257057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.257212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.258738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.261180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.263053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.269438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.270629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.274176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.275254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.275880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.276497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.319271 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 HTTP/1.1 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '32fcb6bd-24d9-4974-b1aa-5f2158dff3d0'} Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.321182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. Sep 14 09:39:20.325133 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.327158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance 32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:20.328494 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-234a6bc0-5f90-4988-a184-1ae177c4f15c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0" status: 404 len: 111 microversion: 2.1 time: 0.076400 Sep 14 09:39:20.329935 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 828/3792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/32fcb6bd-24d9-4974-b1aa-5f2158dff3d0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:20.338188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.339160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 207df2b2-3d56-49c0-bda0-f915a8eedec0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.356799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.357623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.358322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.359230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.359916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.360557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.380162 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 HTTP/1.1 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '207df2b2-3d56-49c0-bda0-f915a8eedec0'} Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:20.384283 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:20.392556 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2bfd713e-53f7-4151-bcc3-54d42b072a47 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0" status: 404 len: 111 microversion: 2.1 time: 0.052835 Sep 14 09:39:20.395528 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 829/3793] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/207df2b2-3d56-49c0-bda0-f915a8eedec0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:20.402558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "207df2b2-3d56-49c0-bda0-f915a8eedec0", "name": "network-vif-deleted", "tag": "33011866-9776-49c5-bc2a-4739801bbb26"}, {"server_uuid": "bfd401c9-3332-4b2f-b6e0-4030c5f62216", "name": "network-vif-deleted", "tag": "f8237e67-f8b1-43e2-a1a0-3e8777eace7c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:20.417213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.418213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.418882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.455716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Creating event network-vif-deleted:33011866-9776-49c5-bc2a-4739801bbb26 for instance 207df2b2-3d56-49c0-bda0-f915a8eedec0 on n-h2-851028-12 Sep 14 09:39:20.457017 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] Creating event network-vif-deleted:f8237e67-f8b1-43e2-a1a0-3e8777eace7c for instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 on n-h1-851028-12 Sep 14 09:39:20.468014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-36939615-4aef-451c-9223-33b4f96109d7 req-e429e6b3-09fb-45ff-8c35-1398874f2a1b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070836 Sep 14 09:39:20.469510 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 830/3794] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:20.475868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb61ac6e-fd03-4e17-8c82-db1746ce0680 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.529580 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb61ac6e-fd03-4e17-8c82-db1746ce0680 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/os-server-groups/cd7a3b94-0a9f-445b-a884-28d912991ead" status: 204 len: 0 microversion: 2.1 time: 0.058577 Sep 14 09:39:20.533585 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 831/3795] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:39:20 2022] DELETE /compute/v2.1/os-server-groups/cd7a3b94-0a9f-445b-a884-28d912991ead => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:20.549229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.550827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.567863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.572529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.574339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.575571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.575661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.577417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.584600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:20.594840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a11dec74-d5ca-40f7-bdbf-f29d17accc6e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.365638 Sep 14 09:39:20.596027 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2965/3796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:20.621801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.622437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.631443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.631988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.632429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.633351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.634132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.646721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.649207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:39:20.692727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:20.926803 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d96e18c2-f53f-40e4-9206-4aae6ace5c14 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "DELETE /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 204 len: 0 microversion: 2.1 time: 0.386628 Sep 14 09:39:20.928800 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 832/3797] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:20 2022] DELETE /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:39:20.941879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:20.943544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:20.956442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.957919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.959306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:20.960694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:20.962009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:20.962767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.042101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:21.051139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1276535a-5b17-484d-876d-68f2b353338b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.434911 Sep 14 09:39:21.053416 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2966/3798] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:21.059378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:21.060567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:21.069533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.070411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.071110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.072121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.072779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.073416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.211400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:21.220104 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bea815d2-9cab-4efb-aefc-42b5e1e7e179 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.288554 Sep 14 09:39:21.221333 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 833/3799] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:20 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:21.227365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:21.228374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] [instance: bfd401c9-3332-4b2f-b6e0-4030c5f62216] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:21.236137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.236871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.237510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.238559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.239563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.240829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.260847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] HTTP exception thrown: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Request method failure captured: Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 HTTP/1.1 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEujrSt_DOhy1unidPz1lXvm0tfW9iZ9Y0VEUdzqQ84LRMpLIUjpI81R0hUU95pWcE34EFRjFQAk3iZD0pwtxrck6EihTq5K6Lrxixuwmu9IMP2cCejDeyzQ9PcTQA6fmBbBaWuSrLzI5Xm_ebglUFzbc73r8H3-6veIn7glUbgnfw Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_8f25af5085a145e5978493c83c691e03", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/8f25af5085a145e5978493c83c691e03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/8f25af5085a145e5978493c83c691e03"}]}] Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 8f25af5085a145e5978493c83c691e03 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-548662793 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 569e41fc56684e52a0db170403751151 Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-548662793-project Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'bfd401c9-3332-4b2f-b6e0-4030c5f62216'} Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.262723 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] Returning 404 to user: Instance bfd401c9-3332-4b2f-b6e0-4030c5f62216 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:21.267565 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-55a2a320-1247-43dc-9eee-82bbf7d3af21 tempest-ServerMetadataNegativeTestJSON-548662793 tempest-ServerMetadataNegativeTestJSON-548662793-project] 10.222.0.90 "GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216" status: 404 len: 111 microversion: 2.1 time: 0.041689 Sep 14 09:39:21.270035 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 834/3800] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:21 2022] GET /compute/v2.1/servers/bfd401c9-3332-4b2f-b6e0-4030c5f62216 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:21.275345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001241343", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:21.364547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:21.374582 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d4cfc45-9812-4855-b700-ac3fd7b86227 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1472 microversion: 2.1 time: 0.319611 Sep 14 09:39:21.375210 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2967/3801] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:21 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:21.436178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.security_group_api [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Neutron security group does_not_exist not found {{(pid=122443) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 14 09:39:21.437214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 258 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001241343", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1001241343', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 14 09:39:21.439019 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:21.443518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:21.450079 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbb25039-dfe6-4dcd-8f12-375243697178 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.169665 Sep 14 09:39:21.450079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 835/3802] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:21.454991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:21.455875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:21.464322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.465486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.466615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.467753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.468661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.470265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.818340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:21.857494 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a240e82-68d6-4c12-8c19-0e5e5f5836f3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.403929 Sep 14 09:39:21.858657 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2968/3803] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:21 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:21.890085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:21.890806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:21.901638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.902624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.903498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:21.904683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:21.905598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:21.906409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.246890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.247545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.261197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.262599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.263425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.264952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.265647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.266283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.495422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:22.517434 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-790c7aa1-5597-426f-82b1-09cba8264751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.626279 Sep 14 09:39:22.532550 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 836/3804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:21 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:22.544880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:22.551563 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-baa73bff-9b8e-4b46-8d8c-1ab19870bc9b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.308747 Sep 14 09:39:22.551851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.553603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.556454 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2969/3805] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:22 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:22.577282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.578056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.578500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.579231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.579609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.579794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.580123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.580507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: f43d75d5-53f7-4c8d-b554-a7fe803dfa67] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.587458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/f43d75d5-53f7-4c8d-b554-a7fe803dfa67 HTTP/1.1 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f43d75d5-53f7-4c8d-b554-a7fe803dfa67'} Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:22.590070 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance f43d75d5-53f7-4c8d-b554-a7fe803dfa67 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb334423-c495-436a-af3f-0783132954e1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f43d75d5-53f7-4c8d-b554-a7fe803dfa67" status: 404 len: 111 microversion: 2.1 time: 0.033728 Sep 14 09:39:22.597667 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2970/3806] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:39:22 2022] DELETE /compute/v2.1/servers/f43d75d5-53f7-4c8d-b554-a7fe803dfa67 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:22.609466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.613977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.622803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.623456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.624746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.624889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.626284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.626822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.842519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:22.854810 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7937d3ec-9d0c-4c37-9cbd-c0476ba9a607 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.251657 Sep 14 09:39:22.856255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2971/3807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:22.887037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:22.888063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:22.901322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.903597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.905605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.907608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:22.908441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:22.909068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:22.937488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:22.954264 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6320250e-5b97-42e9-8c2c-28d1be2c8a52 tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1472 microversion: 2.1 time: 0.420075 Sep 14 09:39:22.967973 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 837/3808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:22 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:23.168647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:23.171531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:23.182606 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2584a200-95e8-4817-a544-ae30de5c5524 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.304287 Sep 14 09:39:23.186410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2972/3809] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:23.218598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:23.219407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:39:23.220117 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 9223372036854775808 could not be found. Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '9223372036854775808'} Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:23.221767 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:23.226424 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:23.226424 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:23.226424 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:23.226424 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 14 09:39:23.226424 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:23.227521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:23.228583 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47c647c2-5890-4870-9ed0-d2b05c1c7bd8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014961 Sep 14 09:39:23.238392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:23.239567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:23.243506 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 838/3810] 10.222.0.90 () {58 vars in 1188 bytes} [Wed Sep 14 09:39:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:23.247384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.248115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.248869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.250831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.251489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.252113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.535676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864f9917-6f8f-434e-8942-3e2f7a854cd7", "name": "network-vif-deleted", "tag": "5a598588-710d-4056-960c-cf064d05b6aa"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:23.548768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.549615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.550345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.564752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] Creating event network-vif-deleted:5a598588-710d-4056-960c-cf064d05b6aa for instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 on n-h1-851028-12 Sep 14 09:39:23.572259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-db6498fe-6e44-4d18-9991-abf6069053aa req-893c5d89-7d41-41b6-917e-f33ac5110b29 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040500 Sep 14 09:39:23.573429 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 839/3811] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:39:23.580614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:23.581724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:23.589815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.590595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.591414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.592465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.593160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.594102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.618120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:23.628057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1610af2c-14ed-457d-9143-de87ff11d98a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.393848 Sep 14 09:39:23.632324 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2973/3812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:23.662849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:23.663916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:23.672634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.673450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.674193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.675128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:23.675737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:23.676507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:23.975454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:23.977305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:23.988677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a25c489-70db-4370-999e-1a8946898ed0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.330685 Sep 14 09:39:23.989455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2974/3813] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:23.996130 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4555d734-1dc8-4abd-b665-289c339ac9b6 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.418240 Sep 14 09:39:24.006537 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 840/3814] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:23 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:24.028443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.029177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.033295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.033870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Failed to fetch instance by id -1 {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:39:24.034398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance -1 could not be found. Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance -1 could not be found. Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '-1'} Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.036057 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:24.041061 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dba79c03-efb4-46b8-a49e-1dc1b6df7f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025303 Sep 14 09:39:24.042600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.043109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.043870 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 841/3815] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:39:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:24.048124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.048963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.049694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.050142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.053269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.053985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.064494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.064956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.065425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.066136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.068663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.069280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.106206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.107337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.108300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.109344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lazy-loading 'fault' on Instance uuid 864f9917-6f8f-434e-8942-3e2f7a854cd7 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:24.183002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cfe36c848644e96a8b93a01084209e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7086c1820364472b7621af92fe1ee6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:24.192225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9c137c4-ca51-42a9-a986-37373e2f873a tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 200 len: 1306 microversion: 2.1 time: 0.194469 Sep 14 09:39:24.193109 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2975/3816] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:23 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 1306 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:24.390761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:24.410000 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d0a9e1cc-8451-4413-9b67-a76a9f2cc7c7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.364860 Sep 14 09:39:24.412709 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 842/3817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:24 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:24.442673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.446889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.466098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.467295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.467746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.468505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.469100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.469545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.741820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:24.752512 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-466918f8-e06e-4e1d-addb-37c4f5703ec4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.314568 Sep 14 09:39:24.753351 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2976/3818] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:24 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:24.776318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:24.777496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.784359 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/3ef68b29-ef82-4eca-aa59-ac4bf9a82d73/action HTTP/1.1 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 19 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: {"forceDelete": {}} Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3ef68b29-ef82-4eca-aa59-ac4bf9a82d73', 'body': {'forceDelete': {}}} Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:24.792195 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:24.796902 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:24.796902 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:24.796902 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. Sep 14 09:39:24.796902 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:24.798623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 3ef68b29-ef82-4eca-aa59-ac4bf9a82d73 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:24.800389 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-76172705-ca6d-4e09-b150-745ba829e1db tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/3ef68b29-ef82-4eca-aa59-ac4bf9a82d73/action" status: 404 len: 111 microversion: 2.1 time: 0.027945 Sep 14 09:39:24.801721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 843/3819] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:24 2022] POST /compute/v2.1/servers/3ef68b29-ef82-4eca-aa59-ac4bf9a82d73/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:24.815822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:24.816690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:24.831813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.832817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.833450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:24.835603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:24.851488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:24.852450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.020850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:25.022396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:25.036408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.038131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.039488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.043001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.043687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.044326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.148726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:25.185759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33f0029c-ebbd-49f1-8689-07b5a741985e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.378342 Sep 14 09:39:25.186115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2977/3820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:24 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:25.217508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:25.218242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:25.227983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.228812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.229444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.230388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.231049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.231684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.384299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:25.410182 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e2ae2384-6025-4158-b001-c07ce6468931 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.393705 Sep 14 09:39:25.411002 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 844/3821] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:25 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:25.415966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:25.416567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] [instance: 864f9917-6f8f-434e-8942-3e2f7a854cd7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:25.434557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.435053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.435724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.436216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.436843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.437413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.476897 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] HTTP exception thrown: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Request method failure captured: Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 HTTP/1.1 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaCKIE0if_NUP7ui1pqdYe5o0K_xcoBZ0BvmcjybI7Y6oxCIyrWDM6wmOAMjnuwKR6t80DbfphHCj2jI5adHl2u1xOmjTRdAQ_YA8aCoCg9t901fY2ynfAS8FawrB2GG0gIsKm35U94KQOmiU43F7O3iamAF1hDY1OEbZvbswypY6gs Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_a7086c1820364472b7621af92fe1ee6f", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/a7086c1820364472b7621af92fe1ee6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/a7086c1820364472b7621af92fe1ee6f"}]}] Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: a7086c1820364472b7621af92fe1ee6f Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1790169651 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0cfe36c848644e96a8b93a01084209e1 Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersOnMultiNodesTest-1790169651-project Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '864f9917-6f8f-434e-8942-3e2f7a854cd7'} Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:25.478702 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. Sep 14 09:39:25.483388 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.486513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] Returning 404 to user: Instance 864f9917-6f8f-434e-8942-3e2f7a854cd7 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:25.491865 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4dbc348a-274d-49bd-85d6-d7c9e9cbf99c tempest-ServersOnMultiNodesTest-1790169651 tempest-ServersOnMultiNodesTest-1790169651-project] 10.222.0.90 "GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7" status: 404 len: 111 microversion: 2.1 time: 0.076720 Sep 14 09:39:25.492701 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 845/3822] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:25 2022] GET /compute/v2.1/servers/864f9917-6f8f-434e-8942-3e2f7a854cd7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:25.673655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:25.684847 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18901c5b-178c-49ff-9c7f-b30e4257bae6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.471569 Sep 14 09:39:25.689086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2978/3823] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:25 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:25.714601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:25.717305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: c11e3102-8198-4862-b106-cd03585bfa4f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:25.723868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/c11e3102-8198-4862-b106-cd03585bfa4f/action HTTP/1.1 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 39 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: {"os-getConsoleOutput": {"length": 10}} Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'c11e3102-8198-4862-b106-cd03585bfa4f', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.735280 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. Sep 14 09:39:25.739656 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:25.743180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance c11e3102-8198-4862-b106-cd03585bfa4f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:25.746015 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-37fdcaff-fae5-43ab-adb3-f434eceff120 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/c11e3102-8198-4862-b106-cd03585bfa4f/action" status: 404 len: 111 microversion: 2.1 time: 0.033885 Sep 14 09:39:25.746956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 846/3824] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:25 2022] POST /compute/v2.1/servers/c11e3102-8198-4862-b106-cd03585bfa4f/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:25.757229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:25.757841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:25.769528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.770005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.770578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:25.776362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:25.776865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:25.777307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.053828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:26.081429 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ebe4dd0a-7870-4b06-83b9-1cbf31d31b97 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.328976 Sep 14 09:39:26.094131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2979/3825] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:25 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:26.113784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:26.115471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:26.132198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.132486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.133001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.134209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.135259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.136415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.439197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:26.454843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:26.458076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:26.475426 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e4ebca58-54be-4150-a312-74483bffc54f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.368169 Sep 14 09:39:26.478942 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 847/3826] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:26 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:26.479802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.480465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.481222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.482348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.483223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.483799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.507632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:26.509292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: c555ac87-6505-4beb-b5eb-943980c0f365] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:26.518203 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/c555ac87-6505-4beb-b5eb-943980c0f365 HTTP/1.1 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'c555ac87-6505-4beb-b5eb-943980c0f365'} Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:26.520042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:26.526406 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:26.526406 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:26.526406 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:26.526406 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. Sep 14 09:39:26.526406 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:26.529141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance c555ac87-6505-4beb-b5eb-943980c0f365 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:26.531460 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fe2b2b10-c94b-46d6-a3ac-1c8e860f61ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/c555ac87-6505-4beb-b5eb-943980c0f365" status: 404 len: 111 microversion: 2.1 time: 0.027139 Sep 14 09:39:26.539814 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 848/3827] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:26 2022] GET /compute/v2.1/servers/c555ac87-6505-4beb-b5eb-943980c0f365 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:26.546748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:26.558947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:26.583732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.590156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.595276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.596319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.596956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.597741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.903074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:26.922581 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5eb429f8-ef2d-40b8-aa79-477b7bc648a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.379040 Sep 14 09:39:26.924165 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 849/3828] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:26 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:26.951528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:26.954016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:26.962491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:26.971087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.971589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.972060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:26.973500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:26.973969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:26.975770 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aaafa45d-4832-47f2-a295-492ab38ed6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.526497 Sep 14 09:39:26.978919 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2980/3829] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:26 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:26.984966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:27.383454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:27.403676 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-01556afe-db0d-4839-abbf-8032bf206dd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.455943 Sep 14 09:39:27.406048 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 850/3830] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:26 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:27.706904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49074aee-182a-454e-a7ec-c57af494cfe9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940879509", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49074aee-182a-454e-a7ec-c57af494cfe9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 238 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1940879509", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1940879509', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.730333 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49074aee-182a-454e-a7ec-c57af494cfe9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49074aee-182a-454e-a7ec-c57af494cfe9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029294 Sep 14 09:39:27.738511 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2981/3831] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:27.741743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:27.742356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:27.753799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:27.756560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:27.760847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:27.761957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:27.762723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:27.763525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.006214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:28.007136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:28.024283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.025268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.025950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.026914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.027591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.028332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.122315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:28.130974 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-403a6c74-bc83-42d8-a548-04efe486a73a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.393131 Sep 14 09:39:28.150007 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 851/3832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:27 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:28.160370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:28.161177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:28.169488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.170222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.170859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.172118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.172816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.173655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.390373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:28.403867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36063f8f-f0ce-4cee-993c-ac92f25af68d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.402920 Sep 14 09:39:28.414387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:28.416434 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2982/3833] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:27 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:28.427168 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79d4022b-c82d-44a9-b1a8-f3ed9199a16e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.270736 Sep 14 09:39:28.440432 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 852/3834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:28 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:28.632246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f2e39f9-9f2f-4b8d-809c-8cf418336556 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097146006", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f2e39f9-9f2f-4b8d-809c-8cf418336556 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 235 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1097146006", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1097146006', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.638729 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 14 09:39:28.643415 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:28.646511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f2e39f9-9f2f-4b8d-809c-8cf418336556 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:28.651600 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f2e39f9-9f2f-4b8d-809c-8cf418336556 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024274 Sep 14 09:39:28.653008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2983/3835] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:28 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:28.663855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:28.664708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:28.673397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.674131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.677065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.679706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:28.680473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:28.681126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:28.961852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:28.970248 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-26872046-9e63-4f7a-89b4-e42f775cd7a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.312227 Sep 14 09:39:28.970838 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 853/3836] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:28 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:28.999942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:29.000662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.013991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.014603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.015199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.016302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.016971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.017972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.224983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:29.240402 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8abac38e-c320-4e9f-bf2e-961e6614703c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.243992 Sep 14 09:39:29.243608 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2984/3837] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:28 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:29.273157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:29.273940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 58f7650d-3a0d-48a6-83ba-dfa5444136a8] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.281493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/58f7650d-3a0d-48a6-83ba-dfa5444136a8/action HTTP/1.1 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 13 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: {"pause": {}} Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '58f7650d-3a0d-48a6-83ba-dfa5444136a8', 'body': {'pause': {}}} Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:29.288371 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 58f7650d-3a0d-48a6-83ba-dfa5444136a8 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:29.293597 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0f54b818-5cdd-47c1-a90b-807b9ae8c751 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/58f7650d-3a0d-48a6-83ba-dfa5444136a8/action" status: 404 len: 111 microversion: 2.1 time: 0.021789 Sep 14 09:39:29.300251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:29.300957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.303501 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 854/3838] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:29 2022] POST /compute/v2.1/servers/58f7650d-3a0d-48a6-83ba-dfa5444136a8/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:29.310531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.311242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.311862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.312827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.313514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.314412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.436631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:29.438679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.453289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.454083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.455130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.456601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.460201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.461721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.570586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:29.583066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8456450-2b6e-4c13-9b10-90c660d308df tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.287174 Sep 14 09:39:29.586876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2985/3839] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:29 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:29.611236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:29.614241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.627518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.628607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.629327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.631312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.632436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.633092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.907289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:29.917720 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edff3240-7b9b-492e-8d39-238de810e67b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.314823 Sep 14 09:39:29.919586 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2986/3840] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:29 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:29.951531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:29.952362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:29.960129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.960881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.961491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:29.962396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:29.963175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:29.964315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:30.091003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2d4ccee-5f1e-45c2-b5b9-dae921fc5b5c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.145689 Sep 14 09:39:30.093259 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2987/3841] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:29 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:39:30.103540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:30.107178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:30.127474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:30.129730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:30.130431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:30.132225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:30.133930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:30.135244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:30.361466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:30.376543 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0a04caf5-d718-4dad-8117-2c22be8f1e5a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.946411 Sep 14 09:39:30.377505 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 855/3842] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:29 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:30.389956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:30.407821 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-717735b6-418d-4781-90be-5a6a62160a50 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1511 microversion: 2.1 time: 0.309802 Sep 14 09:39:30.408637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2988/3843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:30 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:31.406998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:31.408379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:31.431048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.431777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.432468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.433537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:31.434165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:31.442301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.443103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.444277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.456910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.457415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.458132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.458915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.459487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.460084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.747673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:31.762146 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17eb5fb5-a783-4dfb-b6ff-aaf53e56cc82 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1491 microversion: 2.1 time: 0.332580 Sep 14 09:39:31.763623 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2989/3844] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:31 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1491 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:31.867014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:31.890138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dc42e779-43f8-4015-9c83-7e3aee356ffe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.488915 Sep 14 09:39:31.891735 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 856/3845] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:31 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:31.899577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:31.903504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:31.925785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.928115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.931860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.932907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:31.936341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:31.936341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:31.941670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:31.993760 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'pause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state paused Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 13 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: {"pause": {}} Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'pause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state paused Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'pause': {}}} Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state paused. Cannot pause while the instance is in this state. Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state paused Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:31.995349 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state paused Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'pause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state paused {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2d92412e-4e31-4328-b4ed-62d0db5662ff tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 143 microversion: 2.1 time: 0.104126 Sep 14 09:39:32.001689 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 857/3846] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:31 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 143 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:32.010098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:32.011808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:32.023702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.032475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.033130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.033993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.034582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.035341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.087491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.098792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.103191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.103873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.104941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.138406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.141075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.180135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-53af993e-af2d-4681-8132-6785c485df16 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.176311 Sep 14 09:39:32.180934 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 858/3847] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:32 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:39:32.193991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.194935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:32.210519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:32.212637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.214283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.214909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.219312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.219312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.219312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.236093 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e97fbaf-2a3b-4be6-9e02-9d6a9b9b4787 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.468223 Sep 14 09:39:32.237191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2990/3848] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:39:31 2022] GET /compute/v2.1/os-services => generated 949 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:32.259602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.266345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.272225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.273452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.275879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.276352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.276792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.320349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:32.341961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afb31851-d045-4c24-b483-40d18d8c0f29 tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?host=n-d-851028-12" status: 200 len: 581 microversion: 2.1 time: 0.090059 Sep 14 09:39:32.343034 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2991/3849] 10.222.0.90 () {58 vars in 1174 bytes} [Wed Sep 14 09:39:32 2022] GET /compute/v2.1/os-services?host=n-d-851028-12 => generated 581 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:32.357146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.360772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.361271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.361717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.362453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.362912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.363341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.429801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ef08ee0-d296-4744-aae7-af622b7e847e tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.076245 Sep 14 09:39:32.431240 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2992/3850] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:39:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:32.446199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.449751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.450242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.450686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.451420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.460159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.460844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.542414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29b3de75-0024-4f8f-8d19-71bcc8b9dc0f tempest-ServicesAdminTestJSON-935372364 tempest-ServicesAdminTestJSON-935372364-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.101424 Sep 14 09:39:32.546510 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2993/3851] 10.222.0.90 () {58 vars in 1137 bytes} [Wed Sep 14 09:39:32 2022] GET /compute/v2.1/os-services => generated 949 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:39:32.592638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:32.603760 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a6ae94f-f8d2-484b-a5a6-5b7be2434dcd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1498 microversion: 2.1 time: 0.417222 Sep 14 09:39:32.604406 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 859/3852] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:32 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1498 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:32.926408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:32.930675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:32.967920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.977158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.978223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:32.980355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:32.982628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:32.985870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.518118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:33.534222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2373c97e-2f2c-4cbf-9b62-059eaa40b543 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1501 microversion: 2.1 time: 0.620266 Sep 14 09:39:33.537079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2994/3853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:32 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1501 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:33.559349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b762da3-2f5b-45ab-9f14-6ab46cf1e45a"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:33.561798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:33.576501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.576999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.577439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.578181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.578676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.582822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.628703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:33.629610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:33.638978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.643270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.647774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.648842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.649519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.650189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.659413 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Cannot 'attach_volume' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state rescued Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/os-volume_attachments HTTP/1.1 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 74 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: {"volumeAttachment": {"volumeId": "9b762da3-2f5b-45ab-9f14-6ab46cf1e45a"}} Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'attach_volume' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state rescued Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': '58fe86fb-6e35-4e56-9852-86ce499a6c41', 'body': {'volumeAttachment': {'volumeId': '9b762da3-2f5b-45ab-9f14-6ab46cf1e45a'}}} Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 14 09:39:33.678664 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state rescued Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state rescued Sep 14 09:39:33.683607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:33.685413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 409 to user: Cannot 'attach_volume' instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 while it is in vm_state rescued {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:33.686448 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-168156fc-eda8-4add-8b27-bc17900c200a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.131191 Sep 14 09:39:33.687212 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 860/3854] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:39:33 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/os-volume_attachments => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:33.708007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:33.714101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:33.724843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.735989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.736723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.737651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.738279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.738876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.841066 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dbb7e797-fe63-4c05-a47a-08321ca8e3be tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action" status: 202 len: 0 microversion: 2.1 time: 0.145373 Sep 14 09:39:33.842026 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 861/3855] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:33 2022] POST /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:39:33.852007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:33.856874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:33.869446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.869952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.870454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:33.871187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:33.871661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:33.872107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.067120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:34.077672 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-745a8ddd-1d41-42ea-a644-d039912cda1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.451460 Sep 14 09:39:34.078925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2995/3856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:33 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:34.110064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:34.111007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:34.125006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.127053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.128403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.132537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.133214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.133849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.484856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:34.497509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4c86e0c-e244-43ee-89a1-010bf6b5cac8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.395205 Sep 14 09:39:34.498121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2996/3857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:34 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:34.528045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:34.535064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:34.552851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.553903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.555051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.556124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.556843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.558257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.583150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:34.583936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action HTTP/1.1 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 28 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: {"reboot": {"type": "SOFT"}} Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cdf30564-dde0-40dd-b32c-c9cf6c3625d2', 'body': {'reboot': {'type': 'SOFT'}}} Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:34.587135 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:34.592431 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:34.597119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:34.598361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d6e466c-e544-4ff4-8179-35976f41bb7b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action" status: 404 len: 111 microversion: 2.1 time: 0.075815 Sep 14 09:39:34.599735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2997/3858] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:34 2022] POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:34.603081 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6c63e39c-a717-4eda-8d70-a68712a0f6ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1509 microversion: 2.1 time: 0.752136 Sep 14 09:39:34.603858 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 862/3859] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:33 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1509 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:34.610161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:34.611181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:34.620767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.621713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.622411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:34.623391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:34.624136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:34.624781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.019981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:35.029625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cf10d89-130f-472b-ac62-ed7502315bd1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.424841 Sep 14 09:39:35.032743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2998/3860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:34 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:35.062276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:35.063596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:35.073081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.073987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.074614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.075548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.076681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.077359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.556330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:35.572765 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21afea45-7fef-4b6b-9666-386e828e57f8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.515038 Sep 14 09:39:35.573479 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 863/3861] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:35 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:35.599885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:35.603087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 2d78049f-348d-40d6-a7c6-9c7bce737dd4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:35.612492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/2d78049f-348d-40d6-a7c6-9c7bce737dd4/action HTTP/1.1 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 28 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: {"reboot": {"type": "SOFT"}} Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2d78049f-348d-40d6-a7c6-9c7bce737dd4', 'body': {'reboot': {'type': 'SOFT'}}} Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. Sep 14 09:39:35.614086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:35.621733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 2d78049f-348d-40d6-a7c6-9c7bce737dd4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:35.627431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:35.628091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:35.632664 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-906a320a-3145-4c0c-b7af-72a9a5350fd3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/2d78049f-348d-40d6-a7c6-9c7bce737dd4/action" status: 404 len: 111 microversion: 2.1 time: 0.038224 Sep 14 09:39:35.633301 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 2999/3862] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:35 2022] POST /compute/v2.1/servers/2d78049f-348d-40d6-a7c6-9c7bce737dd4/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:35.651766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.652349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.652784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.653500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.653952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.654375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.662538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:35.663273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:35.674230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.679623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.680264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:35.681337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:35.682852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:35.688383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:36.314710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:36.328961 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b6d31aba-9d82-49d4-843e-a27b8b0c4525 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1509 microversion: 2.1 time: 0.705801 Sep 14 09:39:36.336762 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 864/3863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:35 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1509 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:36.443317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:36.452552 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17caf607-111c-40d7-9343-f6fc4926ed9c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.804275 Sep 14 09:39:36.453151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3000/3864] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:35 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:36.500574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:36.503087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:36.531840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:36.533999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:36.535151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:36.535949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:36.550365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:36.550861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:36.551310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.268053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:37.282400 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ff5e1e8-9c6a-462c-9964-e4d1fe34f708 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.805139 Sep 14 09:39:37.283009 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 865/3865] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:36 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:37.313923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:37.322447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:37.330754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.337661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.338349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.339234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.339761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.340404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.353087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:37.354342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:37.368936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.370279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.373550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.375092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.377766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.384560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:37.392104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action HTTP/1.1 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 65 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'cdf30564-dde0-40dd-b32c-c9cf6c3625d2', 'body': {'rebuild': {'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55'}}} Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:39:37.410965 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40439412-6288-4966-87b9-d69f38cffdd5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action" status: 404 len: 111 microversion: 2.1 time: 0.103639 Sep 14 09:39:37.418675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3001/3866] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:37 2022] POST /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2/action => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:37.429123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:37.429846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:37.437158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.437727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.438836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.439662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.440455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.441082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.664926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:37.680773 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a41cdf37-c2f8-4e1f-91ce-c9a5cbb99dad tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1515 microversion: 2.1 time: 0.325641 Sep 14 09:39:37.696118 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 866/3867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:37 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:37.826903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:37.844815 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b7692cf-c026-44d4-b401-4dbe3933d504 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.419942 Sep 14 09:39:37.847120 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3002/3868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:37 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:37.880235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:37.882401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:37.893052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.895981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.898623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:37.901123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:37.905774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:37.908782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:39.273938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:39.286932 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6d1fc70e-889d-4b19-9c08-8feb5dc7f95a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 1.411731 Sep 14 09:39:39.289631 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 867/3869] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:37 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:39.321249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:39.324487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 704544f9-ee5a-4a3d-be2f-fb0beb05a20c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:39.341406 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/704544f9-ee5a-4a3d-be2f-fb0beb05a20c/action HTTP/1.1 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 65 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '704544f9-ee5a-4a3d-be2f-fb0beb05a20c', 'body': {'rebuild': {'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55'}}} Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:39:39.347133 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 704544f9-ee5a-4a3d-be2f-fb0beb05a20c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:39.351968 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c265f5df-3d87-431f-bccf-25accb4ae32a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/704544f9-ee5a-4a3d-be2f-fb0beb05a20c/action" status: 404 len: 111 microversion: 2.1 time: 0.032283 Sep 14 09:39:39.358662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:39.368574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:39.373917 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3003/3870] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:39 2022] POST /compute/v2.1/servers/704544f9-ee5a-4a3d-be2f-fb0beb05a20c/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:39.379850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:39.380458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:39.381411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:39.382151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:39.382615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:39.383050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:40.238241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:40.251990 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-22988349-73e9-4313-899d-daa5884284a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.897546 Sep 14 09:39:40.253573 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 868/3871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:39 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:40.279159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:40.280141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:40.293348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:40.296481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:40.297227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:40.298198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:40.303142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:40.303956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:40.683096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0de7074a-8246-4598-bb49-ad90d9b89eef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: .version_select at 0x7f693f89f670>, body: {"keypair": {"name": "tempest-keypair-142396110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzLUfCoo5xIa4M+rPPnXzuznt4iTWHQBX0y3kSHkJzhacU+8RtzZ6k4qhpSJDFc+w5l6nZzfEhlouzFh9yUd5svFzRQHhBVnX5XhQBMyaWSljXdD7jDVAHuEGIAizIN2A=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:40.704808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0de7074a-8246-4598-bb49-ad90d9b89eef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for project 198415f4f0344cd5816fdf8998068bcf. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:39:40.715641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:40.725127 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8621f581-6a60-4df1-b8e8-5853dffe1df3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.449430 Sep 14 09:39:40.725736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3004/3872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:40 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:40.740323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0de7074a-8246-4598-bb49-ad90d9b89eef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for user ce2585d18cd04594b7f8ba9df37c5641 and project 198415f4f0344cd5816fdf8998068bcf. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:39:40.754422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:40.754985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 3eb315cd-1d74-4a1a-8d96-6b31727275de] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:40.766486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/3eb315cd-1d74-4a1a-8d96-6b31727275de/action HTTP/1.1 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: {"restore": {}} Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3eb315cd-1d74-4a1a-8d96-6b31727275de', 'body': {'restore': {}}} Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:40.768644 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 3eb315cd-1d74-4a1a-8d96-6b31727275de could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df0b8ed1-03f3-4e0d-a8f7-74f27303a23b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/3eb315cd-1d74-4a1a-8d96-6b31727275de/action" status: 404 len: 111 microversion: 2.1 time: 0.023528 Sep 14 09:39:40.775733 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3005/3873] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:40 2022] POST /compute/v2.1/servers/3eb315cd-1d74-4a1a-8d96-6b31727275de/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:39:40.782958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:40.783597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:40.794958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:40.796361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:40.797120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:40.798064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:40.799343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:40.801317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:40.811358 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0de7074a-8246-4598-bb49-ad90d9b89eef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132859 Sep 14 09:39:40.816875 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 869/3874] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:39:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:41.117849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:41.129721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5cefaabd-6ff7-4f14-9d5f-7d21c1ccfda9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.351665 Sep 14 09:39:41.155177 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3006/3875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:40 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:41.176284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:41.177029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:41.183945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.184822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.185462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:41.187842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.188769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.189471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:41.767334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:41.784963 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-49826a40-f174-41e5-81c2-5d85bc78a40a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.629406 Sep 14 09:39:41.800686 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 870/3876] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:41 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:41.815542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:41.816767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:41.828902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.829571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.830169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:41.831255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.831886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.838707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:41.887520 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'restore' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: {"restore": {}} Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'restore' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'restore': {}}} Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state active. Cannot restore while the instance is in this state. Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:41.892646 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:41.897189 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:41.897189 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:41.897189 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:41.897189 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:41.897189 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:39:41.899881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'restore' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:41.901040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-247ee74b-fd58-466a-8769-ee90a48e293f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 145 microversion: 2.1 time: 0.092932 Sep 14 09:39:41.903360 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3007/3877] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:41 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:39:41.912438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:41.913328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:41.925712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.926219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.926660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:41.928099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:41.928903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:41.929324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:42.234782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:42.247207 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b1409d1-c253-437c-8d75-fd48e1469a80 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.339565 Sep 14 09:39:42.248488 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 871/3878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:41 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:42.280460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:42.281681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:42.294925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:42.301045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:42.301815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:42.304345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:42.310306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:42.311109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:42.496126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:42.862364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:42.882370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5490c8cd-6ef5-4fdf-8cf9-ad8a75e4f8f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.606501 Sep 14 09:39:42.883329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3008/3879] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:42 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:42.907011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:42.907719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 2ca2408b-1d12-41ef-9014-22bdc84a9710] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:42.929124 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/2ca2408b-1d12-41ef-9014-22bdc84a9710/action HTTP/1.1 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 14 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: {"resume": {}} Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '2ca2408b-1d12-41ef-9014-22bdc84a9710', 'body': {'resume': {}}} Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:42.936627 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:42.942411 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:42.942411 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:42.942411 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. Sep 14 09:39:42.942411 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:42.942411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 2ca2408b-1d12-41ef-9014-22bdc84a9710 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:42.943257 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3864b602-e469-4054-a83b-c7c16b2e455f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/2ca2408b-1d12-41ef-9014-22bdc84a9710/action" status: 404 len: 111 microversion: 2.1 time: 0.039746 Sep 14 09:39:42.944599 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 872/3880] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:42 2022] POST /compute/v2.1/servers/2ca2408b-1d12-41ef-9014-22bdc84a9710/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:42.952746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:42.953371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:42.962859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:42.963350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:42.965946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:42.969076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:42.969732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:42.972447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:43.528760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:43.547596 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e1a048b-f892-4a60-9b0d-327423e6231d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.598687 Sep 14 09:39:43.548739 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3009/3881] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:42 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:43.576364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:43.577076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:43.589766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:43.591279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:43.591962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:43.594668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:43.595260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:43.595824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:43.992715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:44.000762 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92838b0b-156a-4e9d-9134-da37247b40a8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.428562 Sep 14 09:39:44.003409 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 873/3882] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:43 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:44.032063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:44.033233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:44.049544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.050968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.053956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.055632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.056793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.058398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.120901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:44.123188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-5164924", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "29b5dc92-79f5-49de-92b8-22658a807eda"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:44.133157 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'resume' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 14 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: {"resume": {}} Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'resume' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'resume': {}}} Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state active. Cannot resume while the instance is in this state. Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:44.134749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'resume' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-138aff7f-f0cc-472b-902a-582a69599318 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 144 microversion: 2.1 time: 0.111758 Sep 14 09:39:44.144941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 874/3883] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:44 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 144 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:39:44.148929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:44.149550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:44.158115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.158622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.159063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.160171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.160883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.161584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.244315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] validate_networks() for [('29b5dc92-79f5-49de-92b8-22658a807eda', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:39:44.447119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:44.458081 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ca9d29d-7191-4c04-a8af-6e448e46fb15 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.313431 Sep 14 09:39:44.459395 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 875/3884] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:44 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:44.486776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:44.488477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:44.500057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.501389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.502138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.503234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:44.503858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:44.504480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:44.721333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:44.738966 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f5fe526-66f6-425b-9170-0bd4f2230969 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.256189 Sep 14 09:39:44.741869 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 876/3885] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:44 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:45.033097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-764aa5e0-cfcb-4d29-9e3c-701bd1d7302c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-764aa5e0-cfcb-4d29-9e3c-701bd1d7302c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 160 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cddd25f6-377c-4af3-ba14-f3857c01c9d2"}]}} Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'body': {'server': {'name': '', 'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55', 'flavorRef': '452', 'networks': [{'uuid': 'cddd25f6-377c-4af3-ba14-f3857c01c9d2'}]}}} Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi '' Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:39:45.043360 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:39:45.048445 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.050921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-764aa5e0-cfcb-4d29-9e3c-701bd1d7302c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:45.052517 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-764aa5e0-cfcb-4d29-9e3c-701bd1d7302c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024458 Sep 14 09:39:45.059508 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 877/3886] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:45 2022] POST /compute/v2.1/servers => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:39:45.069496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:45.071618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:45.086224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.087015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.088311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:45.089508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.090118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.091402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:45.400150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:45.414336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ebafbd1-c8df-47d3-b914-7b3ce66f5d53 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.350909 Sep 14 09:39:45.420251 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 878/3887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:45 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:45.448268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:45.449253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:45.462519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.465682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.466252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:45.467101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.470952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.471521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:45.753266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:45.765324 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5c48aec9-4529-4421-8564-e26309fa17b0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.321860 Sep 14 09:39:45.789765 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 879/3888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:45 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:45.799669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:45.802766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 39ae91a1-12a1-46ca-84d3-9f336bd25b7e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:45.815959 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/39ae91a1-12a1-46ca-84d3-9f336bd25b7e/action HTTP/1.1 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 14 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: {"shelve": {}} Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '39ae91a1-12a1-46ca-84d3-9f336bd25b7e', 'body': {'shelve': {}}} Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:39:45.825332 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:39:45.835654 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:39:45.835654 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:39:45.835654 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. Sep 14 09:39:45.835654 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:39:45.842906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 39ae91a1-12a1-46ca-84d3-9f336bd25b7e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:39:45.846386 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-25ca450d-e824-4f7e-8bbf-90d229406f96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/39ae91a1-12a1-46ca-84d3-9f336bd25b7e/action" status: 404 len: 111 microversion: 2.1 time: 0.054958 Sep 14 09:39:45.851432 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 880/3889] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:45 2022] POST /compute/v2.1/servers/39ae91a1-12a1-46ca-84d3-9f336bd25b7e/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:39:45.869463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:45.870366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:45.894495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.895028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.898041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:45.900029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:45.902372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:45.902372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:46.105580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:39:46.106172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:39:46.106479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:39:46.110042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:39:46.110835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:39:46.135975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:46.136750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:46.137613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:46.138651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:46.139301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:46.139971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:46.193871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Getting quotas for project 965251f481454a6ba08cea2f74ab4eec. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:39:46.223469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Getting quotas for user 125b739f16194932a9a32511cdf5fc00 and project 965251f481454a6ba08cea2f74ab4eec. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:39:46.253320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:39:46.256543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:39:46.357201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f86d4cad-9547-4ae8-b75b-6b943b827b68 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574132 Sep 14 09:39:46.358422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3010/3890] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:39:46.381422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13f26d14-b142-4748-afcb-31f81188035b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:46.386623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13f26d14-b142-4748-afcb-31f81188035b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:46.407819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:46.421381 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0cbc5bf3-4bdf-454f-baba-e9303127cdca tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.563164 Sep 14 09:39:46.432085 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 881/3891] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:45 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:46.465934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:46.470179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:46.492419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:46.492990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:46.493444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:46.495323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:46.495807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:46.497696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:46.652544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-13f26d14-b142-4748-afcb-31f81188035b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:46.686249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13f26d14-b142-4748-afcb-31f81188035b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1213 microversion: 2.1 time: 0.318521 Sep 14 09:39:46.686899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3011/3892] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:46 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1213 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:47.636896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:47.655420 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f303880-1878-43b2-96d5-9b8052b2e1e0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 1.203089 Sep 14 09:39:47.656590 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 882/3893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:46 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:47.683554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:47.684954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:47.692931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:47.693805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:47.694740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:47.695699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:47.696406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:47.697066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:47.711614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:47.712599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:47.721990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:47.725760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:47.727336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:47.747781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:47.748674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:47.749345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:47.789661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'flavor' on Instance uuid a9eebd67-2f50-426f-a198-2dc13af1ccca {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:39:48.117806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:48.128655 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e3094b39-efae-4f1c-baf4-eb996eaff032 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1209 microversion: 2.1 time: 0.422387 Sep 14 09:39:48.132089 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 883/3894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:47 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1209 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:48.227256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-44164041", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf547488-52e4-4c17-aaa9-de542e807a98"}], "security_groups": [{"name": "tempest-securitygroup--644153473"}], "key_name": "tempest-keypair-142396110", "user_data": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:48.289459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dfbdd9d9-2d87-4b3b-b89a-efa620f95d6f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.610386 Sep 14 09:39:48.292715 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3012/3895] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:39:47 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:39:48.329325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:48.329827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:48.354772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:48.355271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:48.355753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:48.357500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:48.358053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:48.362024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:48.601135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] validate_networks() for [('cf547488-52e4-4c17-aaa9-de542e807a98', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:39:48.673877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:48.679143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:48.687222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-274bc0e3-81fb-4e04-8485-e4df50b38277 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.378076 Sep 14 09:39:48.689773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3013/3896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:48 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:49.161906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:49.175346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:49.205646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.219165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.220992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.224952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.227311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.228305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.700390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:49.711212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d09ccea7-b86b-4d6d-80fa-3e603f4d9e57 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1271 microversion: 2.1 time: 0.556942 Sep 14 09:39:49.729505 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3014/3897] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:49 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1271 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:49.747595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:49.748881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:49.760152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.761433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.762118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.763054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.764524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.765211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.902009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:39:49.903603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:39:49.904357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:39:49.905096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:39:49.906629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:39:49.943541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.946221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.946876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.950032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:49.951000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:49.952268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:49.976658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:39:49.984117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Getting quotas for user ce2585d18cd04594b7f8ba9df37c5641 and project 198415f4f0344cd5816fdf8998068bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:39:50.002337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:39:50.005189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:39:50.114075 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-114c3d8d-768b-4e23-aa37-9b8f84aa4aa0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.900726 Sep 14 09:39:50.115935 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 884/3898] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:39:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:39:50.128985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ad699d0-93a5-4d4a-a947-980d25a3f1ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:50.131520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8ad699d0-93a5-4d4a-a947-980d25a3f1ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:50.193311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:50.214102 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25f563f3-416c-415e-a1c4-0bccb786481d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.482382 Sep 14 09:39:50.237994 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3015/3899] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:49 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:50.348456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8ad699d0-93a5-4d4a-a947-980d25a3f1ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:50.360397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ad699d0-93a5-4d4a-a947-980d25a3f1ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1243 microversion: 2.1 time: 0.236485 Sep 14 09:39:50.362016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 885/3900] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:50 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1243 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:50.777454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:50.780244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:50.798515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:50.800064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:50.800728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:50.801753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:50.803374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:50.804273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:51.252577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:51.253215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:51.283136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:51.283844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:51.284122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:51.284846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:51.292414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:51.292865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:51.526260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:51.542797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bf29830-d484-4ab1-9f29-15707b2dbfb9 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.796493 Sep 14 09:39:51.548659 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3016/3901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:50 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:51.561596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:51.562907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:51.580749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:51.581259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:51.581700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:51.583830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:51.584667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:51.585040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:51.703268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:51.712111 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e27785f-5a8c-4db2-966f-417d76fed7ec tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1239 microversion: 2.1 time: 0.161958 Sep 14 09:39:51.712724 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3017/3902] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:51 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1239 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:51.948983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:51.967546 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77245692-f328-4a77-8d5a-4a0366a43b94 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.727961 Sep 14 09:39:51.970802 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 886/3903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:51 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:52.575202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:52.576509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:52.588382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:52.589140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:52.589825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:52.590783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:52.591478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:52.592931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:52.737659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:52.738868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:52.755917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:52.756625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:52.757236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:52.758119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:52.758756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:52.759345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:52.953679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:52.977238 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4f4773b-086e-4f45-a3c8-af7723515e6a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1301 microversion: 2.1 time: 0.241768 Sep 14 09:39:52.980116 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 887/3904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:52 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1301 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:53.000752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:53.004419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:53.015323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:53.126880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:53.135731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1b7adea-5e72-4890-9803-8e9de14082d0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.564332 Sep 14 09:39:53.163144 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3018/3905] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:52 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:53.665881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51073e2b-146b-4f26-8e99-8794ccae11b9", "tag": "54676367-ff7a-493b-b535-e3bcbc8cabb5"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:53.686201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:53.686978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:53.687598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:53.718383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] Creating event network-changed:54676367-ff7a-493b-b535-e3bcbc8cabb5 for instance 51073e2b-146b-4f26-8e99-8794ccae11b9 on n-h1-851028-12 Sep 14 09:39:53.723812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5ea89729-0894-42f2-a80a-b89b7ce0eba3 req-7d946ee3-f38f-4729-b158-ad20233f729e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061534 Sep 14 09:39:53.725040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3019/3906] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:54.005118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:54.005773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:54.015204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:54.015720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:54.016212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:54.021394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:54.037905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:54.041117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:54.178781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:54.192887 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5c7152b-ec08-43f0-8bc4-c05e94b6a138 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 1.197830 Sep 14 09:39:54.207924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 888/3907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:52 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:54.207924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:54.207924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:54.216519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:54.217020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:54.217457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:54.218177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:54.218633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:54.219065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:54.314885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:54.323370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d8bceac-76ba-4be0-b79a-1ef7ea103771 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1301 microversion: 2.1 time: 0.322643 Sep 14 09:39:54.324502 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3020/3908] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:53 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1301 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:54.674572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:54.684259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-67e26f9d-8e96-4d2b-983d-7690651fbc9b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.488632 Sep 14 09:39:54.698222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 889/3909] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:54 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:55.220915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:55.221542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:55.233374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:55.233865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:55.234967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:55.240318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:55.241212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:55.241833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:55.349094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:55.350807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:55.365708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:55.366482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:55.368435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:55.369505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:55.371344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:55.372069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:56.044891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:56.051277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:56.056700 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-daa2f236-3f20-4da5-b735-e3d3ab25ba9c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.711646 Sep 14 09:39:56.076398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3e54189-6a97-4937-8974-071bdb5bdb63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.857477 Sep 14 09:39:56.088792 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 890/3910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:55 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:56.100872 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3021/3911] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:55 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:56.111120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:56.117035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:56.166045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:56.169174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:56.169996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:56.170970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:56.171652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:56.172377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:56.573795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:56.587369 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-564e593e-2b59-4ac3-bbac-d590e2f9ec36 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.494033 Sep 14 09:39:56.589150 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 891/3912] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:56 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:57.109375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:57.110001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:57.112952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:57.117666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:57.124420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.124925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.125369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.126108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.126553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.126973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.132490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:57.139720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:57.221979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.222828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.223683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.236895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.238156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.239163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.431151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:57.449470 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-434ef32d-0bbb-4dd6-b2b8-2fe34d61e0f4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.344110 Sep 14 09:39:57.456755 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 892/3913] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:57 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:57.618734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:57.619419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:57.635574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.636366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.636989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.637868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:57.638482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:57.639067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:57.719304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:57.731461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d85854ce-e06a-4347-926e-9607f45ce5b9 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.625120 Sep 14 09:39:57.734643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3022/3914] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:57 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:57.881491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:57.895168 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52a462ba-0314-403a-b615-3fc2f38600d6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.281235 Sep 14 09:39:57.896390 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 893/3915] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:57 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:39:58.238953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:39:58.265798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.266179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.266679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.310251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] Creating event network-changed:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:39:58.318881 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-43cf0cf3-cfdf-40fd-9265-bd5937ee9083 req-b5a14046-7fbf-4652-8309-6c4ef8c7fa7e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084010 Sep 14 09:39:58.323331 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3023/3916] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:39:58.475437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:58.477479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:58.496143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.507883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.508374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.509144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.509611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.510045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.763948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:58.764752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:58.781392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.788068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.788989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.789777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.790261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.790695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.809247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:58.819412 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8d96607-7054-44b2-b181-38b6c16424f1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.348550 Sep 14 09:39:58.824665 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 894/3917] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:58 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:58.918915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:58.919524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:58.930996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.931495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.931955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:58.948330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:58.949095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:58.949748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:59.000786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:39:59.585175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:59.594668 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7fac3c9d-81f2-4035-a77b-6d2ebec62977 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.679656 Sep 14 09:39:59.600751 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 895/3918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:58 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:59.738189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:39:59.753664 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f88288a3-ffda-4fa7-a3e1-0f7d05dcb6f1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.994468 Sep 14 09:39:59.778930 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3024/3919] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:58 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:39:59.855057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:39:59.856272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:39:59.867206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:59.868861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:59.869299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:59.870016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:39:59.870469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:39:59.874073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:39:59.963459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:00.355184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:00.454176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:00.484771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47ac9192-fbdd-49b3-8a18-232a0896387d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.635392 Sep 14 09:40:00.488089 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 896/3920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:39:59 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:00.511564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51073e2b-146b-4f26-8e99-8794ccae11b9", "name": "network-vif-plugged", "status": "completed", "tag": "54676367-ff7a-493b-b535-e3bcbc8cabb5"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:00.524586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:00.525137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:00.525573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:00.553096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] Creating event network-vif-plugged:54676367-ff7a-493b-b535-e3bcbc8cabb5 for instance 51073e2b-146b-4f26-8e99-8794ccae11b9 on n-h1-851028-12 Sep 14 09:40:00.572411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1f41cf41-8604-4687-a044-dd711a24a1b5 req-a6dd485e-dd50-45c7-85eb-bc0b06e249bc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066821 Sep 14 09:40:00.573155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3025/3921] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:00.624434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:00.624989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:00.642096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:00.643014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:00.644066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:00.645446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:00.646758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:00.647707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:00.785487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:00.787457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:00.797874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:00.800568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:00.803428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:00.804588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:00.806017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:00.808709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:01.033293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:01.043656 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10f63ea1-3a48-4411-8667-369919b32e95 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.424855 Sep 14 09:40:01.047538 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 897/3922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:00 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:01.105285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:01.114400 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dfd6eb9c-2725-41a3-9f06-4b85984b94ef tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.333833 Sep 14 09:40:01.115074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3026/3923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:00 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:01.515872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:01.516553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:01.540168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:01.541040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:01.542295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:01.543214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:01.544489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:01.545100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:01.960850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:01.970383 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b42efdd-0d1e-4e11-9ed0-f62d47192d19 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.461378 Sep 14 09:40:01.975391 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 898/3924] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:01 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:02.074305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:02.076664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:02.089989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.090894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.091502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.092566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.093213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.094001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.144787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:02.146768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:02.182565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.183131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.183586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.184350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:02.184802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:02.187238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:02.435102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:02.455230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:02.464079 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eaca624f-408c-490d-86fb-f765c42aa152 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.313947 Sep 14 09:40:02.466918 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 899/3925] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:02 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:02.467616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-049f1f22-2209-4441-8659-1f3c196fd939 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1313 microversion: 2.1 time: 0.399432 Sep 14 09:40:02.479790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3027/3926] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:02 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:03.003096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:03.004002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:03.025524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.026034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.033049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.035448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.037641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.038353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.394159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:03.408680 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-309c1f8c-6498-4190-b98f-db2dee1b97a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.410020 Sep 14 09:40:03.411143 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 900/3927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:02 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:03.496593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:03.497953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:03.505050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:03.506293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:03.530012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.531856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.532661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:03.534065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.540575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.541346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.541829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.543193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.545971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.546632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:03.548744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:03.550294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:03.556062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:04.032574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:04.047802 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a14083b8-0f4e-4aa5-8ece-c2a24ff99362 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.547619 Sep 14 09:40:04.054336 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 901/3928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:03 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:04.435614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:04.436344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:04.439363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:04.446404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:04.450353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:04.451618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:04.453400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:04.454974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:04.456340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:04.852657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:04.862080 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8df892e4-7525-4b07-adc8-b21203d4f6e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.431352 Sep 14 09:40:04.879969 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 902/3929] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:04 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:05.081500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.082118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.095291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.095795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.098809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.099671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.102776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.103248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.359858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:05.373091 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d0d7d6b7-c93f-4f2a-8343-3e796ebc953e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.294494 Sep 14 09:40:05.376481 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 903/3930] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:05 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:05.379011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:05.402306 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-542d9c1c-d47b-4e72-ba13-45f11ca3600b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1501 microversion: 2.1 time: 1.913182 Sep 14 09:40:05.411289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3028/3931] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:03 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1501 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:05.444897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.445446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.465492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.472448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.473215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.476068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.479010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.479744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.766420 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-68131550-86c3-413f-b976-02d177da39c6 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "DELETE /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.328699 Sep 14 09:40:05.770078 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 904/3932] 10.222.0.90 () {58 vars in 1296 bytes} [Wed Sep 14 09:40:05 2022] DELETE /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9/os-server-password => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:40:05.785598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.786345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.799871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.800613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.803629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.804911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.811951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.812685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.859351 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-120d0c63-cc2e-4b09-af5d-5529a73ae92b tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.083207 Sep 14 09:40:05.864408 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3029/3933] 10.222.0.90 () {58 vars in 1293 bytes} [Wed Sep 14 09:40:05 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9/os-server-password => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:40:05.873150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.873666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.888788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.889686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.890132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.890849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.891507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.892129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.901079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:05.902637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:05.920553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.938693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.942048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.944253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:05.949066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:05.950460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:05.987292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:40:06.284943 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-525b274c-d679-4635-b48d-e51ed65a48e0 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "DELETE /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 204 len: 0 microversion: 2.1 time: 0.415383 Sep 14 09:40:06.288953 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 905/3934] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:40:05 2022] DELETE /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:40:06.306647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "name": "network-vif-plugged", "status": "completed", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:06.349322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:06.350137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:06.350751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:06.393684 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] Creating event network-vif-plugged:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:40:06.415221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-feefe968-2380-4f5d-9151-ffc45ffc6cc0 req-80077594-084f-4dfc-9211-5ef18aaf2f8d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122181 Sep 14 09:40:06.420994 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 906/3935] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:06.429788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:06.430498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:06.449334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:06.450051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:06.450270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:06.451000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:06.451450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:06.455215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:06.504698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:06.517157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b622392b-2b97-4e33-87f6-c1afd56c963b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.623715 Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3030/3936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:05 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:06.534451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:06.535412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:06.536150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:06.883585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:06.902666 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05820d78-62e1-4f7d-bb31-ef6e85e5a27c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.381986 Sep 14 09:40:06.903668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:06.907937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3031/3937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:06 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:06.937361 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-25418760-30a2-4244-b0e8-76c5aeb285db tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1507 microversion: 2.1 time: 0.514380 Sep 14 09:40:06.937626 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 907/3938] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:06 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:07.394322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20f2e7d2-3f81-47a5-a409-8f9445598e1c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Action: 'create', calling method: .version_select at 0x7f693f8fe820>, body: {"keypair": {"name": "tempest-keypair-573449210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWRfcfFh8kdLUT7LdKV0WLiI6rt8qzJoN79oJCQuajQNowmvR5/RptQVFQdEXDfbDrDtoUXPPkZ1Sou+DH4cOffkPpD5jnp3lBsCmHAyopgMjbZ0JQDCbRhJBDn3AcLcA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:07.451046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-20f2e7d2-3f81-47a5-a409-8f9445598e1c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:40:07.467347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-20f2e7d2-3f81-47a5-a409-8f9445598e1c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for user 448c43cada3c4f1c837e1e9f6602da26 and project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:40:07.507477 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20f2e7d2-3f81-47a5-a409-8f9445598e1c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.386085 Sep 14 09:40:07.526490 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3032/3939] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:40:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:07.548456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:07.550689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:07.570221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.570643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.571090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.573525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.574500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.575440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.827690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:07.841208 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5408ad8f-b8c9-44c9-8a8c-0d1a9fddaa68 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.301240 Sep 14 09:40:07.847468 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 908/3940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:07 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:07.952432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:07.961819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:07.964680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:07.965339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:07.983336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.983832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.984296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.985015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.985468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.985896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.994574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.995792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.996478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:07.997607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:07.998228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:07.998815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:08.028206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:08.277324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:08.285480 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a16ffa9-9f82-4e23-9914-7b3478a61342 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1507 microversion: 2.1 time: 0.324826 Sep 14 09:40:08.291161 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 909/3941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:07 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:08.570494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:08.572772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:08.589542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a0a46c3-1367-47ae-b568-93e926bfc5ea tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1368 microversion: 2.1 time: 0.647684 Sep 14 09:40:08.590148 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3033/3942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:07 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1368 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:08.874294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:08.875629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:08.891095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:08.896493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:08.898111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:08.899019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:08.901465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:08.902099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.318488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:09.319126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:09.332186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.332700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.333150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.334261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.335293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.347451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.598268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:09.626648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4c124d37-ef86-480c-bb82-f08aac7e6df1 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.756903 Sep 14 09:40:09.627254 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 910/3943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:08 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:09.648880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:09.649503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:09.659615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.660198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.660710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.661406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.661823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.662234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.851877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '125b739f16194932a9a32511cdf5fc00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '965251f481454a6ba08cea2f74ab4eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:09.867080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95f6e830-1cb3-4796-b4aa-ec24bad00d8d tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 200 len: 1465 microversion: 2.1 time: 0.553193 Sep 14 09:40:09.870918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3034/3944] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:09 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 1465 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:09.889777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:09.913331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51073e2b-146b-4f26-8e99-8794ccae11b9", "name": "network-vif-deleted", "tag": "54676367-ff7a-493b-b535-e3bcbc8cabb5"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:09.930276 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3d2db6f4-7c57-4820-b065-199600fb94c3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1562 microversion: 2.1 time: 0.301951 Sep 14 09:40:09.944272 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 911/3945] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:09 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1562 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:09.962989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.966488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:09.968436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:09.971962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.972421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.987915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.988422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.988874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.989637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:09.990381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:09.990885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:09.994035 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] Creating event network-vif-deleted:54676367-ff7a-493b-b535-e3bcbc8cabb5 for instance 51073e2b-146b-4f26-8e99-8794ccae11b9 on n-h1-851028-12 Sep 14 09:40:09.999578 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3b4bcf2f-4d34-4895-988f-0a088599efba req-93b6f9bd-c9ff-46ba-bc1d-939382171474 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098294 Sep 14 09:40:10.001012 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3035/3946] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:10.167056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7450d82e-e402-40cb-aeec-688ff72b7694 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.209691 Sep 14 09:40:10.168449 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 912/3947] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:40:09 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:10.349071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1024161838", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "8858e84c-ab7e-4cae-8f46-c9ce414196e0"}], "security_groups": [{"name": "tempest-securitygroup--342151734"}], "key_name": "tempest-keypair-573449210", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:10.587743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] validate_networks() for [('8858e84c-ab7e-4cae-8f46-c9ce414196e0', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:40:10.653194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:10.653987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:10.668960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:10.669863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:10.670496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:10.671506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:10.672181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:10.672622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.096954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:12.120189 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fe2e98ac-542d-4a84-ad8f-e9c5583a644e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1533 microversion: 2.1 time: 1.471536 Sep 14 09:40:12.125532 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 913/3948] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:10 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1533 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:12.136465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:12.137316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] [instance: 51073e2b-146b-4f26-8e99-8794ccae11b9] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:12.162936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.163841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.164727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.166269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.167422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.168665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.208959 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] HTTP exception thrown: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Request method failure captured: Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 HTTP/1.1 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaFfMVMEd6CRKvzyvDB3Vi8Xsu-EyFy3xN-k_w8vxuV74t5AgJMyBaOSsO9sRv7h2R1a4WH924WjAePTpOC2XOGhgGT21SPbWdNeuiVj1_I0B4_YgEZaBEGK-orzV9mtc3qjoMCeucpATjNC-Uox7ZNJb2w-iDL9oqQGANb5uu8vZ30 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 965251f481454a6ba08cea2f74ab4eec Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerPasswordTestJSON-264671132 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_965251f481454a6ba08cea2f74ab4eec", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/965251f481454a6ba08cea2f74ab4eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/965251f481454a6ba08cea2f74ab4eec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/965251f481454a6ba08cea2f74ab4eec"}]}] Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerPasswordTestJSON-264671132 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 965251f481454a6ba08cea2f74ab4eec Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerPasswordTestJSON-264671132 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerPasswordTestJSON-264671132-project Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 125b739f16194932a9a32511cdf5fc00 Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerPasswordTestJSON-264671132-project Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '51073e2b-146b-4f26-8e99-8794ccae11b9'} Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:12.213379 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. Sep 14 09:40:12.220817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:12.223577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] Returning 404 to user: Instance 51073e2b-146b-4f26-8e99-8794ccae11b9 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:40:12.225530 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3f3d99ea-2c02-4437-8de2-0c67db138ba8 tempest-ServerPasswordTestJSON-264671132 tempest-ServerPasswordTestJSON-264671132-project] 10.222.0.90 "GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9" status: 404 len: 111 microversion: 2.1 time: 0.103734 Sep 14 09:40:12.228437 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 914/3949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:12 2022] GET /compute/v2.1/servers/51073e2b-146b-4f26-8e99-8794ccae11b9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:40:12.636913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:40:12.638260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:40:12.641831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:40:12.642434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:40:12.643019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:40:12.664384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.665170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.665797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.666547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:12.667003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:12.667428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:12.688161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:40:12.696301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for user 448c43cada3c4f1c837e1e9f6602da26 and project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:40:12.713347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:40:12.716244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:40:12.791806 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff21985f-16d9-4e33-b746-426c54e4a59a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.446851 Sep 14 09:40:12.793086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3036/3950] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:40:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:40:12.809926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b15e21a3-de4a-4850-b238-392d4ef58c3d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:12.814680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b15e21a3-de4a-4850-b238-392d4ef58c3d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:13.137487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b15e21a3-de4a-4850-b238-392d4ef58c3d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:13.146054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b15e21a3-de4a-4850-b238-392d4ef58c3d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1241 microversion: 2.1 time: 0.340235 Sep 14 09:40:13.156356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:13.156980 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 915/3951] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:12 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1241 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:13.176518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:13.200693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:13.202274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:13.205662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:13.210583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:13.212060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:13.213718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:13.805232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "name": "network-vif-plugged", "status": "completed", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:13.944151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:13.944815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:13.945328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:13.971503 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] Creating event network-vif-plugged:b4e96758-6513-4caa-8c42-e20b291c98dc for instance a9eebd67-2f50-426f-a198-2dc13af1ccca on n-h1-851028-12 Sep 14 09:40:13.978243 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0ef2836f-26a6-48a6-9002-e4a42ce269b7 req-38cabee1-b277-457e-ab0c-29f3ccebfac7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181461 Sep 14 09:40:13.982749 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 916/3952] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:13.992273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:14.007331 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67c65cc5-31a7-4003-a685-51739394b51c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.852642 Sep 14 09:40:14.008333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3037/3953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:13 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:14.183298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:14.184048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:14.213307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.213919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.214705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.218036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.221169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.223040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.494563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:14.525992 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2def2463-0557-4fa7-8069-8f5b6b3bfc1b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1245 microversion: 2.1 time: 0.346756 Sep 14 09:40:14.533967 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 917/3954] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:14 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1245 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:14.890140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:14.920644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:14.921066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:14.921508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:14.967610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] Creating event network-changed:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:40:14.984794 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f1ebf451-cf09-46dd-b585-73f36eb1a1b8 req-ec600cb7-6c8b-4454-bd28-a1c059c2b4dc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097792 Sep 14 09:40:14.987326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3038/3955] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:15.030742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:15.031444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:15.057214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:15.057824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:15.058264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:15.058983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:15.059506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:15.059952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:15.555713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:15.556439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:15.565805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:15.571477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:15.580475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:15.582595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:15.589275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:15.589824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:15.847643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:15.890627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eda09bb3-ada8-4c20-a1a4-ecab84666430 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1311 microversion: 2.1 time: 0.337830 Sep 14 09:40:15.910286 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3039/3956] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:15 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:16.011860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:16.021671 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-744bb997-483e-423b-8df2-83696c55ff25 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.993996 Sep 14 09:40:16.037163 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 918/3957] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:15 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:16.934937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:16.936310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:16.956590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:16.957499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:16.958022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:16.960338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:16.960881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:16.961545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:17.058234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:17.060290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:17.074889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:17.075777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:17.076509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:17.077524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:17.078342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:17.079009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:17.190629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:17.209397 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-004027f7-bafa-4e4f-aa73-a2826f614930 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1299 microversion: 2.1 time: 0.278516 Sep 14 09:40:17.212346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3040/3958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:16 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:17.774498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:17.789382 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fecffb58-8afa-4a3f-b7b8-23c1fae3deb8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.738509 Sep 14 09:40:17.790791 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 919/3959] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:17 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:18.236783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:18.238061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:18.245767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:18.246640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:18.247379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:18.248300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:18.248910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:18.249498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:18.815818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:18.817609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:18.842042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:18.846187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:18.846906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:18.848704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:18.851878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:18.854528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:19.043566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:19.067581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94dada1f-4f21-4c7e-b557-c3fc71faa6ad tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.830426 Sep 14 09:40:19.073390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3041/3960] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:18 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:19.469465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:19.485672 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-33337948-f6f7-4728-9e10-4ad4bce70580 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.674308 Sep 14 09:40:19.493713 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 920/3961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:18 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:20.108161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:20.109888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:20.139256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:20.149382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:20.149845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:20.150609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:20.151074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:20.151503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:20.521690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:20.523045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:20.532889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:20.537999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:20.538846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:20.539796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:20.541683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:20.542357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:20.996856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:21.011272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c9b0545-49ba-4479-95c5-370d8b4778f5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.913380 Sep 14 09:40:21.011886 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3042/3962] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:20 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:21.320739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb69a36f-6165-4760-823c-7a6c095c58d1", "tag": "91c32187-e043-4f54-b93a-85d1e24c35cd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:21.337531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:21.338328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:21.338948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:21.357051 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] Creating event network-changed:91c32187-e043-4f54-b93a-85d1e24c35cd for instance eb69a36f-6165-4760-823c-7a6c095c58d1 on n-h2-851028-12 Sep 14 09:40:21.467752 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-77c49c7d-15f4-4df2-b9c2-9271d0537b4f req-6931ea53-a779-4494-af79-41153f1a6cbe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150689 Sep 14 09:40:21.468198 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3043/3963] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:21.568453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:21.589459 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f524d23-559d-4a7f-9211-77b164c42046 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 1.073217 Sep 14 09:40:21.591517 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 921/3964] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:22.044705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:22.045438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:22.064448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:22.066818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:22.068202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:22.069278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:22.071869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:22.073028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:22.456487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:22.479192 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-34368eed-6003-42d2-a760-3deb0365fc87 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.439927 Sep 14 09:40:22.495804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3044/3965] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:22 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:22.634815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:22.635426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:22.645554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:22.646655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:22.659152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:22.664105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:22.664666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:22.665120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:23.142363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:23.502772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:23.504007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:23.539169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:23.540343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:23.543413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:23.543947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:23.544402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:23.545120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:23.545774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:23.546368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:23.853282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:23.866225 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cdb572f6-157e-4e49-8bec-3deed618a87e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 1.236337 Sep 14 09:40:23.868404 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 922/3966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:24.059619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:24.077981 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e93941e3-804f-4565-8101-bd707904854f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.577648 Sep 14 09:40:24.083089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3045/3967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:23 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:24.897022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:24.898360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:24.915759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:24.917219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:24.917852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:24.920237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:24.922536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:24.923265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:25.110446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:25.111212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:25.127571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:25.133208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:25.136707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:25.139031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:25.140161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:25.147035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:25.389091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:25.399782 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-633f39f9-78e6-466d-bccb-45a620c81fd0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.508619 Sep 14 09:40:25.403132 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 923/3968] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:24 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:25.571601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:25.586929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5684a0b-5883-4e07-adee-89c879590d5a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.481564 Sep 14 09:40:25.588043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3046/3969] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:25 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:25.827108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb69a36f-6165-4760-823c-7a6c095c58d1", "name": "network-vif-plugged", "status": "completed", "tag": "91c32187-e043-4f54-b93a-85d1e24c35cd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:25.839104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:25.840665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:25.841289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:25.854774 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] Creating event network-vif-plugged:91c32187-e043-4f54-b93a-85d1e24c35cd for instance eb69a36f-6165-4760-823c-7a6c095c58d1 on n-h2-851028-12 Sep 14 09:40:25.870835 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-cfbce49a-4dfc-49c1-a866-11e3c8ec98f1 req-3ff61d37-0734-4084-9aa9-ac31b18cd980 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048259 Sep 14 09:40:25.873032 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 924/3970] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:26.431219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:26.432071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:26.446707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:26.450476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:26.451052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:26.454831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:26.455685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:26.456641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:26.628915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:26.630776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:26.646185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:26.649944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:26.650768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:26.651674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:26.652515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:26.655448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:26.951809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:26.962982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b1a166ef-6a78-40b4-abc0-fe0cabeada68 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1366 microversion: 2.1 time: 0.339433 Sep 14 09:40:26.964159 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 925/3971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:26 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:27.070850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:27.118168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-198f0dd0-2e83-4069-9089-9fbeba8637c9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.691862 Sep 14 09:40:27.121687 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3047/3972] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:26 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:27.820635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bac70868-3c68-4f1e-bcde-500f1efa9200 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Action: 'create', calling method: .version_select at 0x7f693f20e9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-571744180", "metadata": {"Type": "work"}}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:27.991222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:27.992291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:28.005619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.006204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.006644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.007348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.007798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.010313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.342890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:28.351989 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b83c7dc5-599c-42c3-9fe5-97352379932c tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1556 microversion: 2.1 time: 0.364822 Sep 14 09:40:28.353947 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3048/3973] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:27 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1556 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:28.358948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:28.359801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:28.367618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.368293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.368976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.370095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.370631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.371208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.517006 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bac70868-3c68-4f1e-bcde-500f1efa9200 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.941770 Sep 14 09:40:28.517827 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 926/3974] 10.222.0.90 () {60 vars in 1156 bytes} [Wed Sep 14 09:40:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 944 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 09:40:28.530617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:28.534362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:28.573075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.573586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.579126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.581969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:28.582466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:28.584932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:28.719294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:28.738714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ca711a3-0705-4152-93af-c33b0fc1dcc2 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216780 Sep 14 09:40:28.739337 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 927/3975] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:40:28 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:28.745068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1fb13e15-2652-4749-b038-47f9ccbe0163 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f26e040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:28.745443 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0f9f058-9384-4c1e-aa0f-4a8f90a04660 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.388075 Sep 14 09:40:28.746277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3049/3976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:28 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:28.863861 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1fb13e15-2652-4749-b038-47f9ccbe0163 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.122649 Sep 14 09:40:28.865805 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 928/3977] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:28 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:29.777118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:29.778600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:29.794251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:29.795075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:29.795773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:29.798202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:29.799963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:29.802344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:29.886655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e45a5001-2448-4ccc-8f12-8d7f46ca50bf tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f23b4c0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:30.035654 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e45a5001-2448-4ccc-8f12-8d7f46ca50bf tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.158161 Sep 14 09:40:30.036994 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 929/3978] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:29 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:30.377110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:30.403398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-465b0179-ca76-4240-8bed-5e5fc93465e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.634247 Sep 14 09:40:30.406136 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3050/3979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:29 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:31.051243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0c26561e-a694-4561-815f-c57b8af32606 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f26de50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:31.137011 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0c26561e-a694-4561-815f-c57b8af32606 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 353 microversion: 2.1 time: 0.091379 Sep 14 09:40:31.137604 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 930/3980] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:31 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:31.157298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19446921-83c1-46dd-83b9-e84d910a8f7e tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693fa27040>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:31.253510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19446921-83c1-46dd-83b9-e84d910a8f7e tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 353 microversion: 2.1 time: 0.106183 Sep 14 09:40:31.256422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3051/3981] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:31 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:31.270913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2b2946a-eda5-4f04-b412-59668201a6ad tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f1f9700>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:31.316413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb69a36f-6165-4760-823c-7a6c095c58d1", "tag": "91c32187-e043-4f54-b93a-85d1e24c35cd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:31.328979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:31.329841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:31.330532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:31.365365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] Creating event network-changed:91c32187-e043-4f54-b93a-85d1e24c35cd for instance eb69a36f-6165-4760-823c-7a6c095c58d1 on n-h2-851028-12 Sep 14 09:40:31.370988 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9336dd30-2f06-410d-a729-06783a983fe2 req-344ffac8-6162-4bcc-a879-ff10192034dc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059750 Sep 14 09:40:31.372285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3052/3982] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:31.434879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:31.436036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:31.445416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:31.446389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:31.447259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:31.448674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:31.449371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:31.452448 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2b2946a-eda5-4f04-b412-59668201a6ad tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 202 len: 0 microversion: 2.1 time: 0.187037 Sep 14 09:40:31.454516 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 931/3983] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:40:31 2022] DELETE /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:40:31.454955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:31.469654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b861adb2-0dd4-4445-920d-12ab4050bd8d tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f26e790>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:31.591022 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b861adb2-0dd4-4445-920d-12ab4050bd8d tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.132648 Sep 14 09:40:31.597643 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 932/3984] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:31 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:40:31.972838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:31.986030 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9cc2dd74-7849-418d-b8d1-2192cee5cbc7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.559881 Sep 14 09:40:31.993333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3053/3985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:31 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:32.606994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4881b327-a37a-49c5-bcb9-3fbc4896a8be tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f20e5e0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:32.728808 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4881b327-a37a-49c5-bcb9-3fbc4896a8be tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.125810 Sep 14 09:40:32.729781 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 933/3986] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:32 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:33.018838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:33.019454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:33.050888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:33.051393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:33.053272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:33.053272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:33.053272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:33.053632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:33.342442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:33.345247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:33.365468 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77796071-798f-445b-a5c4-8b6f487c6b52 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.350486 Sep 14 09:40:33.371079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3054/3987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:33 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:33.746390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85571f03-bb60-46b6-ad90-e25b7fa4e8ce tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f26e280>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:33.868083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85571f03-bb60-46b6-ad90-e25b7fa4e8ce tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.126871 Sep 14 09:40:33.869371 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 934/3988] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:33 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:34.399468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:34.400814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:34.423606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:34.440194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:34.440807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:34.441354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:34.442265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:34.443243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:34.454460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:34.818793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:34.830384 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17661034-209e-47b0-a5dd-889627092f63 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.435527 Sep 14 09:40:34.830999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3055/3989] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:34 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:34.885135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77fe5663-d3a3-426f-85b0-01f8f508f45f tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f6947b4e1f0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:34.976368 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77fe5663-d3a3-426f-85b0-01f8f508f45f tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 200 len: 352 microversion: 2.1 time: 0.096997 Sep 14 09:40:34.977107 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 935/3990] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:34 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:35.867993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:35.869290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:35.888781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:35.889570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:35.890179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:35.891073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:35.891690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:35.892306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:36.001116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8133e034-a0be-480d-98c7-06065e16ce71 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Calling method '.version_select at 0x7f693f26de50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:36.073366 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-8133e034-a0be-480d-98c7-06065e16ce71 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] HTTP exception thrown: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8133e034-a0be-480d-98c7-06065e16ce71 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Request method failure captured: Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 HTTP/1.1 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaGLn30sZCZj2-GA4Y0524tqT0kWU1dN2IOx0i5Vv4Q0-C7tAo6Knqf-w4xuMwkziENcNn4VaK-BNYx-gJezVxY5GtCKgmHakIh7iXtCG0dWRcgcnS9Zskn-BhHO4S9kw_WTrtpnEJ4o2EO6Fyg4vOb3RybRwzXEWFsQcAt3JtsgsAg Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: db0671a5421a406d99f0b9c6b5bd32b3 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-VolumesGetTestJSON-64526221 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_db0671a5421a406d99f0b9c6b5bd32b3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/db0671a5421a406d99f0b9c6b5bd32b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/db0671a5421a406d99f0b9c6b5bd32b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/db0671a5421a406d99f0b9c6b5bd32b3"}]}] Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-VolumesGetTestJSON-64526221 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: db0671a5421a406d99f0b9c6b5bd32b3 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-VolumesGetTestJSON-64526221 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-VolumesGetTestJSON-64526221-project Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 72b2eced78fa42d791086df62c975e93 Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-VolumesGetTestJSON-64526221-project Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: exception: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'df8ff941-5f36-49d6-9c45-489921968b49'} Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. (HTTP 404) (Request-ID: req-03f52be7-69ba-4236-8f04-286e54cd6f8f) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:40:36.077383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8133e034-a0be-480d-98c7-06065e16ce71 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] Returning 404 to user: Volume df8ff941-5f36-49d6-9c45-489921968b49 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8133e034-a0be-480d-98c7-06065e16ce71 tempest-VolumesGetTestJSON-64526221 tempest-VolumesGetTestJSON-64526221-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49" status: 404 len: 109 microversion: 2.1 time: 0.091991 Sep 14 09:40:36.086991 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 936/3991] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:40:35 2022] GET /compute/v2.1/os-volumes/df8ff941-5f36-49d6-9c45-489921968b49 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:40:36.185718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:36.200450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5abc3e2e-27e3-4698-8421-045842df79f9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1528 microversion: 2.1 time: 0.343888 Sep 14 09:40:36.201979 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3056/3992] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:35 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1528 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:37.237819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:37.240192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:37.258940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:37.267553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:37.268806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:37.269508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:37.270463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:37.271419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:37.272516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:37.498423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:37.512696 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b2fc053-3035-4d8f-8292-f32dc5b9040b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1510 microversion: 2.1 time: 0.289352 Sep 14 09:40:37.522323 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 937/3993] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:37 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:38.551346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:38.554077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:38.565632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:38.566458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:38.567352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:38.569073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:38.569937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:38.572664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:38.838667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:38.853597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ecbe093-b9f9-4f98-a23d-8cd6a3a6f77c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1510 microversion: 2.1 time: 0.317889 Sep 14 09:40:38.865994 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3057/3994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:38 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:39.892370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:39.893596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:39.917632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:39.918763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:39.919213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:39.923988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:39.927493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:39.928408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:39.934592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=89 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:40:40.308703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:40.319547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c033d1e-64a5-4d43-9dcf-c4eb253c23a9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1513 microversion: 2.1 time: 0.433474 Sep 14 09:40:40.339961 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 938/3995] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:39 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1513 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:40.345073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:40.345685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:40.363438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.364275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.364904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.365895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.366513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.367095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.591153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:40.600821 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e290ccf-65eb-42cf-85ae-2f703be96a09 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1453 microversion: 2.1 time: 0.259516 Sep 14 09:40:40.621190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3058/3996] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:40 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1453 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:40.667402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:40.667950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:40.681535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.682042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.682478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.683312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.683791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.684246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.731797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'flavor' on Instance uuid a9eebd67-2f50-426f-a198-2dc13af1ccca {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:40:40.752551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'shelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state shelved_offloaded Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 14 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: {"shelve": {}} Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'shelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state shelved_offloaded Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'shelve': {}}} Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:40:40.754479 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state shelved_offloaded Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state shelved_offloaded Sep 14 09:40:40.760256 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:40:40.762841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'shelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state shelved_offloaded {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:40:40.764362 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-766e008b-1a7f-4109-bba6-092aa7f1d85d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 155 microversion: 2.1 time: 0.100644 Sep 14 09:40:40.775513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:40.776163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:40.783039 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 939/3997] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:40:40 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 155 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:40:40.785992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.787572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.788642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.789601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.790339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.791011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.841412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122444) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 09:40:40.949482 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de34e038-8a9f-477f-a0f0-881669fd3f47 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.177825 Sep 14 09:40:40.950489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3059/3998] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:40:40 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:40:40.958725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:40.960378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:40.973049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.973504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.975250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:40.977472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:40.978639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:40.980290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:41.445712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:41.460590 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80fbbd4c-a875-4aef-b9f4-d866139d8314 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1461 microversion: 2.1 time: 0.500662 Sep 14 09:40:41.472621 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 940/3999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:40 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1461 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:41.548714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "name": "network-vif-unplugged", "status": "completed", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:41.584686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:41.588590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:41.590398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:41.617139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.compute.server_external_events [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] Unable to find a host for instance a9eebd67-2f50-426f-a198-2dc13af1ccca. Dropping event network-vif-unplugged {{(pid=122444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 09:40:41.620005 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-747c7a25-e012-40da-856d-0262f1ae48fb req-285959d0-83c5-4c0c-9481-1b9da42387b5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.076129 Sep 14 09:40:41.625689 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3060/4000] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 09:40:42.487550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:42.488380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:42.499920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:42.502040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:42.502497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:42.504356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:42.504852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:42.505834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:42.715656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:42.730411 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b807e4b-d2f9-4c51-8bd9-e07309a13b39 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1461 microversion: 2.1 time: 0.244439 Sep 14 09:40:42.733357 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 941/4001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:42 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1461 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:43.754829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:43.756077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:43.769593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:43.770104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:43.771085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:43.776565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:43.777363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:43.778817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:44.113747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:44.122854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6376081a-674d-46e2-b236-440197f9b9ab tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.372060 Sep 14 09:40:44.140728 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3061/4002] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:43 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:45.147632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:45.148291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:45.159819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:45.169986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:45.173813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:45.174805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:45.177734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:45.179859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:45.550731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:45.565995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e346e2b-b5cc-459d-98e7-385fff57cda5 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.422803 Sep 14 09:40:45.567158 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 942/4003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:45 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:46.592883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:46.604613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:46.619344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:46.620588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:46.635072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:46.641034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:46.644251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:46.644790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:46.969931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:46.986261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86ff6b06-373a-4a3a-bf5d-08059729c81e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.397169 Sep 14 09:40:46.990106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3062/4004] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:46 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:48.023168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:48.025433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:48.063877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.065757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.066285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.071642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.072185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.072622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.373967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db5300f7-5a01-479a-8e96-e33c7ef22efe"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:40:48.377302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:48.387050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.387566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.388015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.388908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:48.419363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:48.421229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:48.560253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:48.571479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d7e81c1-70da-4dbf-9eaa-73acdfbc64e8 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.560111 Sep 14 09:40:48.575876 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 943/4005] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:48 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:49.137311 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8b7a273b-9606-48aa-b5d2-ace2e63de804 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764069 Sep 14 09:40:49.140417 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3063/4006] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:40:48 2022] POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:40:49.602680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:49.604484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:49.627111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:49.627630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:49.628111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:49.633176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:49.634221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:49.635580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:49.997293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:50.015699 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ba0f2d7d-0186-4585-ac57-3e1f18635467 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.419923 Sep 14 09:40:50.016725 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 944/4007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:49 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:51.061997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:51.066066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:51.093222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:51.094257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:51.094906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:51.102391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:51.104875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:51.106251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:51.563198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:51.596014 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcbfe93d-f1cc-427a-b61f-f4b8e2626fb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.546119 Sep 14 09:40:51.598488 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3064/4008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:51 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:52.627272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:52.627913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:52.647224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:52.648001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:52.651634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:52.652669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:52.656542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:52.665864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:53.142781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:53.154384 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ecf0e350-93a8-4b39-92ca-b958684290e3 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.533113 Sep 14 09:40:53.158288 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 945/4009] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:52 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:54.204080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:54.207366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:54.236091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:54.237054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:54.241069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:54.242482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:54.244510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:54.246231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:54.642801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:54.665223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d1b4a5b-42c0-447a-b926-2a40f793ecfb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.474350 Sep 14 09:40:54.676271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3065/4010] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:54 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:55.694349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:55.695374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:55.710398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:55.714362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:55.716474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:55.717458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:55.718101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:55.718715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:56.041826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:56.051045 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-95c52453-62a3-44c8-8eeb-4d2a0480d834 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.361635 Sep 14 09:40:56.055684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 946/4011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:55 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:40:57.102302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:57.102302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:57.115873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:57.116629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:57.117253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:57.122556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:57.123241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:57.123849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:57.369129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:57.369711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:57.383532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:57.384173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:57.384629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:57.386663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:57.387148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:57.387593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:57.489090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:57.500669 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe041145-cb01-4ca4-8fef-c127d89cf8fe tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.408315 Sep 14 09:40:57.512731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3066/4012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:57 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:57.601786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lazy-loading 'services' on Instance uuid eeb4e37c-7add-4bb9-97b1-cc44e429f327 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:40:57.796087 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7fedcd3c-b4d6-4eb8-928b-6252ec0af5db tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "DELETE /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327/os-volume_attachments/fbfb53fe-26d8-4576-963c-81ca712f0545" status: 202 len: 0 microversion: 2.1 time: 0.431229 Sep 14 09:40:57.797178 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 947/4013] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:40:57 2022] DELETE /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327/os-volume_attachments/fbfb53fe-26d8-4576-963c-81ca712f0545 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:40:58.544573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:58.546389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:58.555817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:58.557148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:58.557924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:58.558940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:58.559620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:58.560346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:58.807063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:40:58.815170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22109816-e784-4495-a3c0-2debbfc9bd14 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.274976 Sep 14 09:40:58.823239 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3067/4014] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:58 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:40:59.842106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:40:59.842874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:40:59.861832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:59.862334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:59.862917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:40:59.863639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:40:59.864221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:40:59.864690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:00.287607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:00.310076 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b73338e-d230-4def-8ecf-5c4921d3f620 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.472346 Sep 14 09:41:00.324342 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 948/4015] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:40:59 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:01.340245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:01.341455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:01.355671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:01.358257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:01.359029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:01.360089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:01.362640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:01.364382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:02.105557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:02.115256 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c03baf9-0c84-414b-ae03-9ab4f9a9169a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.778598 Sep 14 09:41:02.117157 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3068/4016] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:01 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:03.144352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:03.146185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:03.175940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:03.176440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:03.177436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:03.178512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:03.178976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:03.179405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:03.587164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:03.608112 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e7dcfc7f-dabf-4334-bb07-3a76a0121ffc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.469042 Sep 14 09:41:03.612051 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 949/4017] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:03 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:04.633806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:04.635063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:04.642391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:04.655282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:04.658074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:04.658821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:04.660420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:04.663103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:04.667095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:04.680522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:04.992103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:05.023459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b07b4769-24b6-455a-b73c-27facde55a8e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.394905 Sep 14 09:41:05.027140 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3069/4018] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:04 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:05.276852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:05.280470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:05.295181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:05.295785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:05.296257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:05.297570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:05.298187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:05.298621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:05.354883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'flavor' on Instance uuid dd3b122b-639e-47bc-90e4-994c6f0230d5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:41:05.572440 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9fbb8f2-5e19-4a18-9b9a-20fe42add4db tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/action" status: 200 len: 32 microversion: 2.1 time: 0.302144 Sep 14 09:41:05.573657 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 950/4019] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:05 2022] POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:41:05.583724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:05.584440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:05.599017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:05.599017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:05.601198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:05.604346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:05.604918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:05.605504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:05.870309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "name": "network-vif-plugged", "status": "completed", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:05.886909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:05.887603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:05.888360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:05.911679 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] Creating event network-vif-plugged:b4e96758-6513-4caa-8c42-e20b291c98dc for instance a9eebd67-2f50-426f-a198-2dc13af1ccca on n-h1-851028-12 Sep 14 09:41:05.919991 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ec83967d-669b-4d41-a6b0-b1d54c423a7f req-d9d85549-11e5-400d-a2c6-40d85f21c9f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054909 Sep 14 09:41:05.921204 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 951/4020] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:06.057591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:06.058357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:06.085467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.086852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.087311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.093958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.095250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.097762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.139617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:06.193251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d6131e4-ecba-487c-9fc4-4cad8e6769e8 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.613397 Sep 14 09:41:06.194529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3070/4021] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:05 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:06.203486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:06.223123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:06.252755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.257156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.257968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.260236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.260945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.261596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.319934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:41:06.551819 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-403b1ee6-0c11-435f-a583-0648ce26cb5a tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "DELETE /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 204 len: 0 microversion: 2.1 time: 0.354532 Sep 14 09:41:06.559559 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3071/4022] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:41:06 2022] DELETE /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:41:06.570128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:06.578311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:06.595680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.597738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.604068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.604988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:06.605547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:06.606052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:06.653732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:06.657672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:06.675704 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fcbd81a3-6d28-4a2e-bb54-def45ba3413d tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.621202 Sep 14 09:41:06.689616 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 952/4023] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:06 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:07.228668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:07.229590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:07.254238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:07.254916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:07.256100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:07.257631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:07.258196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:07.259121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:07.508779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:07.518241 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7e7fed3f-5348-4b63-a602-ec34c8b1d1b7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.294947 Sep 14 09:41:07.525526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 953/4024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:07 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:07.597809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:07.611972 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24c1400e-b7ad-4ea2-80e6-0a28c699ed67 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1468 microversion: 2.1 time: 1.047121 Sep 14 09:41:07.613227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3072/4025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:06 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1468 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:07.710208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:07.710208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:07.718646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:07.720802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:07.725901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:07.726649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:07.729064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:07.729776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:07.730439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:07.965823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:07.987453 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4c27da95-1e0c-4c53-9b00-f00692ad6491 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.284313 Sep 14 09:41:08.002113 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 954/4026] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:07 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:08.570725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:08.571423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:08.596374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:08.597790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:08.598259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:08.601892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:08.602403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:08.603076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:08.661513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:08.662914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:08.671994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:08.672828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:08.673344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:08.674231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:08.674763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:08.675259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.031482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:09.045230 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-20a8cc5f-72a6-4c0f-ae27-9cc999bbb908 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1468 microversion: 2.1 time: 0.400654 Sep 14 09:41:09.045864 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 955/4027] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:08 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:09.060139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:09.060361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:09.060361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:09.061237 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d6950e1-9447-4546-98db-6dbc8c33854e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.507197 Sep 14 09:41:09.069778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:09.070290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:09.070740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.070981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3073/4028] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:08 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:09.097310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:09.097768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:09.098215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.352054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada401ea-bd72-491c-bd36-19c2062a0292"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:09.354536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:09.366377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:09.367010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:09.367319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.368073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:09.385302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:09.386598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.592474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:09.600426 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24fbf44b-774c-44e9-a419-5f18cbbcbbb0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1519 microversion: 2.1 time: 0.553425 Sep 14 09:41:09.601013 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 956/4029] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:09 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1519 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:09.846439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-911e5e4f-c4b0-4b00-b590-86b707ffe41a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "POST /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498956 Sep 14 09:41:09.847519 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3074/4030] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:41:09 2022] POST /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:09.894669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb4e37c-7add-4bb9-97b1-cc44e429f327", "name": "network-vif-deleted", "tag": "37c8b85a-55ee-40b3-8b2e-20e33bb410c8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:09.918588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:09.919682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:09.920603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:09.940131 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] Creating event network-vif-deleted:37c8b85a-55ee-40b3-8b2e-20e33bb410c8 for instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 on n-h2-851028-12 Sep 14 09:41:09.982883 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7be9412a-8875-4fba-af40-0f12eaf29bea req-8b56a693-9cb3-49ab-a6c5-dc71ccfac195 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099884 Sep 14 09:41:10.009572 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 957/4031] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:10.075682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:10.076670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:10.089574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.092444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.102984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:10.105802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:10.108648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.113289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.118158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.123715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.130337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.133287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.135236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.137370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.138018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.139823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.224682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.225929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.226834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.227653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lazy-loading 'fault' on Instance uuid eeb4e37c-7add-4bb9-97b1-cc44e429f327 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:41:10.308309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc6dd5d197de4e888960d41bd82f03ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b380b75f35f543e7a09fabaf873a15f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:10.320560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40ae3bab-9d75-432a-bd9d-e514ef0eeaa3 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 200 len: 1304 microversion: 2.1 time: 0.251004 Sep 14 09:41:10.321247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3075/4032] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:10 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 1304 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:10.628049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:10.628598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:10.641594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.642099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.642546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.643275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.643735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.644211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.929497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:10.939112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-464a1498-425b-4154-b3c6-ae785df500ad tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.316211 Sep 14 09:41:10.957980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:10.959743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3076/4033] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:10 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:10.970544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:10.971466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:10.973647 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a62cc0f1-0cbc-4ae9-aedb-5d83a2502d3a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.876667 Sep 14 09:41:10.974984 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 958/4034] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:10 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:10.978898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.979374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.980004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:10.980712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:10.981476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:10.982047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.256670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:11.269160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a29af464-69d5-4d13-85c2-eb9e111485cc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.302621 Sep 14 09:41:11.282038 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3077/4035] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:10 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:11.308295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:11.309640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.332089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.350261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:11.352716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] [instance: eeb4e37c-7add-4bb9-97b1-cc44e429f327] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:11.372075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.372903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.374765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.376250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.378708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.379330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.397824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] HTTP exception thrown: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Request method failure captured: Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 HTTP/1.1 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEf-sNWsyQsHiG_o2-87lfbqZIibX5FR0mCjJShwYIJYOOOT8khcSE4jlxDLQV5neR1lFcJ_405tpAqqYDvrrbHyCpUD5lvaNYncHMQxfhxsF2hkp4EtqcfpOqDi1fbwCLGgiIZ8kZLufWb_T0YH7oydQm5nt5M36IFSJL1gBGLby8 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b380b75f35f543e7a09fabaf873a15f3 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesBackupsTest-1340497361 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b380b75f35f543e7a09fabaf873a15f3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b380b75f35f543e7a09fabaf873a15f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b380b75f35f543e7a09fabaf873a15f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b380b75f35f543e7a09fabaf873a15f3"}]}] Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesBackupsTest-1340497361 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b380b75f35f543e7a09fabaf873a15f3 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesBackupsTest-1340497361 Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesBackupsTest-1340497361-project Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: bc6dd5d197de4e888960d41bd82f03ba Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesBackupsTest-1340497361-project Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'eeb4e37c-7add-4bb9-97b1-cc44e429f327'} Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:11.399764 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] Returning 404 to user: Instance eeb4e37c-7add-4bb9-97b1-cc44e429f327 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:11.405702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f297e1c5-6962-453b-ac36-2445d97c6e09 tempest-VolumesBackupsTest-1340497361 tempest-VolumesBackupsTest-1340497361-project] 10.222.0.90 "GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327" status: 404 len: 111 microversion: 2.1 time: 0.057234 Sep 14 09:41:11.408901 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3078/4036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:11 2022] GET /compute/v2.1/servers/eeb4e37c-7add-4bb9-97b1-cc44e429f327 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:11.708421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:11.726814 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8a5e3ed4-7f9d-4376-9656-03686d9d96cf tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.423240 Sep 14 09:41:11.727923 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 959/4037] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:11 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:11.751688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01931291-1705-429c-bd69-11fcf9fb463b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:11.759288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-01931291-1705-429c-bd69-11fcf9fb463b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01931291-1705-429c-bd69-11fcf9fb463b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/3c94b169-5058-499d-b577-af4087474631/action HTTP/1.1 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: {"os-stop": {}} Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3c94b169-5058-499d-b577-af4087474631', 'body': {'os-stop': {}}} Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:11.770090 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01931291-1705-429c-bd69-11fcf9fb463b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 3c94b169-5058-499d-b577-af4087474631 has no mapping to a cell. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:11.774838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01931291-1705-429c-bd69-11fcf9fb463b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/3c94b169-5058-499d-b577-af4087474631/action" status: 404 len: 117 microversion: 2.1 time: 0.026067 Sep 14 09:41:11.779549 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3079/4038] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:11 2022] POST /compute/v2.1/servers/3c94b169-5058-499d-b577-af4087474631/action => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:11.784746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:11.785445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:11.795699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.796278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.796842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:11.797626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:11.798094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:11.798650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.003548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:12.004214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:12.018622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.019136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.019585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.020343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.023999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.024512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.116874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:12.140364 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-60a2118d-1cf7-41be-bac2-7d0b1e322f0c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.360047 Sep 14 09:41:12.145287 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 960/4039] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:11 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:12.170808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:12.175075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:12.196114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.196611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.197042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.205244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.208655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.210497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.319476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:12.336791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed4f8f21-e31b-4030-9d6f-990e563bbcc0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.337381 Sep 14 09:41:12.339999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3080/4040] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:11 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:12.584954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:12.593286 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-76779f6b-3de7-4d34-bb1b-a24fdb33cd42 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.426721 Sep 14 09:41:12.594186 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 961/4041] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:12 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:12.618787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:12.619789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 775ecb41-3f08-41b6-bb5f-89f02e185ce8] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:12.625926 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/775ecb41-3f08-41b6-bb5f-89f02e185ce8/action HTTP/1.1 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: {"suspend": {}} Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '775ecb41-3f08-41b6-bb5f-89f02e185ce8', 'body': {'suspend': {}}} Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:12.627837 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 775ecb41-3f08-41b6-bb5f-89f02e185ce8 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86048c9d-6ea5-400a-8445-01fb7cd1f190 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/775ecb41-3f08-41b6-bb5f-89f02e185ce8/action" status: 404 len: 111 microversion: 2.1 time: 0.017755 Sep 14 09:41:12.635412 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3081/4042] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:12 2022] POST /compute/v2.1/servers/775ecb41-3f08-41b6-bb5f-89f02e185ce8/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:12.639070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:12.639691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:12.646851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.647452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.647891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.648615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.649066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.649486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.846193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:12.855013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-354e9b96-651c-461f-8944-f49843efd323 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.219553 Sep 14 09:41:12.864968 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 962/4043] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:12 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:12.888740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:12.889867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:12.903851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.904778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.905446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:12.906950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:12.912261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:12.913529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.115130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:13.126186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99d892cf-b84a-4a14-91e3-2d2002841a37 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.241370 Sep 14 09:41:13.132374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3082/4044] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:12 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:13.158534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:13.170209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:13.187760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.188598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.189691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.190671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.191347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.192047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.228601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'flavor' on Instance uuid a9eebd67-2f50-426f-a198-2dc13af1ccca {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:41:13.365124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:13.366360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:13.375112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.376673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.377421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.378442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.379131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.380345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.431720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ea6c18df-1bf3-4daf-b60b-c1cc40a78913 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.275806 Sep 14 09:41:13.437451 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 963/4045] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:13 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:41:13.452427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:13.453128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:13.472148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.472915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.473360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.474732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:13.475281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:13.476123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:13.638242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:13.652365 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e470b1de-3233-4073-a5b5-96c67ea815bb tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.293747 Sep 14 09:41:13.652875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3083/4046] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:13 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:13.862746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:13.881995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7353650f-6776-4d5c-84b3-869d2203c5f7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1514 microversion: 2.1 time: 0.437016 Sep 14 09:41:13.884486 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 964/4047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:13 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1514 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:14.678333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:14.679647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:14.686937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:14.687355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:14.688446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:14.689233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:14.689927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:14.690432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:14.868545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:14.885120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2aa8a7de-43f2-40b0-b2c4-bed0950b0e4f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.211328 Sep 14 09:41:14.886141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3084/4048] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:14 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:14.913028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:14.913626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:14.920647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:14.921324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:14.921928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:14.922972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:14.924022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:14.924611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.119013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:15.131633 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28974bff-6481-47ed-ae40-54a821467dda tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1497 microversion: 2.1 time: 0.223294 Sep 14 09:41:15.135851 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 965/4049] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:14 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:15.179992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:15.180645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:15.193276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.194574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.195266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.196281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.196972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.197654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.202880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:15.229368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lazy-loading 'flavor' on Instance uuid a9eebd67-2f50-426f-a198-2dc13af1ccca {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:41:15.256422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'suspend' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state suspended Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: {"suspend": {}} Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'suspend' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state suspended Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'suspend': {}}} Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state suspended. Cannot suspend while the instance is in this state. Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 14 09:41:15.258566 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state suspended Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state suspended Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'suspend' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state suspended {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9e464f1-1524-4313-a7ee-7308e4fdc9cb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 148 microversion: 2.1 time: 0.102470 Sep 14 09:41:15.265507 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3085/4050] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:15 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 148 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:41:15.269635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:15.270181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:15.289589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.290110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.290551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.291278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.291737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.292194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.402721 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a94bc19c-da19-4b27-99aa-61f866d6e785 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 202 len: 0 microversion: 2.1 time: 0.136832 Sep 14 09:41:15.405473 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 966/4051] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:15 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:41:15.414454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:15.414848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:15.421991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.422561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.422927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.456408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.457216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.473093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.910897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:15.911695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:15.932444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.933359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.933942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.934686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:15.935145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:15.938759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:15.941000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:15.953696 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33c545b1-d325-4630-9659-cedf8a19f864 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1503 microversion: 2.1 time: 0.543130 Sep 14 09:41:15.971172 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3086/4052] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:15 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1503 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:15.996402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:16.226705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:16.241255 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a03db491-cb05-4744-afb3-55e129761ee0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.334192 Sep 14 09:41:16.255931 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 967/4053] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:15 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:16.984283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:16.984711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:16.994887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:16.995393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:16.995838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:16.996606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:16.997065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:16.997502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:17.269549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:17.270163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:17.291582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:17.292704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:17.293332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:17.294291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:17.294758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:17.296054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:17.392641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:17.406856 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d68d6a1-4689-4fc9-86d4-2831e6dad2fd tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1503 microversion: 2.1 time: 0.425970 Sep 14 09:41:17.421531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3087/4054] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:16 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1503 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:17.544617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:17.556227 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f8a4830-25c3-498f-a18d-820ae03a363e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.290437 Sep 14 09:41:17.557583 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 968/4055] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:17 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:18.437219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:18.438177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:18.450241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.454814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.455518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.459873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.460859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.461475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.588273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:18.589670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:18.598402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.599496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.600251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.602112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.604271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.605114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.748101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:18.766042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d95dc5c-a64b-4f97-a33c-d84684ed6ed9 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.332666 Sep 14 09:41:18.766808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3088/4056] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:18 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:18.800532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:18.802655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:18.820902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.822200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.822761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.823678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:18.824317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:18.824765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:18.866447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:18.875493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-33cbb57e-4e55-4659-ae05-e522ba55d7a4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.293122 Sep 14 09:41:18.892162 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 969/4057] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:18 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:19.134836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:19.144019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04125991-8e8c-4408-98c9-1b221140cb8b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.354960 Sep 14 09:41:19.144624 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3089/4058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:18 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:19.167188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:19.168072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 3b516a56-166c-4635-a83c-5d69da06d2af] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:19.173970 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/3b516a56-166c-4635-a83c-5d69da06d2af/action HTTP/1.1 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 15 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: {"unpause": {}} Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3b516a56-166c-4635-a83c-5d69da06d2af', 'body': {'unpause': {}}} Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:19.175797 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:19.180947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:19.180947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:19.180947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. Sep 14 09:41:19.180947 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:19.182035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 3b516a56-166c-4635-a83c-5d69da06d2af could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:19.184850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-658570f6-887a-4e58-b38f-103d6a3953f0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/3b516a56-166c-4635-a83c-5d69da06d2af/action" status: 404 len: 111 microversion: 2.1 time: 0.022108 Sep 14 09:41:19.185432 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 970/4059] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:19 2022] POST /compute/v2.1/servers/3b516a56-166c-4635-a83c-5d69da06d2af/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:19.195031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:19.195803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:19.203131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.203874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.204603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:19.205429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.205987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.206564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:19.816968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:19.842704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-943dc846-3470-4ffb-a9e4-d45679763e2b tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.652558 Sep 14 09:41:19.851399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3090/4060] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:19 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:19.876694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:19.877970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:19.887246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.888117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.888987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:19.889852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.890491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.891434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:19.906844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:19.907462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:19.935871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.940493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.941155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:19.943425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:19.944009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:19.944363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.109295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:20.117892 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-38b2a084-cba9-4b7e-a694-6b3eedcf9e69 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.245350 Sep 14 09:41:20.128903 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 971/4061] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:19 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:20.152621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:20.153371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.160223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.160960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.161595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.162550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.163146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.163713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.198159 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'unpause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 15 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: {"unpause": {}} Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'unpause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'unpause': {}}} Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state active. Cannot unpause while the instance is in this state. Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.201323 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:20.206018 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:20.206018 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:20.206018 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:20.206018 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:20.206018 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.207301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'unpause' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:20.209332 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-71f915c1-9424-40ca-a135-a678fe7d4c96 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 145 microversion: 2.1 time: 0.060385 Sep 14 09:41:20.215036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 972/4062] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:20 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 14 09:41:20.221106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:20.222125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.230213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:20.238409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.239152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.240321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.241391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.241972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.242891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.249727 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0053f37-f8b3-4ed8-bdb6-3375f436505f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.345704 Sep 14 09:41:20.251668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3091/4063] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:19 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:20.537202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:20.550065 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e71a5924-be53-41e4-a622-1e3150e05848 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.333341 Sep 14 09:41:20.573736 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 973/4064] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:20.595073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:20.596033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.606170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.606170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.606381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.606916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.607378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.607801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.878606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:20.894005 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b19accf-0bee-4d90-b0fb-28b1b1aa0965 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.301574 Sep 14 09:41:20.897153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3092/4065] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:20.922524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:20.923404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 29fd2fb9-2e07-443e-818a-5648962cb499] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.931371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/29fd2fb9-2e07-443e-818a-5648962cb499/action HTTP/1.1 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 18 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: {"unshelve": null} Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '29fd2fb9-2e07-443e-818a-5648962cb499', 'body': {'unshelve': None}} Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.932383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 29fd2fb9-2e07-443e-818a-5648962cb499 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-061b0421-6ac9-429d-b029-5dab823d71bc tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/29fd2fb9-2e07-443e-818a-5648962cb499/action" status: 404 len: 111 microversion: 2.1 time: 0.018023 Sep 14 09:41:20.943353 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 974/4066] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:20 2022] POST /compute/v2.1/servers/29fd2fb9-2e07-443e-818a-5648962cb499/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:20.948800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:20.949428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:20.968036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.972764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.973536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:20.975390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:20.981024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:20.981539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.274511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:21.275152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:21.282335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.282822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.283480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.284222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.284849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.285276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.334135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:21.347686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b33dfad-bd2c-42b0-b6d7-15d88be6f3a6 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.405663 Sep 14 09:41:21.351964 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3093/4067] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:20 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:21.375453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:21.376450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:21.384540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.385343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.386055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.386958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.387745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.388391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.457680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:21.467165 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-89be41cd-3b08-4d07-a7ad-33d7c2685536 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.196592 Sep 14 09:41:21.467750 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 975/4068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:21 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:21.706930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:21.722098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c52c0f64-b383-4dbb-addb-19d1b27300a4 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.349939 Sep 14 09:41:21.735949 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3094/4069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:21 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:21.750790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:21.751653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:21.758975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.759682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.760383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.761300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.761993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.762631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.808770 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Cannot 'unshelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action HTTP/1.1 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 18 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: {"unshelve": null} Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'unshelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'unshelve': None}} Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca in vm_state active. Cannot unshelve while the instance is in this state. Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:41:21.811043 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 409 to user: Cannot 'unshelve' instance a9eebd67-2f50-426f-a198-2dc13af1ccca while it is in vm_state active {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f24b24eb-27da-42c4-8c92-3dea6bdbe58c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action" status: 409 len: 146 microversion: 2.1 time: 0.065905 Sep 14 09:41:21.815623 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 976/4070] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:21 2022] POST /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca/action => generated 146 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:41:21.824971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:21.826171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:21.837236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.839315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.839786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:21.840748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:21.841220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:21.841659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.170309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:22.181671 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a832d07d-4fa7-44b2-952e-1add9768b96e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.361615 Sep 14 09:41:22.185555 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3095/4071] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:21 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:22.214182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:22.214819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.224167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.225591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.226295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.227283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.227957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.228573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.492823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:22.493703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.512724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.513318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.513674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.514612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.515498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.516432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.615421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:22.629469 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d1ac0f9-9254-4922-9b77-879abc82db81 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.422718 Sep 14 09:41:22.633936 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 977/4072] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:22.669140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2000228644_updated"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:22.697013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: 0af580d7-a99c-46d9-adb6-381104315512] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.709042 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/servers/0af580d7-a99c-46d9-adb6-381104315512 HTTP/1.1 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 81 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2000228644_updated"}} Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '0af580d7-a99c-46d9-adb6-381104315512', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2000228644_updated'}}} Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 14 09:41:22.713434 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. Sep 14 09:41:22.717836 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:22.720533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance 0af580d7-a99c-46d9-adb6-381104315512 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:22.721419 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac76490d-9e66-4bae-ad74-003950ec4cdb tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "PUT /compute/v2.1/servers/0af580d7-a99c-46d9-adb6-381104315512" status: 404 len: 111 microversion: 2.1 time: 0.070500 Sep 14 09:41:22.722191 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 978/4073] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:41:22 2022] PUT /compute/v2.1/servers/0af580d7-a99c-46d9-adb6-381104315512 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:22.731378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:22.732034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.741161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.741951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.742399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.743728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:22.744461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:22.744901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:22.807060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:22.818649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2585256e-bcd0-4ec8-ac6f-c8896782cbc4 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.330238 Sep 14 09:41:22.819570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3096/4074] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:22 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:22.950481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:22.959457 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da8fafd3-0b6f-4add-890f-a1430b4baf7c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.232254 Sep 14 09:41:22.960881 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 979/4075] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:22.987484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:22.988570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:22.999445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.000870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.001416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.002223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.002758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.003269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.197882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:23.214143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-daf3b343-8592-4a26-aa0d-e399dac1f310 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.231134 Sep 14 09:41:23.228601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3097/4076] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:22 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:23.237593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffe0c3dc-1a51-4a51-8f32-cb54a07ccbde tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffe0c3dc-1a51-4a51-8f32-cb54a07ccbde tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: request: PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca HTTP/1.1 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 280 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.242896 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffe0c3dc-1a51-4a51-8f32-cb54a07ccbde tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:23.246501 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ffe0c3dc-1a51-4a51-8f32-cb54a07ccbde tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 400 len: 619 microversion: 2.1 time: 0.010689 Sep 14 09:41:23.254172 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 980/4077] 10.222.0.90 () {60 vars in 1257 bytes} [Wed Sep 14 09:41:23 2022] PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:41:23.256540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:23.257554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:23.266274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.266769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.267788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.268566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.269029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.269847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.489016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:23.498032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb4df860-5a66-4931-8fe9-940519c91c20 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.246019 Sep 14 09:41:23.499128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3098/4078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:23.526252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:23.527443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:23.534948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.535454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.536157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.537042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.537651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.538229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.742812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:23.752163 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e5cf145-48c6-4b2e-9d36-d79fa2255e1f tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.231710 Sep 14 09:41:23.752987 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 981/4079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:23.782148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fbed253c-2578-4a5e-8890-cf47299387a2 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fbed253c-2578-4a5e-8890-cf47299387a2 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca HTTP/1.1 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 24 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: {"server": {"name": ""}} Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca', 'body': {'server': {'name': ''}}} Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise error Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi '' Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 09:41:23.792300 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 14 09:41:23.797467 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:23.799795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fbed253c-2578-4a5e-8890-cf47299387a2 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:23.804715 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fbed253c-2578-4a5e-8890-cf47299387a2 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 400 len: 108 microversion: 2.1 time: 0.025220 Sep 14 09:41:23.821233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3099/4080] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 09:41:23 2022] PUT /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 108 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:41:23.830675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:23.831775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:23.842179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:23.842784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:23.856121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.856618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.858401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.859786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.860934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.861439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.861890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.862631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:23.863823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.864329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:23.868562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:23.869973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:24.087157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:24.097003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a7c1b2f-5f1b-48cc-aaa0-f08642d7a493 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.258559 Sep 14 09:41:24.099935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3100/4081] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:23 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:24.108449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:24.118337 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0538722a-dec2-4eac-963a-6cf0bc094a0e tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1506 microversion: 2.1 time: 0.299330 Sep 14 09:41:24.120310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 982/4082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:23 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1506 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:24.859170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0ab7b81f-1b8f-40c3-81c2-8beb7f508df4"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:24.862232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:24.869895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:24.871101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:24.873327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:24.875759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:24.879872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:24.881502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.032398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] HTTP exception thrown: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Request method failure captured: Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments/ada401ea-bd72-491c-bd36-19c2062a0292 HTTP/1.1 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 74 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaF3G-r5VajwwsYy5uB_nVpm7f8VfqHRYNV_-lQcxsq34ALxhfcIT3wz47XnRx9VGehosNYaFwIY81Aln3YaV3hqc85UfU_QQfu6oip-u9SkxJD41XWDgeQA3di_3tWVX4DQ9eTEE-HiB3SAVkWpaMfB5Q3xT_VfdJWEzo5yB3rDryM Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c2af291c8bec48ce873f09f613bdce8d Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c2af291c8bec48ce873f09f613bdce8d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c2af291c8bec48ce873f09f613bdce8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c2af291c8bec48ce873f09f613bdce8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c2af291c8bec48ce873f09f613bdce8d"}]}] Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c2af291c8bec48ce873f09f613bdce8d Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesAdminNegativeTest-1023499754-project-admin Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b23eee6217e5462fb0d65e44da6664a4 Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesAdminNegativeTest-1023499754-project-admin Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: {"volumeAttachment": {"volumeId": "0ab7b81f-1b8f-40c3-81c2-8beb7f508df4"}} Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': 'eb69a36f-6165-4760-823c-7a6c095c58d1', 'id': 'ada401ea-bd72-491c-bd36-19c2062a0292', 'body': {'volumeAttachment': {'volumeId': '0ab7b81f-1b8f-40c3-81c2-8beb7f508df4'}}} Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. (HTTP 404) (Request-ID: req-bcc97810-dc14-43ce-a449-17d396154ef3) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:41:25.039462 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. Sep 14 09:41:25.044673 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:25.049860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Returning 400 to user: Volume 0ab7b81f-1b8f-40c3-81c2-8beb7f508df4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:25.051011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ab29e38-dff3-49d5-87a2-57db3fbcc315 tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] 10.222.0.90 "PUT /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments/ada401ea-bd72-491c-bd36-19c2062a0292" status: 400 len: 107 microversion: 2.1 time: 0.530556 Sep 14 09:41:25.052424 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3101/4083] 10.222.0.90 () {60 vars in 1433 bytes} [Wed Sep 14 09:41:24 2022] PUT /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments/ada401ea-bd72-491c-bd36-19c2062a0292 => generated 107 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:41:25.123302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:25.123945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:25.131964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.132599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.133044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.133758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.134210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.134635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.175433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:25.176361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:25.186788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.187676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.188375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.189311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.190503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.191173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.303952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lazy-loading 'services' on Instance uuid eb69a36f-6165-4760-823c-7a6c095c58d1 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:41:25.309827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:25.469561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:25.481592 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6b3c77a-1f03-4c2d-aa0e-b0ac94a902b3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.362368 Sep 14 09:41:25.499300 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 983/4084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:25 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:25.561970 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c79cc4c8-0f58-4c38-8726-3c3a212f53c0 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "DELETE /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments/ada401ea-bd72-491c-bd36-19c2062a0292" status: 202 len: 0 microversion: 2.1 time: 0.395096 Sep 14 09:41:25.563295 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3102/4085] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:41:25 2022] DELETE /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments/ada401ea-bd72-491c-bd36-19c2062a0292 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:41:25.572472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:25.575034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:25.588573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.592539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.593221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.594165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:25.594933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:25.595372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:25.665114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e8daa34-be93-44c7-aa4b-e100973ae9a1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092225 Sep 14 09:41:25.668210 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 984/4086] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:25 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:26.528320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:26.530444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:26.547575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.552929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.559026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.560352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.560845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.561287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.679029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:26.685819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:26.719591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.720167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.720620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.721361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:26.721825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:26.722256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:26.825858 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a0e5f7f-5f55-4806-be8f-1fc3023c7d8b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151901 Sep 14 09:41:26.839844 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 985/4087] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:26 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:27.003073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:27.015102 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-933c0a6b-20e6-4ede-b88f-d394e386dd13 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.493537 Sep 14 09:41:27.019088 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3103/4088] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:26 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:27.853379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:27.856226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:27.888404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:27.889931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:27.893754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:27.896477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:27.897579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:27.899283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:27.998583 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7ca7d9a-9553-4b24-bffc-45d37ba3a44b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154905 Sep 14 09:41:28.006950 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 986/4089] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:27 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:28.051756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:28.052348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:28.064273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:28.064620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:28.065242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:28.066149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:28.066920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:28.067610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:28.713865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:28.725870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e69a6ebe-c10e-4f6f-865d-9c95c729bb1b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.679150 Sep 14 09:41:28.728936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3104/4090] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:28 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:29.024342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:29.027224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:29.042876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.045666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.046235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:29.047325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.053967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.056576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:29.154921 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5cc4b3e3-6960-40b4-ba85-bb9284be19e3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140543 Sep 14 09:41:29.155532 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 987/4091] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:29 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:29.760238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:29.760924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:29.782812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.787449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.788013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:29.788811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:29.789259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:29.793629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:30.168451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:30.170422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:30.189507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:30.190015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:30.190459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:30.198488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:30.198999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:30.199452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:30.277800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:30.293052 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f4d3c1a-a5cc-4eab-82da-06c795a8198d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129157 Sep 14 09:41:30.299756 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 988/4092] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:30 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:30.392297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:30.407020 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abc9ea1b-ebcd-4d3a-9bb6-f2f95e1eb4f5 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.652590 Sep 14 09:41:30.408282 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3105/4093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:29 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:31.324340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:31.335204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:31.350966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.354004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.356495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.357446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.358750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.360528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.435326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:31.436827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:31.446994 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee1f1e96-7ed5-4408-953f-d97509d3200e tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144775 Sep 14 09:41:31.447810 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 989/4094] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:31 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:31.467792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.472944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.476972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.482458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:31.486701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:31.497800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:31.865628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:31.889377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ba7bf35-1da0-4edb-b5b3-c2d333e48bd7 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.457021 Sep 14 09:41:31.890024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3106/4095] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:31 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:32.407433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.408680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.422040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.423487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.424176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.425463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.426812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.427568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.461143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.463604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.468791 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 HTTP/1.1 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'cdf30564-dde0-40dd-b32c-c9cf6c3625d2'} Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:32.470943 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.476020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.481900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:32.483123 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-814c95ae-00d4-42d9-b839-5de9cc15ba91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 404 len: 111 microversion: 2.1 time: 0.079859 Sep 14 09:41:32.484164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.486651 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 990/4096] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:41:32 2022] DELETE /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:32.487452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.487942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.488713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.490566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.491040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.494252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.503195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: cdf30564-dde0-40dd-b32c-c9cf6c3625d2] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.522933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.523992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.524738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.526100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.527082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.527762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.581447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4add3e07-460e-4898-8e2d-5807782ead4a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126351 Sep 14 09:41:32.588848 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.589599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3107/4097] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 HTTP/1.1 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'cdf30564-dde0-40dd-b32c-c9cf6c3625d2'} Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:32.593930 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. Sep 14 09:41:32.599758 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:32.603020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance cdf30564-dde0-40dd-b32c-c9cf6c3625d2 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:32.609629 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c94d21d4-71a8-4c9b-a9e8-4301a46b6f91 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2" status: 404 len: 111 microversion: 2.1 time: 0.118845 Sep 14 09:41:32.611060 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 991/4098] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/servers/cdf30564-dde0-40dd-b32c-c9cf6c3625d2 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:32.621588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.623092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.635986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.657125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.661625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.662879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.665717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.666365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.739717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:41:32.916093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:32.917011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:32.932733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.937231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.939699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.946863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:32.952205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:32.952880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:32.975448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8288554-209f-4ec1-9641-20fc26ffe9d0 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 204 len: 0 microversion: 2.1 time: 0.359082 Sep 14 09:41:32.980633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3108/4099] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:41:32 2022] DELETE /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:41:33.006906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.008165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:33.023273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.025742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.028001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.029739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.031797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.032445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.448975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:33.464077 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f84ae9b2-7008-47cd-a6ea-150f1c0a7258 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.553632 Sep 14 09:41:33.464894 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 992/4100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:33.500215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:33.508967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd9b29cf-5a55-4688-bb0d-f9e00be1bf1a tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.524102 Sep 14 09:41:33.513455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3109/4101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:32 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:33.596534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:33.599095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:33.615496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.616352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.616881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.617636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:33.618099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:33.626723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:33.719034 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-399daa41-5a46-48f2-ae37-3cb517d722e9 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127126 Sep 14 09:41:33.721807 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 993/4102] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:33 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:34.498699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:34.499325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:34.519848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.521727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.522666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.523767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.526535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.530834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.543694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:34.544350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:34.558584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.564168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.565784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.568821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.569300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.569734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.854581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:34.863100 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8acff722-6e15-49ab-97a3-c5a9c379b694 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.323536 Sep 14 09:41:34.864836 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 994/4103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:34 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:34.869832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:34.872241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:34.882161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.882840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.883473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.884452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:34.885106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:34.885909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:34.933455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:34.934444 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-63bcb88d-17ad-4db7-91bf-78773f5341f1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068439 Sep 14 09:41:34.935036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 995/4104] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:41:34 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:41:34.957602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bf15463-6385-4541-9a55-76f0d4f1ae52 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.470545 Sep 14 09:41:34.960287 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3110/4105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:34 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:35.212502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-793110756", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "8858e84c-ab7e-4cae-8f46-c9ce414196e0"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:35.311450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] validate_networks() for [('8858e84c-ab7e-4cae-8f46-c9ce414196e0', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:41:35.890984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:35.891604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:35.894537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:35.910049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:35.912154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:35.925792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:35.926645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:35.927139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:35.927603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.283043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:41:36.283549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:41:36.283960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:41:36.284400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:41:36.284815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:41:36.294330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.294817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.295258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.296120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.296580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.297010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.320361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:41:36.326455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Getting quotas for user 448c43cada3c4f1c837e1e9f6602da26 and project 6c76e14a837940b8a7f7bc7f15be0c3d. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:41:36.343224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:41:36.345690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:41:36.419013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9689d78-6990-4048-b336-1f5a842373c5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.212795 Sep 14 09:41:36.419682 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 996/4106] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:41:36.428915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:36.429806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:36.437762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.440626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.441327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.442376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.443156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.443813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.679193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '540eb30f57dc4ff7ade977e26cecebad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412ee460776a4060afcee7dd2217fb58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:36.696827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df53b15d-c755-4511-8662-6b83e993eca7 tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 200 len: 1512 microversion: 2.1 time: 0.809650 Sep 14 09:41:36.700133 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3111/4107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:35 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 1512 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:36.705136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90e5ca62-d664-4221-8bfa-6190aa8631ec tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:36.705761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90e5ca62-d664-4221-8bfa-6190aa8631ec tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:36.834960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:36.853822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-831c1a63-c1c4-4719-8268-ab7075b4dc0e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1732 microversion: 2.1 time: 0.432108 Sep 14 09:41:36.878062 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 997/4108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:36 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1732 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:36.922233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9eebd67-2f50-426f-a198-2dc13af1ccca", "name": "network-vif-deleted", "tag": "b4e96758-6513-4caa-8c42-e20b291c98dc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:36.941382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:36.955846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:36.956731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:36.957683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:36.978859 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] Creating event network-vif-deleted:b4e96758-6513-4caa-8c42-e20b291c98dc for instance a9eebd67-2f50-426f-a198-2dc13af1ccca on n-h1-851028-12 Sep 14 09:41:36.980364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90e5ca62-d664-4221-8bfa-6190aa8631ec tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:36.991618 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7c220f8f-455f-40bd-99ab-adf79398bc5c req-3363729e-f967-4177-885a-7fba2d320763 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073729 Sep 14 09:41:36.992606 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 998/4109] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:36.996737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90e5ca62-d664-4221-8bfa-6190aa8631ec tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1217 microversion: 2.1 time: 0.294165 Sep 14 09:41:37.008869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3112/4110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:36 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:37.731439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:37.732551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] [instance: a9eebd67-2f50-426f-a198-2dc13af1ccca] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:37.760936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:37.761769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:37.762460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:37.763621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:37.764503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:37.765180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:37.786648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] HTTP exception thrown: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Request method failure captured: Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca HTTP/1.1 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEGou5hGSyKUm0XZmgDLHgBefKdRudcXTAjmWezojcX-sWWmO6685JquFR9Wek4N0AlTaYfkmKhpuY2hhOV5Hovyhc2hy0ALBPAdtzDTBy6yEMqL7TzjbcYBG3USgiouN7Sd4r8oH4-HjeObNJjI_xDdkHODLKDxGVSIFylBRgldKQ Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_412ee460776a4060afcee7dd2217fb58", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/412ee460776a4060afcee7dd2217fb58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/412ee460776a4060afcee7dd2217fb58"}]}] Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 412ee460776a4060afcee7dd2217fb58 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-796813506 Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 540eb30f57dc4ff7ade977e26cecebad Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-796813506-project Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a9eebd67-2f50-426f-a198-2dc13af1ccca'} Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:37.788026 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. Sep 14 09:41:37.795969 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:37.797816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] Returning 404 to user: Instance a9eebd67-2f50-426f-a198-2dc13af1ccca could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:37.798896 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c001693d-4edc-491d-a9f7-5f3cdef8678c tempest-ServersNegativeTestJSON-796813506 tempest-ServersNegativeTestJSON-796813506-project] 10.222.0.90 "GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca" status: 404 len: 111 microversion: 2.1 time: 0.075827 Sep 14 09:41:37.799489 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 999/4111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:37 2022] GET /compute/v2.1/servers/a9eebd67-2f50-426f-a198-2dc13af1ccca => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:41:37.887284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:37.887924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:37.910048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:37.910514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:37.911008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:37.913856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:37.915335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:37.919410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.023136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:38.023771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:38.030533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.032017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.033520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.035208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.037688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.039064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.197100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:38.213712 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb54b240-c21d-49b2-b2b7-947e6a25ef7a tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1269 microversion: 2.1 time: 0.188985 Sep 14 09:41:38.214422 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1000/4112] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:38 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:38.482536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:38.500545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca4d39e4-047b-4631-b160-1c98b137a112 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1712 microversion: 2.1 time: 0.617046 Sep 14 09:41:38.501804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3113/4113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:37 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1712 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:38.722484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:38.722983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:38.729596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.730356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.730790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.731488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.732091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.732366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.860050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Cannot 'detach_volume' instance dd3b122b-639e-47bc-90e4-994c6f0230d5 while it is in vm_state rescued Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments/db5300f7-5a01-479a-8e96-e33c7ef22efe HTTP/1.1 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'detach_volume' instance dd3b122b-639e-47bc-90e4-994c6f0230d5 while it is in vm_state rescued Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': 'dd3b122b-639e-47bc-90e4-994c6f0230d5', 'id': 'db5300f7-5a01-479a-8e96-e33c7ef22efe'} Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance dd3b122b-639e-47bc-90e4-994c6f0230d5 while it is in vm_state rescued Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:38.862207 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance dd3b122b-639e-47bc-90e4-994c6f0230d5 while it is in vm_state rescued Sep 14 09:41:38.866614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:41:38.868919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 409 to user: Cannot 'detach_volume' instance dd3b122b-639e-47bc-90e4-994c6f0230d5 while it is in vm_state rescued {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:38.870249 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fed7b5e4-b0c6-474b-9c88-6a9ffed0901a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments/db5300f7-5a01-479a-8e96-e33c7ef22efe" status: 409 len: 152 microversion: 2.1 time: 0.151883 Sep 14 09:41:38.871271 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1001/4114] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:41:38 2022] DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments/db5300f7-5a01-479a-8e96-e33c7ef22efe => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:41:38.887553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:38.888690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:38.897384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.897910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.898635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:38.899369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:38.899830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:38.900359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:39.082302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-937a7029-8874-4be7-ba45-7ae53224115d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/action" status: 202 len: 0 microversion: 2.1 time: 0.202335 Sep 14 09:41:39.084935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3114/4115] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:41:38 2022] POST /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:41:39.096129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:39.105276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:39.125725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:39.127274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:39.127867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:39.128999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:39.129260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:39.130451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:39.241072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:39.242157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:39.249899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:39.250772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:39.251432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:39.252433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:39.253114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:39.254524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:39.394703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:39.406039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb43c020-18d4-4ff0-8b52-9b0a00986a13 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1275 microversion: 2.1 time: 0.169495 Sep 14 09:41:39.409270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3115/4116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:39 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:39.714260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:39.729568 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e2e0eca6-89b8-44d3-87fa-89e309f00367 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1720 microversion: 2.1 time: 0.639691 Sep 14 09:41:39.753809 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1002/4117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:39 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1720 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:40.431412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:40.431985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:40.448468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:40.448972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:40.449414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:40.450133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:40.450592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:40.451020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:40.594293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:40.603385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3439d882-bbde-4080-a4b8-45842f55de4b tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1275 microversion: 2.1 time: 0.176548 Sep 14 09:41:40.604711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3116/4118] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:40 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:40.761590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:40.763862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:40.776559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:40.779219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:40.785587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:40.788476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:40.789934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:40.791349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:41.190602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:41.213779 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41bc480b-05e0-42f7-9296-dad75c403681 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1720 microversion: 2.1 time: 0.458260 Sep 14 09:41:41.226321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1003/4119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:40 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1720 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:41.631744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:41.635715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:41.655412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:41.656069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:41.656727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:41.657658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:41.658131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:41.658563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:41.749735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:42.242829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:42.243466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:42.259872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:42.260637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:42.261279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:42.262185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:42.262797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:42.263389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:42.545885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:42.576991 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eea05a13-673f-4108-b035-8b09d062d5c3 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.950624 Sep 14 09:41:42.577909 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3117/4120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:41 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:42.992558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:43.006047 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dfee893b-c71a-4b05-bc27-1b6494243c2f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1726 microversion: 2.1 time: 0.766482 Sep 14 09:41:43.007463 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1004/4121] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:42 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1726 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:43.030205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:43.030716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:43.038148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:43.038933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:43.039556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:43.040478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:43.041097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:43.041690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:43.226610 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da3399e7-e2c9-49c5-9afd-e5ca36da35ed tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200708 Sep 14 09:41:43.234932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3118/4122] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:41:43 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:43.412848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d602677e-ab7f-46b5-b775-6acb7f572a5b", "tag": "d0e70f5b-d4b4-4dd9-acab-540f802a3ce8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:43.441550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:43.445228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:43.446914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:43.480554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] Creating event network-changed:d0e70f5b-d4b4-4dd9-acab-540f802a3ce8 for instance d602677e-ab7f-46b5-b775-6acb7f572a5b on n-h2-851028-12 Sep 14 09:41:43.496214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e1b89403-ff19-4f15-9d91-d98c03e7fb0c req-08203553-97c4-426b-92fd-f7c09bfdb821 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102101 Sep 14 09:41:43.498790 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1005/4123] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:43.605666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:43.606282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:43.620269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:43.620857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:43.621308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:43.622049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:43.622504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:43.622928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:44.292137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:44.317046 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9c3fd4a-59ae-4ba6-8410-f945b625e8a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.715111 Sep 14 09:41:44.330365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3119/4124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:43 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:45.354228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:45.354954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:45.382969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.384779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.385439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.386419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.387689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.388382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.628679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:45.673728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:45.674423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:45.674815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:45.720803 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] Creating event network-changed:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:41:45.730869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0f3b13de-8fc4-4c26-8cf3-99accc45aa64 req-316202b4-8460-4c5b-b0de-f6a9860330ab service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106622 Sep 14 09:41:45.734074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3120/4125] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:46.087090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:46.113300 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94fb1e80-82d1-4e9f-98a6-d1a5fcd480cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.766993 Sep 14 09:41:46.115076 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1006/4126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:45 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:41:47.143494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:47.146077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:47.154028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:47.180174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:47.181175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:47.183278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:47.186406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:47.187586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:47.188668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:47.768267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:47.771074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:47.787224 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af18e090-b418-4adb-894f-61fb57111738 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.650253 Sep 14 09:41:47.795164 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3121/4127] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:47 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:47.796317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:47.797242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:41:47.805545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:47.806272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:47.806894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:47.828186 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] Creating event network-changed:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:41:47.834603 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c0d35fe8-ca9e-46f0-97d0-2631194d72fb req-27c21d38-4cba-494a-907c-9e4e524f0cfe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071328 Sep 14 09:41:47.835451 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1007/4128] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:48.821716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:48.822355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:48.834651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:48.835146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:48.835590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:48.836601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:48.837053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:48.837476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:49.201838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:49.216410 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c256e120-cd84-4a3b-b433-ea8aa4d89f1f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.398399 Sep 14 09:41:49.217823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3122/4129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:48 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:50.244552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:50.245268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:50.253217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:50.253697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:50.254130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:50.254989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:50.255438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:50.255858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:50.444483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d602677e-ab7f-46b5-b775-6acb7f572a5b", "name": "network-vif-plugged", "status": "completed", "tag": "d0e70f5b-d4b4-4dd9-acab-540f802a3ce8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:50.468082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:50.468728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:50.470280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:50.503517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] Creating event network-vif-plugged:d0e70f5b-d4b4-4dd9-acab-540f802a3ce8 for instance d602677e-ab7f-46b5-b775-6acb7f572a5b on n-h2-851028-12 Sep 14 09:41:50.522337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-bbcedc0e-ec9c-42b5-b083-06cf0eced9f6 req-6c6293ff-15f7-4d14-9da1-8e8fdd39533b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086297 Sep 14 09:41:50.524973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3123/4130] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:50.686440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:50.702335 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-61889ac6-b8f0-4a67-a02b-ba8c6e263bc1 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.463543 Sep 14 09:41:50.703923 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1008/4131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:50 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:51.727861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:51.729155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:51.745671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:51.746164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:51.746787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:51.747667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:51.748311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:51.748931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:52.160732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:52.181209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86871e46-afd9-4d76-9165-99a8c727d550 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1317 microversion: 2.1 time: 0.457902 Sep 14 09:41:52.182651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3124/4132] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:51 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:53.112654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8a1c313a-bb62-4947-8faa-151f8b19a7a2 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f6947b38e50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:53.175490 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8a1c313a-bb62-4947-8faa-151f8b19a7a2 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/5fe0e3aa-693d-4cb3-a48e-30e449a9e424" status: 200 len: 350 microversion: 2.1 time: 0.066531 Sep 14 09:41:53.177239 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1009/4133] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:41:53 2022] GET /compute/v2.1/os-volumes/5fe0e3aa-693d-4cb3-a48e-30e449a9e424 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:41:53.204833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:53.206223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:53.214609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.215341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.216079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.216978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:53.217637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:53.218236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:53.573703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:41:53.585851 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b240c10-66e4-4d9e-b4b9-42aa18ece733 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1508 microversion: 2.1 time: 0.384664 Sep 14 09:41:53.587327 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3125/4134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:41:53 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:55.814338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c522dc4-83d9-4103-9063-24df021cf7b0 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693f1c5f70>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:55.902097 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c522dc4-83d9-4103-9063-24df021cf7b0 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/40dde4ac-013d-44d8-9deb-312e9ee5e0f2" status: 200 len: 350 microversion: 2.1 time: 0.091786 Sep 14 09:41:55.916483 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1010/4135] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:41:55 2022] GET /compute/v2.1/os-volumes/40dde4ac-013d-44d8-9deb-312e9ee5e0f2 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:56.382122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5dd7d3b9-c9f9-4de4-ab25-e3f1b81b64c0"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:41:56.385343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:41:56.402755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:56.403261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:56.403708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:56.408896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:41:56.414338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:41:56.415066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:41:56.550916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] HTTP exception thrown: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Request method failure captured: Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: request: PUT /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b/os-volume_attachments/eec08a02-17ca-400a-b6bd-01fca31a3eb1 HTTP/1.1 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 74 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaF3G-r5VajwwsYy5uB_nVpm7f8VfqHRYNV_-lQcxsq34ALxhfcIT3wz47XnRx9VGehosNYaFwIY81Aln3YaV3hqc85UfU_QQfu6oip-u9SkxJD41XWDgeQA3di_3tWVX4DQ9eTEE-HiB3SAVkWpaMfB5Q3xT_VfdJWEzo5yB3rDryM Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c2af291c8bec48ce873f09f613bdce8d Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c2af291c8bec48ce873f09f613bdce8d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c2af291c8bec48ce873f09f613bdce8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c2af291c8bec48ce873f09f613bdce8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c2af291c8bec48ce873f09f613bdce8d"}]}] Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c2af291c8bec48ce873f09f613bdce8d Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1023499754 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesAdminNegativeTest-1023499754-project-admin Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: b23eee6217e5462fb0d65e44da6664a4 Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesAdminNegativeTest-1023499754-project-admin Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: {"volumeAttachment": {"volumeId": "5dd7d3b9-c9f9-4de4-ab25-e3f1b81b64c0"}} Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': 'd602677e-ab7f-46b5-b775-6acb7f572a5b', 'id': 'eec08a02-17ca-400a-b6bd-01fca31a3eb1', 'body': {'volumeAttachment': {'volumeId': '5dd7d3b9-c9f9-4de4-ab25-e3f1b81b64c0'}}} Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. (HTTP 404) (Request-ID: req-3839edc7-5a80-4e7f-92c5-317eb4e64572) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:41:56.554261 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. Sep 14 09:41:56.559265 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:41:56.565297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] Returning 404 to user: Volume eec08a02-17ca-400a-b6bd-01fca31a3eb1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:41:56.566366 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89c9923c-c51d-49df-a3e9-0148736c21ee tempest-VolumesAdminNegativeTest-1023499754 tempest-VolumesAdminNegativeTest-1023499754-project-admin] 10.222.0.90 "PUT /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b/os-volume_attachments/eec08a02-17ca-400a-b6bd-01fca31a3eb1" status: 404 len: 109 microversion: 2.1 time: 0.190132 Sep 14 09:41:56.567560 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3126/4136] 10.222.0.90 () {60 vars in 1433 bytes} [Wed Sep 14 09:41:56 2022] PUT /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b/os-volume_attachments/eec08a02-17ca-400a-b6bd-01fca31a3eb1 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:41:58.888602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55911c8d-25ff-41b2-b50e-9a7137ee3d5c tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693f23b4c0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.016726 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-55911c8d-25ff-41b2-b50e-9a7137ee3d5c tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/fa6ec25f-0d33-400a-9a6f-d60a8480ccdb" status: 200 len: 351 microversion: 2.1 time: 0.133909 Sep 14 09:41:59.026459 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1011/4137] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:41:58 2022] GET /compute/v2.1/os-volumes/fa6ec25f-0d33-400a-9a6f-d60a8480ccdb => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:59.034770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d0accca-5fad-4d83-b4b1-8a048dfe5ea6 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693e2f2d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.217062 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d0accca-5fad-4d83-b4b1-8a048dfe5ea6 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.188874 Sep 14 09:41:59.217989 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3127/4138] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:59.234980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c6b904d1-6e81-426b-a4ee-828c5a051d85 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f6947b17ca0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.426128 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c6b904d1-6e81-426b-a4ee-828c5a051d85 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.196153 Sep 14 09:41:59.427450 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1012/4139] 10.222.0.90 () {58 vars in 1149 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:59.443254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d290a17-c5f5-4cf4-9995-9d78b1bca8fa tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693e2f2670>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.591082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d290a17-c5f5-4cf4-9995-9d78b1bca8fa tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.152451 Sep 14 09:41:59.591973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3128/4140] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:41:59.606225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9cf9238-d7c5-469f-a074-d80d2bb25fc4 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f6947b38550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.758594 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9cf9238-d7c5-469f-a074-d80d2bb25fc4 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.156113 Sep 14 09:41:59.769321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1013/4141] 10.222.0.90 () {58 vars in 1167 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:59.778591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91afc126-18f0-4e5b-844b-742105b89175 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693f899d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:41:59.926166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91afc126-18f0-4e5b-844b-742105b89175 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.153210 Sep 14 09:41:59.936813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3129/4142] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:41:59.948307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af2038eb-8bd6-4437-9db6-13a699cd0678 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f6947b3e940>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.052339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.053566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:00.054692 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af2038eb-8bd6-4437-9db6-13a699cd0678 tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.115582 Sep 14 09:42:00.055484 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1014/4143] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:41:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:00.065924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.066758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.068187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.069117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.069749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.070275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41ee21dc-ffad-4582-aad2-75275157e68e tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f6947b463a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.073798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.174408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:00.253263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=21 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:00.272792 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41ee21dc-ffad-4582-aad2-75275157e68e tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207545 Sep 14 09:42:00.273381 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1015/4144] 10.222.0.90 () {58 vars in 1188 bytes} [Wed Sep 14 09:42:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:00.290322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-437cda66-f7ba-4e95-bdf0-f4023b2a342c tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] Calling method '.version_select at 0x7f693f1c5ee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.432147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2ff594f-94ab-40a6-84a1-69c5a350504f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 204 len: 0 microversion: 2.1 time: 0.386166 Sep 14 09:42:00.433330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3130/4145] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:00 2022] DELETE /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:42:00.457272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:00.458387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:00.467518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.468303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.472448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.477198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:00.479551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:00.480210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:00.568934 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-437cda66-f7ba-4e95-bdf0-f4023b2a342c tempest-VolumesTestJSON-696045975 tempest-VolumesTestJSON-696045975-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.283866 Sep 14 09:42:00.582835 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1016/4146] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:42:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:00.891037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:00.905873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd4407c1-c410-4d97-8f50-5aa7e158f759 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1514 microversion: 2.1 time: 0.467979 Sep 14 09:42:00.912442 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3131/4147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:00 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1514 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:01.927665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=93 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:01.935206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:01.936689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:01.945149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:01.945830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:01.946496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:01.947420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:01.947874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:01.948492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:02.303712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:02.313538 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1da06fb5-6618-4145-9037-cbea171962cc tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1514 microversion: 2.1 time: 0.387633 Sep 14 09:42:02.334005 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1017/4148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:01 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:03.210430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d602677e-ab7f-46b5-b775-6acb7f572a5b", "name": "network-vif-deleted", "tag": "d0e70f5b-d4b4-4dd9-acab-540f802a3ce8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:03.237816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.238900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.240870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.256454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] Creating event network-vif-deleted:d0e70f5b-d4b4-4dd9-acab-540f802a3ce8 for instance d602677e-ab7f-46b5-b775-6acb7f572a5b on n-h2-851028-12 Sep 14 09:42:03.310974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a3ec4ea4-0713-4435-8b7e-d33e00ac587a req-47c4a84d-f08a-4a00-a59a-3725f3d233dc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095659 Sep 14 09:42:03.313236 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3132/4149] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:03.347945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:03.349141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:03.376510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.376923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.377361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.378086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.378535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.380693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.470799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:03.471626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:03.472324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:03.474557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lazy-loading 'fault' on Instance uuid d602677e-ab7f-46b5-b775-6acb7f572a5b {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:42:03.572344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:03.584947 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6882fc13-2c5e-4e0c-a581-7c9e51beca2d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 200 len: 1307 microversion: 2.1 time: 0.243290 Sep 14 09:42:03.600499 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1018/4150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:03 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:04.612759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:04.614597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: d602677e-ab7f-46b5-b775-6acb7f572a5b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:04.634191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:04.635188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:04.635872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:04.637019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:04.637695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:04.638331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:04.668768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] HTTP exception thrown: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Request method failure captured: Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b HTTP/1.1 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaFqMojj6cwLi8Npfs527Q6TD1xm2Q6ocQwdJs4J3wjxoEjQhOrjDrXTMNFme9JPsShCND3N4Np3HieTfcbfcffev_mt5B2tjbNH3APvHga7Sjh2G5mO2YjhgHGQ16AZVvdwDRpE-xhpjqtd8s4Py-Hr7031uESatsLmZt9WrlSsAh8 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 6c76e14a837940b8a7f7bc7f15be0c3d Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6c76e14a837940b8a7f7bc7f15be0c3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c76e14a837940b8a7f7bc7f15be0c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c76e14a837940b8a7f7bc7f15be0c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6c76e14a837940b8a7f7bc7f15be0c3d"}]}] Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 6c76e14a837940b8a7f7bc7f15be0c3d Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesAdminNegativeTest-1080698744-project Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 448c43cada3c4f1c837e1e9f6602da26 Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesAdminNegativeTest-1080698744-project Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd602677e-ab7f-46b5-b775-6acb7f572a5b'} Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:04.677537 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Returning 404 to user: Instance d602677e-ab7f-46b5-b775-6acb7f572a5b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:04.682796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f0fcebf-4f3d-4193-9825-5190e22dbe91 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b" status: 404 len: 111 microversion: 2.1 time: 0.072319 Sep 14 09:42:04.686219 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3133/4151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:04 2022] GET /compute/v2.1/servers/d602677e-ab7f-46b5-b775-6acb7f572a5b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:42:10.478989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:10.480206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:10.488757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.490252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.491016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:10.491927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.492545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.493134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:10.537843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:10.709072 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d71184f8-33a3-480d-bd0c-d1ee363b4b9d tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "DELETE /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 204 len: 0 microversion: 2.1 time: 0.233838 Sep 14 09:42:10.709948 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1019/4152] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:10 2022] DELETE /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:42:10.723151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:10.725911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:10.760855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:10.765816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.767800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.769483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:10.774355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:10.776059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:10.777800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:11.135067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:11.149191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c56795f-1049-4f81-a20f-fcde1f4223b5 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1680 microversion: 2.1 time: 0.434148 Sep 14 09:42:11.167159 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3134/4153] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:10 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1680 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:12.183601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:12.184800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:12.194747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:12.195869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:12.195869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:12.196411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:12.196861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:12.200596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:12.541081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:12.549787 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2e6c3ab-967d-497c-bd65-4ce89a0aa9a8 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1680 microversion: 2.1 time: 0.372913 Sep 14 09:42:12.555440 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1020/4154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:12 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:13.575614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:13.577468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:13.593183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:13.594005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:13.594684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:13.595818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:13.596529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:13.597281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:13.666682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:14.005272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448c43cada3c4f1c837e1e9f6602da26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c76e14a837940b8a7f7bc7f15be0c3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:14.038971 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9f57b59e-3453-4103-8608-40e460c8c04f tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 200 len: 1613 microversion: 2.1 time: 0.462041 Sep 14 09:42:14.054626 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3135/4155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:13 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 1613 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:14.128005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb69a36f-6165-4760-823c-7a6c095c58d1", "name": "network-vif-deleted", "tag": "91c32187-e043-4f54-b93a-85d1e24c35cd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:14.146759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:14.148360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:14.149231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:14.194804 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] Creating event network-vif-deleted:91c32187-e043-4f54-b93a-85d1e24c35cd for instance eb69a36f-6165-4760-823c-7a6c095c58d1 on n-h2-851028-12 Sep 14 09:42:14.201804 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-b6a7b46b-f29b-4d6f-9923-2d86d0d9089b req-334a4b72-a284-4876-9af0-7a6739b28842 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.464584 Sep 14 09:42:14.204076 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1021/4156] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:15.065635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:15.066973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [instance: eb69a36f-6165-4760-823c-7a6c095c58d1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:15.075396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.076108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.076933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.077916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.078647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.079305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.094912 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] HTTP exception thrown: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Request method failure captured: Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 HTTP/1.1 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaFqMojj6cwLi8Npfs527Q6TD1xm2Q6ocQwdJs4J3wjxoEjQhOrjDrXTMNFme9JPsShCND3N4Np3HieTfcbfcffev_mt5B2tjbNH3APvHga7Sjh2G5mO2YjhgHGQ16AZVvdwDRpE-xhpjqtd8s4Py-Hr7031uESatsLmZt9WrlSsAh8 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 6c76e14a837940b8a7f7bc7f15be0c3d Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6c76e14a837940b8a7f7bc7f15be0c3d", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c76e14a837940b8a7f7bc7f15be0c3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6c76e14a837940b8a7f7bc7f15be0c3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6c76e14a837940b8a7f7bc7f15be0c3d"}]}] Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 6c76e14a837940b8a7f7bc7f15be0c3d Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1080698744 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesAdminNegativeTest-1080698744-project Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 448c43cada3c4f1c837e1e9f6602da26 Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesAdminNegativeTest-1080698744-project Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'eb69a36f-6165-4760-823c-7a6c095c58d1'} Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:15.097055 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. Sep 14 09:42:15.102545 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:15.104645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Returning 404 to user: Instance eb69a36f-6165-4760-823c-7a6c095c58d1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:15.105787 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-915c7568-f579-43b8-925e-416d2d2ce388 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1" status: 404 len: 111 microversion: 2.1 time: 0.044097 Sep 14 09:42:15.120225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-437d2d52-516d-4dfe-9d33-c6459bff9a63 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] Calling method '.version_select at 0x7f6947b46a60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:15.126117 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-437d2d52-516d-4dfe-9d33-c6459bff9a63 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:42:15.126719 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3136/4157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:15 2022] GET /compute/v2.1/servers/eb69a36f-6165-4760-823c-7a6c095c58d1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:42:15.811660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:15.812214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:15.823410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.823930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.830766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.831847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:15.832513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:15.833320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:15.986352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'services' on Instance uuid dd3b122b-639e-47bc-90e4-994c6f0230d5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:42:16.122106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eabfa21f-ec79-4620-ad22-be759a9de17a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments/db5300f7-5a01-479a-8e96-e33c7ef22efe" status: 202 len: 0 microversion: 2.1 time: 0.314234 Sep 14 09:42:16.123724 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3137/4158] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:42:15 2022] DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments/db5300f7-5a01-479a-8e96-e33c7ef22efe => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:42:16.138795 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-437d2d52-516d-4dfe-9d33-c6459bff9a63 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 47194. Sep 14 09:42:16.140664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:16.144330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:16.186356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:16.186869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:16.187304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:16.193423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:16.194984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:16.195597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:16.201154 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-437d2d52-516d-4dfe-9d33-c6459bff9a63 tempest-VolumesAdminNegativeTest-1080698744 tempest-VolumesAdminNegativeTest-1080698744-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-573449210" status: 202 len: 0 microversion: 2.1 time: 1.089677 Sep 14 09:42:16.202506 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1022/4159] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:42:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-573449210 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:42:16.261759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abda59d7-530f-4dd8-899c-0db4efe75750 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131447 Sep 14 09:42:16.264117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3138/4160] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:16 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:17.277898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:17.280291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:17.301045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:17.301861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:17.304018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:17.304122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:17.304520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:17.304959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:17.377012 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0c00516-09c2-4fbc-ae98-a48b57b0c659 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104935 Sep 14 09:42:17.380676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1023/4161] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:17 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:18.392133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:18.397297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:18.405279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:18.406005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:18.406663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:18.407585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:18.408307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:18.409116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:18.448071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-adea40e3-ca5c-40ae-b562-c260161a7850 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060860 Sep 14 09:42:18.449057 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3139/4162] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:18 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:19.463084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:19.465488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:19.484509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:19.486580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:19.487234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:19.491619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:19.492559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:19.495005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:19.624459 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f5891c6-c6b6-480f-b146-997223d9bafe tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161149 Sep 14 09:42:19.630711 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1024/4163] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:19 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:20.638300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:20.653511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:20.674246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:20.676300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:20.678812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:20.680944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:20.681705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:20.683756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:20.774706 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dacc0aca-e4cb-40ad-a6ac-054e86f42286 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140670 Sep 14 09:42:20.778824 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3140/4164] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:20 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:21.791719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:21.795310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:21.809929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:21.813728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:21.816403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:21.819781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:21.820530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:21.822559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:21.955252 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-15205018-bd3b-4782-8f9d-d58b5fbed266 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169683 Sep 14 09:42:21.961261 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1025/4165] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:21 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:22.971702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:22.976153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:22.997838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:22.998619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:22.999655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:23.002632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:23.003289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:23.005973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:23.104765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5fbf1a4b-b86a-4391-8d98-b9f1e5b86524 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139489 Sep 14 09:42:23.112506 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3141/4166] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:22 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:24.121484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:24.125350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:24.148221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:24.150146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:24.150866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:24.151804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:24.155988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:24.156789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:24.225934 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-daf654a0-8ace-4915-9b68-d18d2523f679 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111903 Sep 14 09:42:24.226940 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1026/4167] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:24 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:25.239108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:25.241475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.257801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.258304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.258741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.259464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.259929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.260369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.327526 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6184095e-019a-4f2a-8592-48db69f46220 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092651 Sep 14 09:42:25.334101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3142/4168] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 09:42:25 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:25.463482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:25.465648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.485199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.485703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.486147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.486883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.487342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.491748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.528218 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Cannot 'reboot' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action HTTP/1.1 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 28 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: {"reboot": {"type": "HARD"}} Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: exception: Cannot 'reboot' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5', 'body': {'reboot': {'type': 'HARD'}}} Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:42:25.537012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 409 to user: Cannot 'reboot' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:25.542488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-93cb703b-4b7b-45ca-a49c-52478b409c17 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action" status: 409 len: 145 microversion: 2.1 time: 0.079699 Sep 14 09:42:25.545675 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1027/4169] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:42:25 2022] POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:42:25.551099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:25.554899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.564118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.564919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.565544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.566445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.568188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.568968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.642675 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Cannot 'rebuild' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action HTTP/1.1 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 65 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: exception: Cannot 'rebuild' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5', 'body': {'rebuild': {'imageRef': 'cd58b78d-2815-4d3d-9878-b3c3c5fdce55'}}} Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:42:25.652853 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 409 to user: Cannot 'rebuild' instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 while it is in vm_state rescued {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:25.658560 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5f23b37-0daa-46c5-93fd-5d5661694d9d tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action" status: 409 len: 146 microversion: 2.1 time: 0.107645 Sep 14 09:42:25.662671 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3143/4170] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:42:25 2022] POST /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5/action => generated 146 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:42:25.665971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:25.666480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.685551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.745726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:25.857586 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fadbe5dd-1577-4da7-9ce4-b7c634cbfb33 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 204 len: 0 microversion: 2.1 time: 0.195091 Sep 14 09:42:25.858802 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1028/4171] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:25 2022] DELETE /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:42:25.868896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:25.869937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:25.877796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.878602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.880729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:25.881860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:25.882979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:25.883459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:26.430045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:26.444472 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85179771-f835-4719-80e2-599448929237 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1686 microversion: 2.1 time: 0.580041 Sep 14 09:42:26.446122 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3144/4172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:25 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1686 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:27.472758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:27.474389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:27.488985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:27.490009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:27.490456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:27.491184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:27.491648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:27.492113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:27.740098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:27.748330 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-488dfd04-1914-4302-a56e-c0f7c41a938f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1686 microversion: 2.1 time: 0.281360 Sep 14 09:42:27.752614 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1029/4173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:27 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1686 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:28.782825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:28.783690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:28.807729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:28.809421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:28.810069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:28.812240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:28.815203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:28.815776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:29.498353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:29.511586 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a7b9159-c513-4ff6-b8cd-9b0cffaa1a76 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1686 microversion: 2.1 time: 0.732817 Sep 14 09:42:29.517041 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3145/4174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:28 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1686 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:30.549579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:30.550952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:30.561560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:30.570419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:30.571233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:30.571878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:30.574148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:30.575471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:30.579049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:30.802341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:30.817784 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c38120a9-bf8e-4bfa-b908-2851bb6ff05c tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1619 microversion: 2.1 time: 0.272907 Sep 14 09:42:30.826818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1030/4175] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:30 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1619 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:31.517541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3b122b-639e-47bc-90e4-994c6f0230d5", "name": "network-vif-deleted", "tag": "934e69eb-5364-4d40-b875-a1a18e4e5ffc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:31.555669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:31.557434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:31.563407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:31.585375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] Creating event network-vif-deleted:934e69eb-5364-4d40-b875-a1a18e4e5ffc for instance dd3b122b-639e-47bc-90e4-994c6f0230d5 on n-h1-851028-12 Sep 14 09:42:31.603866 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-76282052-bb93-476f-a2dc-d5bc763cfce2 req-281e6f48-f946-4660-9fbd-00d731e20a3d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088044 Sep 14 09:42:31.610529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3146/4176] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:31.852509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:31.858151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:31.913262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:31.913824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:31.923411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:31.929642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:31.930164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:31.930618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:32.045770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:32.100214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:32.100721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:32.101167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:32.104733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'fault' on Instance uuid dd3b122b-639e-47bc-90e4-994c6f0230d5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:42:32.237257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:32.256350 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0e3d54ea-062c-43cd-aa15-21ad5e0cc577 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 200 len: 1333 microversion: 2.1 time: 0.413975 Sep 14 09:42:32.257595 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1031/4177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:31 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 1333 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:33.285709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:33.286466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: dd3b122b-639e-47bc-90e4-994c6f0230d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:33.305612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:33.306122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:33.306578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:33.307309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:33.307772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:33.317064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:33.355448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 HTTP/1.1 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'dd3b122b-639e-47bc-90e4-994c6f0230d5'} Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:33.373242 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. Sep 14 09:42:33.378733 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:33.384320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 404 to user: Instance dd3b122b-639e-47bc-90e4-994c6f0230d5 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:33.386834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e749bedc-06a7-4088-a21e-db9318e906a1 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5" status: 404 len: 111 microversion: 2.1 time: 0.105427 Sep 14 09:42:33.391496 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3147/4178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:33 2022] GET /compute/v2.1/servers/dd3b122b-639e-47bc-90e4-994c6f0230d5 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:42:33.400879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f379de89-3cf0-432f-84bc-64b0f1f734f3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '.version_select at 0x7f6947af5430>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:33.465878 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f379de89-3cf0-432f-84bc-64b0f1f734f3 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142396110" status: 202 len: 0 microversion: 2.1 time: 0.069651 Sep 14 09:42:33.466602 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1032/4179] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 09:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142396110 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:42:38.373524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d654a62-88c2-49b0-926a-f2ca864e32bb tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f693e218940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:38.388450 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:42:38.388898 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 09:42:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe (ip 10.222.0.90) !!! Sep 14 09:42:38.441723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d654a62-88c2-49b0-926a-f2ca864e32bb tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe" status: 200 len: 637 microversion: 2.1 time: 0.072391 Sep 14 09:42:38.443599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3148/4180] 10.222.0.90 () {58 vars in 1233 bytes} [Wed Sep 14 09:42:38 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe => generated 637 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:42:38.459571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-55a97428-1406-4292-99b5-53aeb1773299 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f6947b28dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:38.577437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-55a97428-1406-4292-99b5-53aeb1773299 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:38.592385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-55a97428-1406-4292-99b5-53aeb1773299 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:38.979147 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-55a97428-1406-4292-99b5-53aeb1773299 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.524361 Sep 14 09:42:38.979966 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1033/4181] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:38 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:38.990862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83075435-88e4-4ef5-90c8-9ef40e2f0ecb tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f693e233280>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:39.467744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83075435-88e4-4ef5-90c8-9ef40e2f0ecb tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "DELETE /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.482316 Sep 14 09:42:39.471389 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3149/4182] 10.222.0.90 () {58 vars in 1296 bytes} [Wed Sep 14 09:42:38 2022] DELETE /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_version => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:42:39.478142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bbc74217-bbd6-4e79-b509-f15de48954bf tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f693f299c10>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:39.539148 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bbc74217-bbd6-4e79-b509-f15de48954bf tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 37 microversion: 2.1 time: 0.066312 Sep 14 09:42:39.539744 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1034/4183] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:42:39 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 37 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:39.552787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d0c7dde-fa2a-4080-8a8c-29fb4b04da3b tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f693e498e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:39.644431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7d0c7dde-fa2a-4080-8a8c-29fb4b04da3b tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:39.656597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7d0c7dde-fa2a-4080-8a8c-29fb4b04da3b tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:40.213384 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d0c7dde-fa2a-4080-8a8c-29fb4b04da3b tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.664893 Sep 14 09:42:40.215227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3150/4184] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:39 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:40.225978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6e258673-95f4-4237-b2d9-6db922a7c32d tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f6947af5040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:40.304868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6e258673-95f4-4237-b2d9-6db922a7c32d tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.084861 Sep 14 09:42:40.305766 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1035/4185] 10.222.0.90 () {58 vars in 1290 bytes} [Wed Sep 14 09:42:40 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_distro => generated 33 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:40.315929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a9fd8aa-739f-4f7a-8b8c-1c6ccf195cf2 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f693fa58af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:40.433263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4a9fd8aa-739f-4f7a-8b8c-1c6ccf195cf2 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:40.444790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4a9fd8aa-739f-4f7a-8b8c-1c6ccf195cf2 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:40.750443 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a9fd8aa-739f-4f7a-8b8c-1c6ccf195cf2 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.438298 Sep 14 09:42:40.752181 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3151/4186] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:40 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:42:40.761472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06563e52-3701-4d14-95e8-e3ea557c2192 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f6947b28820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:40.834695 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06563e52-3701-4d14-95e8-e3ea557c2192 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.076465 Sep 14 09:42:40.836263 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1036/4187] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:42:40 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:40.846963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e857867-2296-4a84-89f8-c79cb9356c22 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f693e1d9040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:40.912684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=44 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:40.931005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3e857867-2296-4a84-89f8-c79cb9356c22 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:40.959530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3e857867-2296-4a84-89f8-c79cb9356c22 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:41.295450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e857867-2296-4a84-89f8-c79cb9356c22 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.452147 Sep 14 09:42:41.296271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3152/4188] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:40 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:41.308423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-60b5a7d4-f46f-4bbd-bb8e-b3c75c58c72c tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f693f1c5dc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:41.393246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-60b5a7d4-f46f-4bbd-bb8e-b3c75c58c72c tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:41.416703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-60b5a7d4-f46f-4bbd-bb8e-b3c75c58c72c tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:42.143624 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-60b5a7d4-f46f-4bbd-bb8e-b3c75c58c72c tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 64 microversion: 2.1 time: 0.841835 Sep 14 09:42:42.144455 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1037/4189] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:41 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 64 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:42.164992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d087b44f-9981-4630-8e7b-1a561e2cb458 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f693e1d9f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:42.249754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d087b44f-9981-4630-8e7b-1a561e2cb458 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 64 microversion: 2.1 time: 0.091492 Sep 14 09:42:42.250284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3153/4190] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:42:42 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 64 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:42.258365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:42.279628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e277449-5d18-4b23-a646-01013f85ff35 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f6947b4e940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:42.416369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5e277449-5d18-4b23-a646-01013f85ff35 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:42.433126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5e277449-5d18-4b23-a646-01013f85ff35 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:42.999252 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e277449-5d18-4b23-a646-01013f85ff35 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.741735 Sep 14 09:42:43.000286 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1038/4191] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:42 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:43.012932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcafab92-c64c-4686-939a-c53dca765a1a tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update', calling method: .version_select at 0x7f693e1e35e0>, body: {"meta": {"os_version": "alt"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:43.117735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fcafab92-c64c-4686-939a-c53dca765a1a tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:43.135422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-fcafab92-c64c-4686-939a-c53dca765a1a tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:43.384707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:43.698693 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcafab92-c64c-4686-939a-c53dca765a1a tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.691013 Sep 14 09:42:43.699463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3154/4192] 10.222.0.90 () {60 vars in 1313 bytes} [Wed Sep 14 09:42:43 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata/os_version => generated 31 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:43.710831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c83f503-2c3a-4c3a-8198-6d1c520e6c26 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f6947aee4c0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:43.791485 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c83f503-2c3a-4c3a-8198-6d1c520e6c26 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 58 microversion: 2.1 time: 0.085238 Sep 14 09:42:43.795299 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1039/4193] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:42:43 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:43.807083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f941aa7d-041e-4a5b-9f19-6dc4776e18ec tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'update_all', calling method: .version_select at 0x7f693e1e31f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:43.884412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f941aa7d-041e-4a5b-9f19-6dc4776e18ec tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:43.899574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f941aa7d-041e-4a5b-9f19-6dc4776e18ec tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:43.986592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:43.987312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:43.997551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:44.011274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:44.012155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:44.015309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:44.019051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:44.019553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:44.118175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:44.400725 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-368bac41-ddd8-4a0b-ab3d-fe81236fb6b0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 204 len: 0 microversion: 2.1 time: 0.416414 Sep 14 09:42:44.405257 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1040/4194] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:43 2022] DELETE /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:42:44.426152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:44.429945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:44.448694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:44.450643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:44.453176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:44.454832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:44.456423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:44.456949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:44.528105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f941aa7d-041e-4a5b-9f19-6dc4776e18ec tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 61 microversion: 2.1 time: 0.724811 Sep 14 09:42:44.529267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3155/4195] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:42:43 2022] PUT /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 61 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:42:44.544999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b265f29e-52af-440b-99c5-8c01c8cbf215 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Action: 'create', calling method: .version_select at 0x7f693e487f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:44.632592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b265f29e-52af-440b-99c5-8c01c8cbf215 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:42:44.645947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b265f29e-52af-440b-99c5-8c01c8cbf215 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Getting quotas for user 3e8633d78caa4c31b8ca0d1cb8f5cda9 and project 2addff8bcf2d413ea049542477af50c9. Resources: dict_keys(['metadata_items']) {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:42:45.237192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:45.254104 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fa0a4c1-7a7a-4ce7-9e1c-04f6b9cb79f0 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1508 microversion: 2.1 time: 0.844738 Sep 14 09:42:45.266108 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1041/4196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:44 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1508 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:45.419977 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b265f29e-52af-440b-99c5-8c01c8cbf215 tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "POST /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 85 microversion: 2.1 time: 0.884564 Sep 14 09:42:45.420900 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3156/4197] 10.222.0.90 () {60 vars in 1281 bytes} [Wed Sep 14 09:42:44 2022] POST /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 85 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:45.431129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-826a2cbf-d01b-430d-8ed6-d508d6840d1f tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] Calling method '.version_select at 0x7f6947ab2550>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:45.518193 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-826a2cbf-d01b-430d-8ed6-d508d6840d1f tempest-ImagesMetadataTestJSON-1216997149 tempest-ImagesMetadataTestJSON-1216997149-project] 10.222.0.90 "GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata" status: 200 len: 85 microversion: 2.1 time: 0.091553 Sep 14 09:42:45.518784 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1042/4198] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 09:42:45 2022] GET /compute/v2.1/images/3955b87b-2696-41d5-99da-4b70788a5cfe/metadata => generated 85 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:42:46.291839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:46.292525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:46.310468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:46.310912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:46.311357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:46.316884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:46.320894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:46.321376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:46.652047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:46.668893 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8dc6b22-aa68-4e53-b60d-7ca3cc70ff60 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1508 microversion: 2.1 time: 0.383774 Sep 14 09:42:46.670804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3157/4199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:46 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1508 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:47.696014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:47.696644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:47.721320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:47.721845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:47.722285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:47.723397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:47.725723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:47.726483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:48.621086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:48.641929 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c0837f28-4d4d-49bd-b389-c9317e61a19e tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1508 microversion: 2.1 time: 0.950748 Sep 14 09:42:48.644967 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1043/4200] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:47 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1508 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:49.191752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5", "name": "network-vif-deleted", "tag": "d6fa8af8-09fb-4955-9173-8beb92dd8f2a"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:49.245220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.245989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.248882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.287703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] Creating event network-vif-deleted:d6fa8af8-09fb-4955-9173-8beb92dd8f2a for instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 on n-h2-851028-12 Sep 14 09:42:49.334890 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ef1659b3-55b7-4a2d-86ce-2d15ca9366f4 req-f5cb975d-fd26-4c27-a026-6a898d4ec9e5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153993 Sep 14 09:42:49.341076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3158/4201] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:49.668439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:49.669772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:49.691131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.691985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.693514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.697822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.698536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.699281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.797820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:49.798387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:49.798844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:49.799313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'fault' on Instance uuid 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:42:49.873481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:49.889822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c7a58d8c-bb35-421f-a282-4ea0dae8963a tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 200 len: 1311 microversion: 2.1 time: 0.225847 Sep 14 09:42:49.890916 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1044/4202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:49 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:50.922097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:50.922097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:50.938889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:50.939384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:50.939823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:50.940676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:50.941018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:50.941447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:50.994937 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 HTTP/1.1 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5'} Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:50.996776 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 404 to user: Instance 4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a60ffba-520a-4155-bc80-429325e0fc3f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5" status: 404 len: 111 microversion: 2.1 time: 0.084388 Sep 14 09:42:51.003409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3159/4203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:50 2022] GET /compute/v2.1/servers/4fcf1e44-bcdb-4334-a948-06f5f2ad0ca5 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:42:51.012094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:51.012720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:51.032354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:51.034182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:51.034804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:51.047845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:51.054158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:51.055556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:51.196360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:42:51.494384 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56304894-6e16-4955-9eef-051dcb04942f tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "DELETE /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 204 len: 0 microversion: 2.1 time: 0.487695 Sep 14 09:42:51.495345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1045/4204] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:42:51 2022] DELETE /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:42:51.503216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:51.504128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:51.516127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:51.517252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:51.524369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:51.525420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:51.526002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:51.526538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:52.139260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:52.154100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-389e827f-e243-4831-8074-9d1a63f3bc59 tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.653965 Sep 14 09:42:52.155359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3160/4205] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:51 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:53.185795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:53.187796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:53.203745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:53.206378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:53.209840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:53.210909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:53.212576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:53.217397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:53.219925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:53.928977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:53.951771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12ce9933-7743-4b0d-9514-5f93d7ba9d2b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.773846 Sep 14 09:42:53.958038 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1046/4206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:53 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:54.983760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:54.985167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:54.988421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=24 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:42:55.015278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:55.016058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:55.020934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:55.023835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:55.025597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:55.031183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:55.524371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:55.532698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b81ce20a-d2d6-43f1-90a6-5977243bc81b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1521 microversion: 2.1 time: 0.554324 Sep 14 09:42:55.534069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3161/4207] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:54 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:42:56.561920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:56.562665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:56.588069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.588601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.591369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.592158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.599292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.606057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.684764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58fe86fb-6e35-4e56-9852-86ce499a6c41", "name": "network-vif-deleted", "tag": "44fd8a0d-62ad-4618-864a-9dd2c7bc5cce"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:42:56.730945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.743839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.744365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.783278 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] Creating event network-vif-deleted:44fd8a0d-62ad-4618-864a-9dd2c7bc5cce for instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 on n-h1-851028-12 Sep 14 09:42:56.783837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:56.795185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:56.795701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:56.796211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lazy-loading 'fault' on Instance uuid 58fe86fb-6e35-4e56-9852-86ce499a6c41 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:42:56.812575 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-84ccd3a8-a5c1-4166-aa34-f022e3735876 req-0d943a8a-67b7-4a91-aef4-14b32bc9828e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.692310 Sep 14 09:42:56.817168 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1047/4208] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:42:57.470631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2585d18cd04594b7f8ba9df37c5641', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198415f4f0344cd5816fdf8998068bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:42:57.490792 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c91c32d-6950-4929-9f53-cd67352bcf6b tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 200 len: 1311 microversion: 2.1 time: 0.932633 Sep 14 09:42:57.499183 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3162/4209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:56 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 1311 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:42:58.522615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:42:58.523339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] [instance: 58fe86fb-6e35-4e56-9852-86ce499a6c41] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:42:58.551839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:58.554098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:58.554553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:58.555663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:42:58.555805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:42:58.560794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:42:58.617056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] HTTP exception thrown: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Request method failure captured: Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 HTTP/1.1 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaEDqoqYbSyHHCIPQ04gJGJqoGNCsNcuE5dkNXdXn8n6lKixXF0fm2SR1YeV5uN7uQzfK_z7PDwkf8q7cosLZlFsiSlK6YzBMVM0CAo9QldWdByyTkR4aMRY9qczojrKb74HW5LoyAEoboHbJCr1rr_bZVlx0OzAKP75BNC4DJy_X50 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_198415f4f0344cd5816fdf8998068bcf", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/198415f4f0344cd5816fdf8998068bcf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/198415f4f0344cd5816fdf8998068bcf"}]}] Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 198415f4f0344cd5816fdf8998068bcf Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-523047133 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ce2585d18cd04594b7f8ba9df37c5641 Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueNegativeTestJSON-523047133-project Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '58fe86fb-6e35-4e56-9852-86ce499a6c41'} Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:58.621764 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] Returning 404 to user: Instance 58fe86fb-6e35-4e56-9852-86ce499a6c41 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:42:58.627511 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-599424de-cd70-4b62-847f-90aeb94326aa tempest-ServerRescueNegativeTestJSON-523047133 tempest-ServerRescueNegativeTestJSON-523047133-project] 10.222.0.90 "GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41" status: 404 len: 111 microversion: 2.1 time: 0.108957 Sep 14 09:42:58.628720 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1048/4210] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:42:58 2022] GET /compute/v2.1/servers/58fe86fb-6e35-4e56-9852-86ce499a6c41 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:01.963792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2139843639", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "416ee7fc-32a4-43b7-a6e7-d8e401046bd8"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:02.054226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] validate_networks() for [('416ee7fc-32a4-43b7-a6e7-d8e401046bd8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:43:03.318877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:43:03.319760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:43:03.322957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:43:03.323460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:43:03.323983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:43:03.353867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:03.360733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:03.361341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:03.365469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:03.365469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:03.365469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:03.423885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Getting quotas for project 7de30489a522430a97d37b78582c6590. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:43:03.444629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Getting quotas for user 3c83e2368c4f4953ad46d901e687d6bd and project 7de30489a522430a97d37b78582c6590. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:43:03.488244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:43:03.492402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:43:03.568629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc5522f7-738c-4a82-a108-e957d21155a3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.829369 Sep 14 09:43:03.570044 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3163/4211] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:43:03.586207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-039572e7-e63d-4e16-863e-9f19d17e3d89 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:03.587606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-039572e7-e63d-4e16-863e-9f19d17e3d89 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:03.611006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:03.792209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-039572e7-e63d-4e16-863e-9f19d17e3d89 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:03.806488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-039572e7-e63d-4e16-863e-9f19d17e3d89 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1216 microversion: 2.1 time: 0.227391 Sep 14 09:43:03.822634 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1049/4212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:03 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1216 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:04.831267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0028d2c-b322-407f-acf9-fb3ab660c3fb tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:04.833157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0028d2c-b322-407f-acf9-fb3ab660c3fb tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:05.075137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c0028d2c-b322-407f-acf9-fb3ab660c3fb tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:05.102793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0028d2c-b322-407f-acf9-fb3ab660c3fb tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1216 microversion: 2.1 time: 0.276315 Sep 14 09:43:05.109783 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3164/4213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:04 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1216 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:06.137793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:06.138400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:06.157448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:06.158314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:06.171507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:06.177962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:06.178915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:06.179720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:06.623805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:06.636580 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5dca16b2-0c19-440f-aa42-413806ec37d2 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1268 microversion: 2.1 time: 0.503637 Sep 14 09:43:06.655289 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1050/4214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:06 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1268 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:07.665382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:07.666889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:07.683568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:07.686174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:07.688420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:07.689620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:07.693418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:07.696330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:07.884531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:07.899420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6af628b-2172-4daf-ac5e-0b43ee0a0107 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1274 microversion: 2.1 time: 0.236240 Sep 14 09:43:07.900217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3165/4215] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:07 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:08.924993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:08.925623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:08.946162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:08.960862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:08.964636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:08.968541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:08.970520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:08.971165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:09.246059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:09.262605 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b348f8d-7631-4ce1-998e-3634550057bf tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1274 microversion: 2.1 time: 0.343729 Sep 14 09:43:09.272278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1051/4216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:08 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1274 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:10.296783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:10.298506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:10.315412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:10.321905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:10.322934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:10.323865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:10.327388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:10.327388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:10.669163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:10.683411 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b31b10b2-6804-4e64-ab94-37b29352bf00 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.391745 Sep 14 09:43:10.690694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3166/4217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:10 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:11.242298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3614fc05-84e4-47a0-aae4-d2d2b256ad96", "tag": "81b08d68-c137-48dd-a40b-544714e313ed"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:11.278609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:11.278609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:11.278609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:11.335513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Creating event network-changed:81b08d68-c137-48dd-a40b-544714e313ed for instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 on n-h2-851028-12 Sep 14 09:43:11.347692 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140043 Sep 14 09:43:11.351870 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1052/4218] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:11.707647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:11.709061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:11.722127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:11.725976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:11.730550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:11.730903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:11.732057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:11.732190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:11.732589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:12.004491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:12.013478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.310757 Sep 14 09:43:12.021448 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3167/4219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:11 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:12.341916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:12.343542 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] 10.222.0.90 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002431 Sep 14 09:43:12.350658 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1053/4220] 10.222.0.90 () {56 vars in 886 bytes} [Wed Sep 14 09:43:12 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:43:12.361252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:12.362166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001654 Sep 14 09:43:12.362575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3168/4221] 10.222.0.90 () {54 vars in 1035 bytes} [Wed Sep 14 09:43:12 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 14 09:43:12.371573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:12.373291 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a8453cf7-b56a-4816-8315-0391b468da6e req-78807967-3aa7-4fec-a0df-6b345284a24f service nova] 10.222.0.90 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002404 Sep 14 09:43:12.374313 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1054/4222] 10.222.0.90 () {54 vars in 1041 bytes} [Wed Sep 14 09:43:12 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:12.388309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:12.389518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1aecab15-81d8-48cb-a92c-5e7729e0bbe3 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001558 Sep 14 09:43:12.390111 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3169/4223] 10.222.0.90 () {56 vars in 886 bytes} [Wed Sep 14 09:43:12 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 14 09:43:13.039358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:13.040534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:13.063059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:13.065972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:13.069245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:13.073871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:13.075094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:13.076112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:13.139442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:13.707241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:13.715962 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3387b1f-16fc-43fe-bb8c-93e02081aaf0 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.681536 Sep 14 09:43:13.728477 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1055/4224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:13 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:14.744098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:14.745509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:14.749449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:14.754584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:14.755405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:14.755948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:14.756941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:14.757475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:14.758099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:14.763885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=51 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:14.971103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:15.002325 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbf12c63-adbe-4311-bdec-e3e86be4bf65 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.263281 Sep 14 09:43:15.003120 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3170/4225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:14 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:15.386371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:15.778052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e5d17cad-0bdc-48f6-a8e8-bc34506032a5 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Action: 'create', calling method: .version_select at 0x7f6947b48f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1172873233"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:16.030752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:16.031448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:16.033845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:43:16.049089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:16.050851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:16.050851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:16.051260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:16.052033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:16.052802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:16.417951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:16.434275 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a22fe65-854d-4cfd-8477-7932cb8b20f1 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.401069 Sep 14 09:43:16.436579 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3171/4226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:16 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:43:16.564016 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e5d17cad-0bdc-48f6-a8e8-bc34506032a5 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.184354 Sep 14 09:43:16.574113 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1056/4227] 10.222.0.90 () {60 vars in 1155 bytes} [Wed Sep 14 09:43:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1195 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 14 09:43:16.578548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c77fb402-7795-4f5b-817c-43a7affc726a tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e1d9820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:16.690257 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c77fb402-7795-4f5b-817c-43a7affc726a tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.115765 Sep 14 09:43:16.691152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3172/4228] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:16 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:17.460089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:17.460997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:17.476549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:17.477230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:17.478305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:17.480373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:17.481508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:17.485590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:17.717581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60e5351a-b7ca-46d7-9668-f158736c46bc tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e1c1c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:17.831973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60e5351a-b7ca-46d7-9668-f158736c46bc tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.125737 Sep 14 09:43:17.833765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3173/4229] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:17 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:17.839937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:17.849565 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-baac1f2f-c751-4c82-91e4-ca18062ee510 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.394794 Sep 14 09:43:17.850406 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1057/4230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:17 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:18.848324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6da47a29-5ef7-4647-9d1b-7c466733ddd1 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693f1c50d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:18.917625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6da47a29-5ef7-4647-9d1b-7c466733ddd1 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 346 microversion: 2.1 time: 0.073590 Sep 14 09:43:18.918498 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1058/4231] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:18 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:18.925105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:18.925969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:18.937612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:18.938545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:18.939158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:18.940097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:18.940864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:18.941520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:19.092860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3614fc05-84e4-47a0-aae4-d2d2b256ad96", "name": "network-vif-plugged", "status": "completed", "tag": "81b08d68-c137-48dd-a40b-544714e313ed"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:19.117553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:19.124198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:19.125740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:19.149648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:19.150902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] Creating event network-vif-plugged:81b08d68-c137-48dd-a40b-544714e313ed for instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 on n-h2-851028-12 Sep 14 09:43:19.165142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0c121f6a-fd87-4b2f-a407-162ba75480e0 req-d95dda2d-e2b4-4c50-a409-51ced34a03ff service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.450478 Sep 14 09:43:19.167084 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-980a026d-4031-495c-a44b-918e48814a26 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.246771 Sep 14 09:43:19.170983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3174/4232] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:19.186476 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1059/4233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:18 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:19.192856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a3e203f-f4f5-4a90-895a-839ef7276448 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Action: 'create', calling method: .version_select at 0x7f693e1e3040>, body: {"snapshot": {"volume_id": "7075dc97-2a30-4504-a32f-fcb7b556bd41", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1097753064"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:19.588174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a3e203f-f4f5-4a90-895a-839ef7276448 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.418398 Sep 14 09:43:19.589244 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3175/4234] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Sep 14 09:43:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:19.602770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c3d9cf1-c4fc-4bb2-a31b-963aeeeaa8af tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947ab1ca0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:19.670516 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c3d9cf1-c4fc-4bb2-a31b-963aeeeaa8af tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.073748 Sep 14 09:43:19.671102 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1060/4235] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:19 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:19.688715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d27a8bd0-5244-4f76-b583-a33d4d039988 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e1bd430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:19.725081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d27a8bd0-5244-4f76-b583-a33d4d039988 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042343 Sep 14 09:43:19.726389 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3176/4236] 10.222.0.90 () {58 vars in 1140 bytes} [Wed Sep 14 09:43:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:19.756873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-66cbce24-f0ac-435b-ae14-4e38dfa374b9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947b17ee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:19.817653 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-66cbce24-f0ac-435b-ae14-4e38dfa374b9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.083339 Sep 14 09:43:19.819036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1061/4237] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:19 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:20.193904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:20.195255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:20.211325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:20.212110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:20.212749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:20.213928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:20.214594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:20.215252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:20.489656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:20.506122 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b951d81-8c76-4dea-9bdd-65a3eea0be96 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1316 microversion: 2.1 time: 0.316738 Sep 14 09:43:20.507040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3177/4238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:20 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:20.831922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4d6dd2df-2ada-4c59-804f-5fdbd6bf1ab6 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947a4b310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:20.923069 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4d6dd2df-2ada-4c59-804f-5fdbd6bf1ab6 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.095990 Sep 14 09:43:20.929458 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1062/4239] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:20 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:21.537037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:21.537659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:21.548612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:21.549122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:21.549562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:21.550291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:21.550744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:21.551206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:21.977701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0de4ed68-cdf8-4111-8ef4-a7f37b21ba6b tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693f1c5ee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:22.032681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:22.081950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5f83303-fdf4-445f-92bd-d447d281d87c tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1504 microversion: 2.1 time: 0.549583 Sep 14 09:43:22.097025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3178/4240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:21 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:22.135124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:22.135774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:22.142582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.143181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.143758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.144538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.146056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.146608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.148147 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0de4ed68-cdf8-4111-8ef4-a7f37b21ba6b tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.196783 Sep 14 09:43:22.148957 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1063/4241] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:21 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:22.203580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:43:22.318674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cecd7fe3-b3e9-46b3-ac82-36ae18be98cc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 204 len: 0 microversion: 2.1 time: 0.210392 Sep 14 09:43:22.322825 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3179/4242] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:43:22 2022] DELETE /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:43:22.328486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:22.329311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:22.346129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.346624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.347061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.347810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:22.349057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:22.349375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:22.564402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:22.578798 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2bec61d-04df-443a-a372-f5c14392fd4e tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1510 microversion: 2.1 time: 0.254624 Sep 14 09:43:22.592424 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1064/4243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:22 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:23.163174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7b25bc9-ea49-45ff-a93d-1047f350a0f0 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e4af430>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:23.208936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7b25bc9-ea49-45ff-a93d-1047f350a0f0 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 288 microversion: 2.1 time: 0.049793 Sep 14 09:43:23.209536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3180/4244] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:23 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 288 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:23.221134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ec3e273-16ec-445f-b3cd-c77a71435fef tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947aee9d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:23.298719 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ec3e273-16ec-445f-b3cd-c77a71435fef tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "DELETE /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 202 len: 0 microversion: 2.1 time: 0.081609 Sep 14 09:43:23.299310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1065/4245] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Sep 14 09:43:23 2022] DELETE /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:43:23.310082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d9d5013-0d08-41ac-9c5e-a6e8d72df9e6 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e183310>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:23.358976 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d9d5013-0d08-41ac-9c5e-a6e8d72df9e6 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.054488 Sep 14 09:43:23.360750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3181/4246] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:23 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:43:23.608742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:23.609761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:23.618005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:23.619676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:23.621086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:23.622081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:23.622770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:23.625106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:24.379182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-942a8dfc-cd6a-4895-8384-058a8a43da7e tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693fa3d4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:24.424463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-942a8dfc-cd6a-4895-8384-058a8a43da7e tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.053980 Sep 14 09:43:24.425065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3182/4247] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:24 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:24.563232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:24.586976 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9093ebed-c094-4e70-9388-28de1c865916 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1510 microversion: 2.1 time: 0.986250 Sep 14 09:43:24.587567 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1066/4248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:23 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1510 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:25.038260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3614fc05-84e4-47a0-aae4-d2d2b256ad96", "name": "network-vif-deleted", "tag": "81b08d68-c137-48dd-a40b-544714e313ed"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:25.132234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.136404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.139105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.258922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] Creating event network-vif-deleted:81b08d68-c137-48dd-a40b-544714e313ed for instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 on n-h2-851028-12 Sep 14 09:43:25.270186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7bd6216a-58c5-46cb-943f-8466b7e3bd51 req-f0ef2184-9983-44d0-8a22-9f8d0a04fbb7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239159 Sep 14 09:43:25.274352 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3183/4249] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:25.445276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2513934f-1299-4d8e-a7ab-0b6b50593ed5 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947a4b670>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:25.535750 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2513934f-1299-4d8e-a7ab-0b6b50593ed5 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 200 len: 287 microversion: 2.1 time: 0.095122 Sep 14 09:43:25.536951 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1067/4250] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:25 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:25.619861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:25.621335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:25.647238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.648315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.650918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.653401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.655745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.659077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.774072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:25.785398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:25.786444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:25.788649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lazy-loading 'fault' on Instance uuid 3614fc05-84e4-47a0-aae4-d2d2b256ad96 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:43:25.876929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c83e2368c4f4953ad46d901e687d6bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de30489a522430a97d37b78582c6590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:43:25.898426 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc866a4c-46bb-4ed6-a98c-8d4af66bfe16 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 200 len: 1306 microversion: 2.1 time: 0.287686 Sep 14 09:43:25.901270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3184/4251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:25 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 1306 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:43:26.550243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d223fc20-6dda-40b3-9d4a-ef9a383d11bf tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947ab1b80>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:26.586352 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-d223fc20-6dda-40b3-9d4a-ef9a383d11bf tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] HTTP exception thrown: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d223fc20-6dda-40b3-9d4a-ef9a383d11bf tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Request method failure captured: Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 HTTP/1.1 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaIzyRbt29Jxglf_-0SF7EdJLYWeamg36oouRES3G0tdfUl5TPbZe1sIzOvzt1_Ra6bF8GSo5TMmlZaJeVeDWkcml6ckvBB0bAlawOg9_MrG6vEjKD4KiBLHZPTrICZv681bNlAXiljDHOZ0WpdpvjXFFXllMZaMPiD58_krZ4-S0g4 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c079efee91274527964eab41d4697c07", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c079efee91274527964eab41d4697c07"}]}] Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: be899593db754abf9af1ea135baa36c7 Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: exception: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '8c3a0887-8f2c-47a1-bb19-acb60bae05a7'} Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. (HTTP 404) (Request-ID: req-c583296d-a9e4-45d7-aa3a-9957c1709905) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:43:26.595785 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. Sep 14 09:43:26.600823 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:26.606038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d223fc20-6dda-40b3-9d4a-ef9a383d11bf tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Returning 404 to user: Snapshot 8c3a0887-8f2c-47a1-bb19-acb60bae05a7 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:26.606038 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d223fc20-6dda-40b3-9d4a-ef9a383d11bf tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7" status: 404 len: 111 microversion: 2.1 time: 0.057825 Sep 14 09:43:26.606038 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1068/4252] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 09:43:26 2022] GET /compute/v2.1/os-snapshots/8c3a0887-8f2c-47a1-bb19-acb60bae05a7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:26.613457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-920b21bd-f9e4-4e4c-8caa-4f9abdadb84f tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e2639d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:26.717924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-920b21bd-f9e4-4e4c-8caa-4f9abdadb84f tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 202 len: 0 microversion: 2.1 time: 0.108558 Sep 14 09:43:26.723932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3185/4253] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:43:26 2022] DELETE /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:43:26.730260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-350d907b-1dfd-4d8a-972a-8f1c4a136ae2 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947af5040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:26.782326 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-350d907b-1dfd-4d8a-972a-8f1c4a136ae2 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.056329 Sep 14 09:43:26.783426 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1069/4254] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:26 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:26.923147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:26.926124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:26.960522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:26.961118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:26.961567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:26.963582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:26.966432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:26.966882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.003518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 HTTP/1.1 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3614fc05-84e4-47a0-aae4-d2d2b256ad96'} Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.006766 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.012998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.013587 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8f7aeba2-cf35-4dc1-bdb1-741dfee7e2f6 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 404 len: 111 microversion: 2.1 time: 0.089668 Sep 14 09:43:27.014632 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3186/4255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:26 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:27.034238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1816534556", "metadata": {"image_type": "test"}}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:27.038545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:27.059866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.060538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.061361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.061903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.062463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.062982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.088922 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96/action HTTP/1.1 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 112 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1816534556", "metadata": {"image_type": "test"}}} Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3614fc05-84e4-47a0-aae4-d2d2b256ad96', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1816534556', 'metadata': {'image_type': 'test'}}}} Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 09:43:27.091285 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.096105 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.098957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.100161 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7e51e554-4653-4d97-8238-033fe3a1ef76 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "POST /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96/action" status: 404 len: 111 microversion: 2.1 time: 0.078646 Sep 14 09:43:27.101154 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1070/4256] 10.222.0.90 () {60 vars in 1279 bytes} [Wed Sep 14 09:43:27 2022] POST /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:27.128223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-329024606", "metadata": {"image_type": "test"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:27.131839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Failed to fetch instance by id tempest-invalid-1089465309 {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:43:27.151734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance tempest-invalid-1089465309 could not be found. Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/tempest-invalid-1089465309/action HTTP/1.1 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 111 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-329024606", "metadata": {"image_type": "test"}}} Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance tempest-invalid-1089465309 could not be found. Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'tempest-invalid-1089465309', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-329024606', 'metadata': {'image_type': 'test'}}}} Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1089465309 could not be found. Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.153372 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1089465309 could not be found. Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1089465309 could not be found. Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance tempest-invalid-1089465309 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d3c70ce-b577-419c-bc70-fcd35cb1a5df tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "POST /compute/v2.1/servers/tempest-invalid-1089465309/action" status: 404 len: 101 microversion: 2.1 time: 0.047270 Sep 14 09:43:27.158379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3187/4257] 10.222.0.90 () {60 vars in 1249 bytes} [Wed Sep 14 09:43:27 2022] POST /compute/v2.1/servers/tempest-invalid-1089465309/action => generated 101 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:27.181530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1451787760"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:27.184170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:43:27.184695 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 57 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: {"createImage": {"name": "tempest-test-snap-1451787760"}} Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1451787760'}}} Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.186362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b21f480a-107f-4dcf-9b5d-633d73bacc2d tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011730 Sep 14 09:43:27.191855 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1071/4258] 10.222.0.90 () {60 vars in 1275 bytes} [Wed Sep 14 09:43:27 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:27.199713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-628861064"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:43:27.202709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 14 09:43:27.203230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 56 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: {"createImage": {"name": "tempest-test-snap-628861064"}} Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-628861064'}}} Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.212306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 14 09:43:27.220235 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.224806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.226360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-11bf2862-8dca-4f20-9596-3aa9ee0091bc tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.031898 Sep 14 09:43:27.233305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3188/4259] 10.222.0.90 () {60 vars in 1281 bytes} [Wed Sep 14 09:43:27 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:43:27.243202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:27.244505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:27.261394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.264722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.275820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.283119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.283684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.284159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.306946 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 HTTP/1.1 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3614fc05-84e4-47a0-aae4-d2d2b256ad96'} Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.308781 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b58b0ade-2673-4f01-a825-ccc4eecf8338 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 404 len: 111 microversion: 2.1 time: 0.075326 Sep 14 09:43:27.313433 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1072/4260] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:43:27 2022] DELETE /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:43:27.320954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:27.321581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] [instance: 3614fc05-84e4-47a0-aae4-d2d2b256ad96] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:43:27.332160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.334336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.335978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.337380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:43:27.339338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:43:27.342498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:43:27.373748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] HTTP exception thrown: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Request method failure captured: Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 HTTP/1.1 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIlLqFjQ2d0_aVGIQ9RfSPgbISsWpBcjFIBEFPdnjGB_kevF1FlBjdkIbQEFWRCPSxn0DFZvR7DmtRPmN046kGx-wAKHuvy9MfIHk-EtiLD_lz-E4NHGMfEe8yXRhhcpdg1FBs0I-XhzHIVPJhvAvQ36HFKcUVW2MCyNv-ahIQH8JM Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_7de30489a522430a97d37b78582c6590", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/7de30489a522430a97d37b78582c6590"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/7de30489a522430a97d37b78582c6590"}]}] Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 7de30489a522430a97d37b78582c6590 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-2079276249 Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 3c83e2368c4f4953ad46d901e687d6bd Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ImagesNegativeTestJSON-2079276249-project Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3614fc05-84e4-47a0-aae4-d2d2b256ad96'} Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:27.381660 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:27.388534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] Returning 404 to user: Instance 3614fc05-84e4-47a0-aae4-d2d2b256ad96 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:27.389640 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-677ea264-c934-4717-a7e4-b797dc556c46 tempest-ImagesNegativeTestJSON-2079276249 tempest-ImagesNegativeTestJSON-2079276249-project] 10.222.0.90 "GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96" status: 404 len: 111 microversion: 2.1 time: 0.072426 Sep 14 09:43:27.390731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3189/4261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:43:27 2022] GET /compute/v2.1/servers/3614fc05-84e4-47a0-aae4-d2d2b256ad96 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:27.798882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee08eafa-94af-41bf-81a4-4b6ed1cb8832 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693f1dd280>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:27.867615 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee08eafa-94af-41bf-81a4-4b6ed1cb8832 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.073011 Sep 14 09:43:27.868711 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1073/4262] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:27 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:28.883440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba396c94-a9e2-4492-9433-7b834b2248aa tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e143700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:28.993084 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba396c94-a9e2-4492-9433-7b834b2248aa tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.114376 Sep 14 09:43:29.000518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3190/4263] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:28 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:30.014142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47a40791-146d-4e76-be38-8edc25daf55e tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f6947b3eca0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:30.124717 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47a40791-146d-4e76-be38-8edc25daf55e tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 200 len: 345 microversion: 2.1 time: 0.121206 Sep 14 09:43:30.125580 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1074/4264] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:30 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:43:31.141041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f916cb13-bd02-482d-b6c5-b7758c77cf03 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e18c790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:31.209052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f916cb13-bd02-482d-b6c5-b7758c77cf03 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] HTTP exception thrown: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f916cb13-bd02-482d-b6c5-b7758c77cf03 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Request method failure captured: Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 HTTP/1.1 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIzyRbt29Jxglf_-0SF7EdJLYWeamg36oouRES3G0tdfUl5TPbZe1sIzOvzt1_Ra6bF8GSo5TMmlZaJeVeDWkcml6ckvBB0bAlawOg9_MrG6vEjKD4KiBLHZPTrICZv681bNlAXiljDHOZ0WpdpvjXFFXllMZaMPiD58_krZ4-S0g4 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c079efee91274527964eab41d4697c07", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c079efee91274527964eab41d4697c07"}]}] Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: be899593db754abf9af1ea135baa36c7 Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7075dc97-2a30-4504-a32f-fcb7b556bd41'} Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. (HTTP 404) (Request-ID: req-f854af65-22d1-4d15-a7f7-dd91807135e3) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:43:31.210974 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f916cb13-bd02-482d-b6c5-b7758c77cf03 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Returning 404 to user: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f916cb13-bd02-482d-b6c5-b7758c77cf03 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 404 len: 109 microversion: 2.1 time: 0.076620 Sep 14 09:43:31.217749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3191/4265] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:31 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:31.228460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3aae6d1c-1d61-41b3-abee-c05674e052e9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693f274b80>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:31.281434 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3aae6d1c-1d61-41b3-abee-c05674e052e9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] HTTP exception thrown: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3aae6d1c-1d61-41b3-abee-c05674e052e9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Request method failure captured: Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 HTTP/1.1 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaIzyRbt29Jxglf_-0SF7EdJLYWeamg36oouRES3G0tdfUl5TPbZe1sIzOvzt1_Ra6bF8GSo5TMmlZaJeVeDWkcml6ckvBB0bAlawOg9_MrG6vEjKD4KiBLHZPTrICZv681bNlAXiljDHOZ0WpdpvjXFFXllMZaMPiD58_krZ4-S0g4 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c079efee91274527964eab41d4697c07", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c079efee91274527964eab41d4697c07"}]}] Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: be899593db754abf9af1ea135baa36c7 Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: method: Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: exception: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '7075dc97-2a30-4504-a32f-fcb7b556bd41'} Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. (HTTP 404) (Request-ID: req-20ff87a7-a5b3-43a0-93e4-9248a69c8380) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:43:31.283383 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3aae6d1c-1d61-41b3-abee-c05674e052e9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Returning 404 to user: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3aae6d1c-1d61-41b3-abee-c05674e052e9 tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "DELETE /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 404 len: 109 microversion: 2.1 time: 0.064591 Sep 14 09:43:31.291362 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1075/4266] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 09:43:31 2022] DELETE /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:43:31.306515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a250577a-aa2b-417e-be8a-bc8f26a4dcca tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Calling method '.version_select at 0x7f693e18c940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:43:31.366741 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a250577a-aa2b-417e-be8a-bc8f26a4dcca tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] HTTP exception thrown: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a250577a-aa2b-417e-be8a-bc8f26a4dcca tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Request method failure captured: Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 HTTP/1.1 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaIzyRbt29Jxglf_-0SF7EdJLYWeamg36oouRES3G0tdfUl5TPbZe1sIzOvzt1_Ra6bF8GSo5TMmlZaJeVeDWkcml6ckvBB0bAlawOg9_MrG6vEjKD4KiBLHZPTrICZv681bNlAXiljDHOZ0WpdpvjXFFXllMZaMPiD58_krZ4-S0g4 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_c079efee91274527964eab41d4697c07", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/c079efee91274527964eab41d4697c07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/c079efee91274527964eab41d4697c07"}]}] Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: c079efee91274527964eab41d4697c07 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-492542710 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: be899593db754abf9af1ea135baa36c7 Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesSnapshotsTestJSON-492542710-project Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: method: Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: exception: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7075dc97-2a30-4504-a32f-fcb7b556bd41'} Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. (HTTP 404) (Request-ID: req-6e55c6aa-9c3a-43fc-a44e-498103c85999) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 14 09:43:31.368782 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a250577a-aa2b-417e-be8a-bc8f26a4dcca tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] Returning 404 to user: Volume 7075dc97-2a30-4504-a32f-fcb7b556bd41 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a250577a-aa2b-417e-be8a-bc8f26a4dcca tempest-VolumesSnapshotsTestJSON-492542710 tempest-VolumesSnapshotsTestJSON-492542710-project] 10.222.0.90 "GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41" status: 404 len: 109 microversion: 2.1 time: 0.071201 Sep 14 09:43:31.375291 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3192/4267] 10.222.0.90 () {58 vars in 1245 bytes} [Wed Sep 14 09:43:31 2022] GET /compute/v2.1/os-volumes/7075dc97-2a30-4504-a32f-fcb7b556bd41 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:45:00.134409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=23 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:00.135434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=33 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:00.137421 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:45:00.137590 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:45:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.90) !!! Sep 14 09:45:00.143673 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 09:45:00.153717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52214f8c-dc19-4059-b209-c19f9bcc03da tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Action: 'create', calling method: .version_select at 0x7f6947b17b80>, body: {"keypair": {"name": "tempest-keypair-1568626865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM99UZY5CdIZC6j2r/1fQ1ke4ON2WdRpt1mnwqwCY20w2ohSZCJUwkWbf7jxTWBBy/nU96TzlH9S54FcoXI9HPEPdFGUshlsgcLQcYLe2Cl+UB/C4VQIPHbBUdyOF93gbg=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:00.182429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-52214f8c-dc19-4059-b209-c19f9bcc03da tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Getting quotas for project d910602cfc27484496a75e9c30aba211. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:45:00.200954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-52214f8c-dc19-4059-b209-c19f9bcc03da tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Getting quotas for user daace12fcd1a407784d449d118b05e16 and project d910602cfc27484496a75e9c30aba211. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:45:00.269688 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52214f8c-dc19-4059-b209-c19f9bcc03da tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.134344 Sep 14 09:45:00.271851 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1076/4268] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 09:45:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 14 09:45:04.622151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:04.623544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:04.662562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-729137196", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d5d6fe98-f53e-4795-9bb5-2d5c9cfd6f49"}, {"port": "d3d5f079-71b7-48d8-8017-26eb3a72851e", "tag": "port-1"}, {"port": "5a4bb046-f218-49c5-b197-a9385272e75d", "tag": "port-2"}, {"uuid": "b3b61a4b-2ec3-413d-81de-58be5a51ed79", "tag": "net-1"}, {"uuid": "b3b61a4b-2ec3-413d-81de-58be5a51ed79"}, {"uuid": "969bdbc1-0f34-4042-a264-e9b6660a7671", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "969bdbc1-0f34-4042-a264-e9b6660a7671", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c6463688-9ec3-4522-81db-2297a2dea028", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4bc19461-085d-40da-be9c-f1060cd0681a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d026ca6f-b036-4158-ab10-61135d7cd1ef", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2105841720"}], "key_name": "tempest-keypair-1568626865", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:04.983633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] validate_networks() for [('d5d6fe98-f53e-4795-9bb5-2d5c9cfd6f49', None, None, None, None, None), (None, None, 'd3d5f079-71b7-48d8-8017-26eb3a72851e', None, None, None), (None, None, '5a4bb046-f218-49c5-b197-a9385272e75d', None, None, None), ('b3b61a4b-2ec3-413d-81de-58be5a51ed79', None, None, None, None, None), ('b3b61a4b-2ec3-413d-81de-58be5a51ed79', None, None, None, None, None), ('969bdbc1-0f34-4042-a264-e9b6660a7671', '10.2.2.100', None, None, None, None), ('969bdbc1-0f34-4042-a264-e9b6660a7671', '10.2.2.200', None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:45:11.722795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:45:11.724196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:45:11.724846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:45:11.735212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:45:11.735212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:45:11.799099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:11.799602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:11.806346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:11.807292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:11.807790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:11.808270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:11.887289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Getting quotas for project d910602cfc27484496a75e9c30aba211. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:45:11.903594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Getting quotas for user daace12fcd1a407784d449d118b05e16 and project d910602cfc27484496a75e9c30aba211. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:45:12.259239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:45:12.262311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c6463688-9ec3-4522-81db-2297a2dea028',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4bc19461-085d-40da-be9c-f1060cd0681a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d026ca6f-b036-4158-ab10-61135d7cd1ef',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:45:13.069141 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e7fb7fd-9b73-4766-8acf-ca4e73029266 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 8.452039 Sep 14 09:45:13.069798 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3193/4269] 10.222.0.90 () {62 vars in 1189 bytes} [Wed Sep 14 09:45:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 8454 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:45:13.081608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:13.082247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:13.087612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:13.088812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:13.283147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:13.296618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:13.303672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:13.308690 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb08a31c-dd6c-45e1-bd0c-a806a60e6b93 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1285 microversion: 2.42 time: 0.231461 Sep 14 09:45:13.309281 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1077/4270] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:13 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:14.344323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:14.345150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:14.578189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:14.590221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:14.599751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:14.604930 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a46ae2f-9d7b-4fd6-a8a8-a9fdc7e201a8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1285 microversion: 2.42 time: 0.263788 Sep 14 09:45:14.607634 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3194/4271] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:14 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:15.652703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:15.654379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:15.677804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:15.678726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:15.681382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:15.687494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:15.688742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:15.691031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:16.143865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:16.154881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:16.166553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:16.169482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ddbb9440-fe2a-400f-ba5e-b9a2ad7c84bd tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1575 microversion: 2.42 time: 0.521821 Sep 14 09:45:16.175404 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1078/4272] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:15 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1575 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:17.217564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:17.219048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:17.233761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:17.234255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:17.241441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:17.242243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:17.242834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:17.243285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:17.415813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:17.427398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:17.437227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:17.438445 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da8ac27f-08ce-4b1d-965c-568253857526 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1593 microversion: 2.42 time: 0.227392 Sep 14 09:45:17.453247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3195/4273] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:17 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1593 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:18.474326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:18.475701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:18.491058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:18.492293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:18.492412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:18.493311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:18.493910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:18.494675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:18.794685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:18.808684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:18.814056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:18.816324 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56ba8c31-1c39-4f9b-a321-84bbc2c19c42 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1593 microversion: 2.42 time: 0.347018 Sep 14 09:45:18.830496 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1079/4274] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:18 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1593 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:19.846048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:19.846772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:19.865161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:19.865681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:19.868300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:19.869103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:19.869574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:19.872079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:20.217463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:20.232187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:20.234263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:20.236790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dda9ea22-e7ad-48d8-8b9e-4368239b9a1e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1661 microversion: 2.42 time: 0.395149 Sep 14 09:45:20.237694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3196/4275] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:19 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1661 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:21.266505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:21.271440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:21.285697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:21.286977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:21.292877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:21.293883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:21.295825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:21.296444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:21.823660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:21.851953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:21.858130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:21.862836 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-df2c3a51-6132-4001-825a-ac025abd8e7b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1661 microversion: 2.42 time: 0.600274 Sep 14 09:45:21.864395 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1080/4276] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:21 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1661 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:22.892251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:22.899336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:22.900498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:22.924169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:22.924989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:22.925648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:22.927261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:22.928188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:22.928956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:23.335036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:23.350514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:23.356530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:23.360062 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3623cc4d-c21d-4005-a298-e761ca46a177 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1708 microversion: 2.42 time: 0.469957 Sep 14 09:45:23.362508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3197/4277] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:22 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1708 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:24.389964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:24.390795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:24.398212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:24.402207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:24.402715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:24.410122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:24.414856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:24.419763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:24.420347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:25.322091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:25.355140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:25.363432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:25.371871 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6167e72b-bc24-4926-89eb-e24ad46680a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1755 microversion: 2.42 time: 0.986175 Sep 14 09:45:25.380137 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1081/4278] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:24 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1755 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:26.410491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:26.412537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:26.425958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:26.462195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:26.462699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:26.463144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:26.463862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:26.472713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:26.473845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:26.970543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:27.000502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:27.007053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:27.012511 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1f46e1e-6bab-4354-9bdc-d7f6a244df19 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1802 microversion: 2.42 time: 0.606192 Sep 14 09:45:27.016849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3198/4279] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:26 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1802 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:28.053857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:28.055105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:28.077306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:28.085916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:28.091659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:28.092882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:28.093376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:28.093819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:28.586504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:28.604482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:28.612194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:28.618382 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34fdf837-9044-408d-9fa8-66a0f23641b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1802 microversion: 2.42 time: 0.567872 Sep 14 09:45:28.623573 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1082/4280] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:28 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1802 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:29.651368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:29.652081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:29.668078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:29.668707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:29.669248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:29.671055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:29.673178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:29.675705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:30.183411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:30.201949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:30.206589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:30.208271 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbea7775-f94d-4daf-b282-61e944ac1de1 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1849 microversion: 2.42 time: 0.561363 Sep 14 09:45:30.224733 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3199/4281] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:29 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1849 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:31.248129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:31.250334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:31.293455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:31.300551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:31.301114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:31.305281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:31.305281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:31.305571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:31.310202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "c4a4c1e9-27d6-45c9-96ab-722055d6840e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:31.370539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:31.371379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:31.372214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:31.392911 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] Creating event network-changed:c4a4c1e9-27d6-45c9-96ab-722055d6840e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:31.408525 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cf3674f2-bfb8-4429-a8d3-f843a89937ef req-77e17e95-bf29-4eb7-afbd-27d55bdc2306 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111257 Sep 14 09:45:31.411020 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3200/4282] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:45:32.644885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:32.667267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:32.678481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:32.680320 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-311dbbbc-9979-4cd8-a02d-d64c96d5e223 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1849 microversion: 2.42 time: 1.449529 Sep 14 09:45:32.687938 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1083/4283] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:31 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1849 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:33.723688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:33.725176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:33.748320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:33.748690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:33.749599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:33.751707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:33.752209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:33.756279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:34.787886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:34.791079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=39 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:34.810649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:34.816114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:34.816114 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c41bffc1-d656-448b-91ff-9391754e0c73 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1870 microversion: 2.42 time: 1.096926 Sep 14 09:45:34.833409 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3201/4284] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:33 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1870 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:35.279093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "d3d5f079-71b7-48d8-8017-26eb3a72851e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:35.314566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:35.315127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:35.315569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:35.328774 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] Creating event network-changed:d3d5f079-71b7-48d8-8017-26eb3a72851e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:35.338125 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a9b8896b-3deb-41e3-b26a-49588b13402d req-ebfae335-e9e0-4421-a07d-a39faaa4a1b2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070123 Sep 14 09:45:35.342763 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1084/4285] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:45:35.845523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:35.846135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:35.850976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:35.890809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:35.891641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:35.892279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:35.893363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:35.893980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:35.894554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:36.566459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:36.598004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:36.603765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:36.608242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1616bf1-69ea-48ff-93ce-35549f6fe261 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1870 microversion: 2.42 time: 0.765455 Sep 14 09:45:36.609379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3202/4286] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:35 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1870 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:37.641489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:37.643118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:37.663529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:37.664844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:37.666150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:37.668449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:37.671758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:37.672989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:38.089927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "5a4bb046-f218-49c5-b197-a9385272e75d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:38.127255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:38.130142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:38.132527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:38.178993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] Creating event network-changed:5a4bb046-f218-49c5-b197-a9385272e75d for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:38.195038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e206059a-b211-4242-8119-85a370ed75cc req-1de06653-94af-455d-bd5f-81e6bbec57fa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114500 Sep 14 09:45:38.198853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3203/4287] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:45:38.675985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:38.699448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:38.704580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:38.710199 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-983d0812-b796-4019-aaf1-9ab28c64238e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 1.078265 Sep 14 09:45:38.711253 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1085/4288] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:37 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:39.745688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:39.746700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:39.765989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:39.768237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:39.769568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:39.772701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:39.773721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:39.775686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:40.177422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:40.195928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:40.215149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:40.218223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6adb5db-d4d3-4131-9ac1-8c4cd7818a12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.477898 Sep 14 09:45:40.234572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3204/4289] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:39 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:41.080140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "4bf16b4c-2b78-4a74-ba97-6d3324f7804e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:41.122067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:41.123326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:41.124121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:41.157667 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] Creating event network-changed:4bf16b4c-2b78-4a74-ba97-6d3324f7804e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:41.183172 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-204ac55c-5bda-4b6c-b088-2f289a97792d req-b1eb5d6d-5a29-4797-b157-a59cf9429147 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105821 Sep 14 09:45:41.187485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1086/4290] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:45:41.249141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:41.250408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:41.266909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:41.267916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:41.269689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:41.272315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:41.276379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:41.277028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:41.753040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:41.775326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:41.791203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:41.792476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78762d61-5239-4a06-b29f-a75315734e12 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.548816 Sep 14 09:45:41.793093 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3205/4291] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:41 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:42.824918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:42.826185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:42.858417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:42.859185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:42.881471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:42.884247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:42.886003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:42.887679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:43.404911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "650232e0-bf9d-48c7-b1ee-0e6bad48bf2c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:43.439469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:43.439973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:43.440441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:43.502438 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] Creating event network-changed:650232e0-bf9d-48c7-b1ee-0e6bad48bf2c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:43.524442 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0e40ffdb-8155-4732-8dd3-3571f3850bf0 req-3d011eb8-c23b-4d89-8e8d-2edc07f344d6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122401 Sep 14 09:45:43.529294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3206/4292] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 14 09:45:44.134696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:44.135800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=51 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:44.156481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:44.194012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:44.197724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0014f78d-78bd-49be-ab37-fe320bd4cdd2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 1.378354 Sep 14 09:45:44.200126 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1087/4293] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:42 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:45.233473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:45.234206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:45.255919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:45.256530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:45.256861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:45.272449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:45.289051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:45.291317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:45.773449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:45.791595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:45.796924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:45.802002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-395e7033-15a8-45cc-8bd5-9c80ef59bcb3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.574422 Sep 14 09:45:45.819935 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3207/4294] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:45 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:46.199664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "62f138f2-9474-49d5-9e39-c258023394ad"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:46.260553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=25 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:45:46.267407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:46.268143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:46.268720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:46.311465 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] Creating event network-changed:62f138f2-9474-49d5-9e39-c258023394ad for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:46.338098 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-56b1ce87-3557-45d3-a608-fb6c15067ef1 req-786b37d3-c144-47e5-b837-3d594beec02c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138548 Sep 14 09:45:46.341115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1088/4295] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:45:46.837955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:46.838574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:46.851016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:46.851524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:46.862516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:46.865315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:46.866802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:46.867359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:47.338574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:47.353386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:47.363411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:47.367925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e98ee182-32df-476b-90fa-8258f3c4dbba tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.531840 Sep 14 09:45:47.379924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3208/4296] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:46 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:48.403541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:48.404408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:48.427281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:48.434169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:48.434778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:48.439517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:48.442261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:48.442947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:49.365020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:49.442412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:49.445204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:49.457313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9d05101-005d-4126-af46-79a2a1de9881 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 1.061844 Sep 14 09:45:49.460994 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1089/4297] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:48 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:49.762533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "9e37e8af-ab20-4671-a729-1e8eb2016b5c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:45:49.778173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:49.779031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:49.779668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:49.797278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] Creating event network-changed:9e37e8af-ab20-4671-a729-1e8eb2016b5c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:45:49.817878 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e38d962f-994e-4c3b-a5e0-080a456733ea req-ea22447b-eac8-4383-aaaf-5c4e7c3ff1df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061600 Sep 14 09:45:49.825209 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3209/4298] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:45:50.490927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:50.491814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:50.510420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:50.511759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:50.512581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:50.513446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:50.514099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:50.515171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:51.378419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:51.410241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:51.426868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:51.426868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-055135cf-a5be-4f46-814d-e024271d6d8c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.938981 Sep 14 09:45:51.437803 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1090/4299] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:50 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:52.464967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:52.476077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:52.494857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:52.501471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:52.501942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:52.502699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:52.513609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:52.515520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:53.504032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:53.529074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:53.534307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:53.536598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b787aa4e-4cb4-4776-871f-82f1ce549558 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 1.083173 Sep 14 09:45:53.537326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3210/4300] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:52 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:54.571359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:54.572795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:54.599526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.600356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.601706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:54.603477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:54.610203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:54.616560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:56.923819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:56.939362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:56.942748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:56.944691 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ef33b9d5-2bc2-4cf4-bb8f-a8e56939c4a0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 2.377800 Sep 14 09:45:56.946021 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1091/4301] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:54 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 2380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:57.988349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:57.989550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:58.005544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:58.007745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:58.012059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:58.014325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:58.016256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:58.016922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:58.702515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:58.714236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:58.716354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:45:58.718028 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-152969e3-708c-4988-b0be-f89e0169d153 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.733896 Sep 14 09:45:58.719499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3211/4302] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:57 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:45:59.758271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:45:59.765860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:45:59.802432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:59.804441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:59.807364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:45:59.814342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:45:59.821058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:45:59.823234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:00.342931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:00.372124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:00.374663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:00.394111 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b89ffc06-1be8-485a-af94-1bd7afee12d3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.646452 Sep 14 09:46:00.396279 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1092/4303] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:45:59 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:01.429399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:01.430088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:01.444660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:01.446277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:01.446913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:01.449911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:01.451338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:01.452809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:01.927346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:01.952593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:01.964768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:01.968551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73f590be-2c2f-4a44-baab-c460d6b59af8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.545574 Sep 14 09:46:01.981066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3212/4304] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:01 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:03.010504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:03.010934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:03.026160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:03.026920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:03.028970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:03.029870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:03.033448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:03.034632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:04.023059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:04.045063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:04.049450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:04.050701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03cacbca-3ad2-4e73-b545-44ef311dbe31 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 1.044617 Sep 14 09:46:04.054907 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1093/4305] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:03 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:05.092837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:05.096199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:05.117066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:05.118541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:05.122508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:05.123618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:05.124379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:05.125677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:05.961431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:05.965473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=60 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:05.995485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:05.999997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:06.008585 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-359d49dd-0463-4bf1-aaf1-997914f5eef3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.929923 Sep 14 09:46:06.013366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3213/4306] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:05 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:07.043680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:07.044422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:07.059724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:07.061365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:07.062123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:07.064214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:07.067954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:07.068647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:07.552026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:07.566510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:07.571601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:07.575062 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b826f17a-0f62-4615-a926-a32c35fe8922 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.535969 Sep 14 09:46:07.579105 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1094/4307] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:07 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:08.607272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:08.608625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:08.625964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=24 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:08.628728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:08.629929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:08.630594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:08.631661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:08.632316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:08.634442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:09.302134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:09.323653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:09.325325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:09.327168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-34a4441b-dd44-45ff-a7c5-f759998d0fef tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1891 microversion: 2.42 time: 0.725864 Sep 14 09:46:09.328244 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3214/4308] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:08 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1891 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:10.357687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:10.359339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:10.389931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:10.395248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:10.395952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:10.403997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:10.405542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:10.406611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:10.895026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:10.911406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:10.914260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:10.915735 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c80f13c-ba38-4e51-a93e-27fb1d4f7e34 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.562530 Sep 14 09:46:10.925616 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1095/4309] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:10 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:11.946950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:11.948340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:11.959540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:11.962301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:11.962915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:11.964037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:11.967355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:11.968013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:12.375753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:12.391147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:12.397838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:12.399079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-433b7c3a-5d0d-4681-9a46-3506f6c3038b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.456181 Sep 14 09:46:12.399827 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3215/4310] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:11 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:13.429332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:13.430694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:13.458948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:13.459795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:13.460505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:13.461720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:13.463466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:13.464903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:13.937602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:13.959567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:13.965049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:13.966984 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-adc7eed7-cbdf-4545-a745-a53e7b13048f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.543679 Sep 14 09:46:13.970321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1096/4311] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:13 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:15.000351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:15.001494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:15.009430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.010195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.010789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.011656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:15.012833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:15.013414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:15.471834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.513090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.518021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:15.531193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f574933-3a3e-466d-8742-2424b584b69d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.537611 Sep 14 09:46:15.542484 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3216/4312] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:14 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:16.564390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:16.565030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:16.580202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:16.581976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:16.583009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:16.583821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:16.586583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:16.587137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:16.599451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=52 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:17.111674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:17.132045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:17.134403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:17.134891 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d8598827-0c8f-45b6-a712-234ea57300ce tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.574381 Sep 14 09:46:17.152273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1097/4313] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:16 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:18.173519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:18.174146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:18.188403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:18.188988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:18.189347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:18.194404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:18.196416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:18.199298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:18.810730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:18.839757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:18.841189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:18.842371 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ffe63e5c-2853-491a-9c69-656278b3a592 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.675272 Sep 14 09:46:18.848875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3217/4314] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:18 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:19.893360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:19.894217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:19.898822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=20 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:19.909108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:19.909593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:19.910248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:19.911510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:19.912160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:19.912746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:20.700010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:20.723694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:20.725579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:20.727779 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e0e74da-155e-41a8-a768-5d67003c4352 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.841491 Sep 14 09:46:20.742706 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1098/4315] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:19 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:21.764674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:21.765296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:21.773618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:21.774504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:21.775172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:21.776156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:21.776841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:21.778963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:22.594227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:22.616415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:22.618576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:22.620510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c605b83-eb77-4e98-bfdc-d7da92a9d34f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.859750 Sep 14 09:46:22.627242 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3218/4316] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:21 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:23.666731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:23.667279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:23.688855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:23.689359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:23.697243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:23.698132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:23.698624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:23.699063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:24.564575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:24.592603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:24.597919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:24.599694 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f967016-51e2-493a-b64e-c09c5fea24b9 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.939147 Sep 14 09:46:24.600308 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1099/4317] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:23 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:25.638057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:25.639586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:25.658907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:25.659506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:25.660115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:25.661021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:25.663060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:25.665176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:26.503213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:26.550268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:26.554015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:26.564565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80c39b08-3c4b-4192-9af6-8c3dc62745e0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.933836 Sep 14 09:46:26.565717 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3219/4318] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:25 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:27.596400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:27.597019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:27.614734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:27.615226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:27.615666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:27.642229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:27.644754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:27.648451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:28.148731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:28.165307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:28.169432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:28.173181 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17f3c864-017a-468c-b39c-f8daefdfb8c0 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.580988 Sep 14 09:46:28.179216 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1100/4319] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:27 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:29.210612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:29.212202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:29.224758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:29.231755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:29.232655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:29.233578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:29.236805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:29.237454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:29.753849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:29.775107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:29.777517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:29.779321 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e797523-fbc1-4d28-a27c-b5bb8f7172df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.572640 Sep 14 09:46:29.780705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3220/4320] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:29 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:30.576125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "c4a4c1e9-27d6-45c9-96ab-722055d6840e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:30.596930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:30.599350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:30.601006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:30.627746 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] Creating event network-vif-plugged:c4a4c1e9-27d6-45c9-96ab-722055d6840e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:30.638153 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0c22e3ff-e9e1-4135-8e98-afeafeca3990 req-50c5dd92-1801-473b-ab1b-a49dc501e0d9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066976 Sep 14 09:46:30.639427 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1101/4321] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:30.817627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:30.821277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:30.837204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:30.838202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:30.838841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:30.839766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:30.840402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:30.841027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:31.257497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:31.305443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:31.330298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:31.331932 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3bd6991-d9bf-425c-8d46-de989521f1d2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.524414 Sep 14 09:46:31.333950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3221/4322] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:30 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:32.360932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:32.361627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:32.377490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:32.377992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:32.378430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:32.379148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:32.379829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:32.380473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:33.294462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:33.311777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:33.324072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:33.325313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f06ecc71-3125-4485-8265-dcc1bebe7440 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.968580 Sep 14 09:46:33.325891 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1102/4323] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:32 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:34.360970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:34.363348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:34.385755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:34.389781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:34.393922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:34.394874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:34.397116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:34.399223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:35.730649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:35.787519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:35.789000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:35.790191 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f25a2a3f-5ece-4172-9173-9632bb0390ec tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 1.433903 Sep 14 09:46:35.824583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3222/4324] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:34 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:36.822109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:36.822914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:36.838564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:36.839291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:36.839985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:36.840883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:36.841481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:36.842761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:37.878924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:37.898666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:37.900221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:37.930631 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ec308b5-3ed4-4891-b0d6-76edece3c4b5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 1.113843 Sep 14 09:46:37.934770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1103/4325] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:36 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:38.965043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:38.965662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:38.968758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:38.983181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:38.986146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:38.986655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:38.987410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:38.987880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:39.001800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:39.066212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=56 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:39.248496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "62f138f2-9474-49d5-9e39-c258023394ad"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:39.285312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:39.287918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:39.290538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:39.324128 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] Creating event network-vif-plugged:62f138f2-9474-49d5-9e39-c258023394ad for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:39.338526 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3f8bd6b7-781d-4c57-8a59-b8b41cbf35de req-5cdc742e-4330-4e47-a475-a4ce8deb3145 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093881 Sep 14 09:46:39.341862 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1104/4326] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:39.564079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:39.584392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:39.596718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:39.617669 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99353095-dfb2-43d1-85db-43caf0531432 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.656727 Sep 14 09:46:39.638837 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3223/4327] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:38 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:40.657162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:40.658487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:40.694923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:40.698062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:40.702831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:40.704958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:40.705323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:40.708538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:41.178095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:41.207771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:41.221822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:41.224000 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ea102e00-0e30-4a37-b691-97d54ce3dd7d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.570736 Sep 14 09:46:41.225109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1105/4328] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:40 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:41.415440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "4bf16b4c-2b78-4a74-ba97-6d3324f7804e"}, {"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "d3d5f079-71b7-48d8-8017-26eb3a72851e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:41.451538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:41.452931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:41.453398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:41.468107 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Creating event network-vif-plugged:4bf16b4c-2b78-4a74-ba97-6d3324f7804e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:41.468877 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] Creating event network-vif-plugged:d3d5f079-71b7-48d8-8017-26eb3a72851e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:41.477725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ef01ff7c-4715-4873-a6bb-bda5191c2ad4 req-a1562810-474b-4ba2-9162-326df6aac54f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066796 Sep 14 09:46:41.478955 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3224/4329] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:42.273570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:42.274206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:42.283139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:42.283916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:42.284507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:42.285832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:42.286450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:42.287030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:43.527457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:43.540758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:43.546480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:43.548140 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8222b40-c01a-435e-b717-17b203025eed tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 1.286771 Sep 14 09:46:43.573892 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1106/4330] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:42 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:43.687276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "5a4bb046-f218-49c5-b197-a9385272e75d"}, {"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "650232e0-bf9d-48c7-b1ee-0e6bad48bf2c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:43.717234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:43.718576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:43.719022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:43.747187 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Creating event network-vif-plugged:5a4bb046-f218-49c5-b197-a9385272e75d for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:43.754923 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] Creating event network-vif-plugged:650232e0-bf9d-48c7-b1ee-0e6bad48bf2c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:43.766513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cab9b8d6-4ecb-45a6-8f0a-8ea92c355b8b req-55ba05ec-f6ad-4ecf-a683-680c5da83b13 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089908 Sep 14 09:46:43.767145 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3225/4331] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:44.582141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:44.582994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:44.601605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:44.602116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:44.607227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:44.608401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:44.609040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:44.611041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:45.782997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:45.820787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:45.822356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:45.830583 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-08609c72-fa57-4736-900a-f969fe649b2b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 1.251663 Sep 14 09:46:45.831331 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1107/4332] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:44 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-plugged", "status": "completed", "tag": "9e37e8af-ab20-4671-a729-1e8eb2016b5c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 09:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:45.956761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:46.082152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] Creating event network-vif-plugged:9e37e8af-ab20-4671-a729-1e8eb2016b5c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:46.082152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fc0597ce-49bd-493e-9f4f-47ee938b0f73 req-0e76cac7-0df5-44a6-9cbb-3556eb38a7d5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156579 Sep 14 09:46:46.082152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3226/4333] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:46.860595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:46.866152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:46.889416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:46.890035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:46.898387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:46.918453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:46.924650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:46.925364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:46.945988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=58 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:47.311595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2054241482", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "d9e86120-6777-4562-afa5-c8a164e388b4"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:47.476985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] validate_networks() for [('d9e86120-6777-4562-afa5-c8a164e388b4', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:46:47.515937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:47.553088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:47.564329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:47.570068 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9a1fade3-26aa-42dc-bd95-b95b8525ff58 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1879 microversion: 2.42 time: 0.715083 Sep 14 09:46:47.571648 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1108/4334] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:46 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1879 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:48.605131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:48.606604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:48.620584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:48.621081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:48.621507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:48.622216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:48.622671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:48.623082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:48.876960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:46:48.878217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:46:48.878908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:46:48.879567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:46:48.880407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:46:48.912230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:48.913229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:48.913989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:48.915325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:48.916239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:48.916950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:49.026139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Getting quotas for project 713b87268fd74525be7905a57003105b. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:46:49.056147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Getting quotas for user d831a1b1f519408ba5b959e9a821ef2c and project 713b87268fd74525be7905a57003105b. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:46:49.092479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:46:49.095594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:46:49.190664 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa0f89d6-3672-4ee6-97e9-f89654ed1c39 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.898486 Sep 14 09:46:49.191344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3227/4335] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:46:49.211339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c71658ac-15fd-4ac9-bb58-bdd2f79847c8 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:49.214112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c71658ac-15fd-4ac9-bb58-bdd2f79847c8 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:49.390031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c71658ac-15fd-4ac9-bb58-bdd2f79847c8 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:49.402074 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c71658ac-15fd-4ac9-bb58-bdd2f79847c8 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1214 microversion: 2.1 time: 0.197194 Sep 14 09:46:49.402937 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3228/4336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:49 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:49.788392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:49.853071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:49.854545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:49.856328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-57d86671-70b5-4e87-acbc-07168001ca3b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2835 microversion: 2.42 time: 1.255386 Sep 14 09:46:49.857413 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1109/4337] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:46:48 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2835 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:49.890123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:49.891010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:49.905081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:49.905930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:49.908611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:49.909537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:49.914221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:49.917927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:50.224661 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e190f4dd-92b3-443a-9ca5-944c2cf0143d tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.339034 Sep 14 09:46:50.235079 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3229/4338] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:46:49 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66/os-interface => generated 1832 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:46:50.431158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-63c65234-b36e-4088-a04c-7f280ecfdaa6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:50.432022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-63c65234-b36e-4088-a04c-7f280ecfdaa6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:50.435377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=24 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:50.715329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-63c65234-b36e-4088-a04c-7f280ecfdaa6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:50.730407 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-63c65234-b36e-4088-a04c-7f280ecfdaa6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1214 microversion: 2.1 time: 0.307072 Sep 14 09:46:50.762566 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1110/4339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:50 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1214 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:51.760376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:51.761885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:51.779487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:51.780233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:51.781389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:51.785938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:51.786618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:51.787216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:52.105151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:52.123654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6fe2239-3709-407a-ba98-8d93f6a64272 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1272 microversion: 2.1 time: 0.373291 Sep 14 09:46:52.124585 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3230/4340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:51 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1272 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:53.158574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:53.159972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:53.168410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:53.169186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:53.169800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:53.170687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:53.171315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:53.171944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:53.302775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:53.329160 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-162b806b-5b4c-4c2b-8bbe-6b551b2eea9d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1272 microversion: 2.1 time: 0.180231 Sep 14 09:46:53.347548 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1111/4341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:53 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:54.357423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:54.358398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:54.368783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:54.386212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:54.400504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:54.401917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:54.417892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:54.422449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:54.705660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "tag": "c4a4c1e9-27d6-45c9-96ab-722055d6840e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:54.734059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:54.734648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:54.735161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:54.752284 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] Creating event network-changed:c4a4c1e9-27d6-45c9-96ab-722055d6840e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:46:54.804022 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d6467d25-fa5b-43f2-988e-3418e66bf0bb req-2459247e-83c3-4c2b-89fe-ea0c515cd347 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096303 Sep 14 09:46:54.808976 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1112/4342] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:46:54.941453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:54.951079 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da7f74a8-9434-4618-93fb-2c07dbbf0e9f tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 0.599066 Sep 14 09:46:54.951701 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3231/4343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:54 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:55.982643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:55.991655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:56.003837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:56.004740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:56.019092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:56.020307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:56.020969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:56.036932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:56.711059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:56.737936 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aad411ac-a26f-45c0-b3cb-4dd7ebfdc711 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 0.755890 Sep 14 09:46:56.742217 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1113/4344] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:55 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:46:56.890092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2270ddaa-78ca-4165-a087-ab809ba16a38", "tag": "0999b24c-fb77-4a56-8306-49df34b129e3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:46:56.920466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:56.922777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:56.940170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:56.997978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] Creating event network-changed:0999b24c-fb77-4a56-8306-49df34b129e3 for instance 2270ddaa-78ca-4165-a087-ab809ba16a38 on n-h1-851028-12 Sep 14 09:46:57.007800 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3f23aa2a-0258-4eec-9110-f64cf1d32c87 req-765c178a-7831-494c-bd57-962d62155ffb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122503 Sep 14 09:46:57.011074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3232/4345] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:46:57.766975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:57.768304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:57.783205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:57.784030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:57.786487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:57.806966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:57.808134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:57.808766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:58.319166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:46:58.330083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bafcd468-c284-4ec5-a629-d57d77384491 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 0.568583 Sep 14 09:46:58.354661 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1114/4346] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:57 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:46:59.356371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:46:59.361948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:46:59.362706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:46:59.387525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:59.388943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:59.390287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:59.393472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:46:59.396590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:46:59.397229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:46:59.397890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:00.897486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:00.920632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff72377a-eb44-4ae6-90a0-fa1c99cc0902 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 1.565145 Sep 14 09:47:00.940367 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3233/4347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:46:59 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:01.867260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2270ddaa-78ca-4165-a087-ab809ba16a38", "name": "network-vif-plugged", "status": "completed", "tag": "0999b24c-fb77-4a56-8306-49df34b129e3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:01.895419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:01.919485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:01.923689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:01.924634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:01.949342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:01.950637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:01.953900 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] Creating event network-vif-plugged:0999b24c-fb77-4a56-8306-49df34b129e3 for instance 2270ddaa-78ca-4165-a087-ab809ba16a38 on n-h1-851028-12 Sep 14 09:47:01.956759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:01.965399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:01.965951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:01.966720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:01.967078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-986f8b17-3e1d-47f8-b878-65276d46827e req-a74b3213-debe-4f52-b8be-f647f2682df1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108160 Sep 14 09:47:01.967255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:01.967739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:01.968365 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1115/4348] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:47:02.682715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:02.694160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-feb619a9-fc43-46d4-bc23-7274e5e3c58e tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 0.749054 Sep 14 09:47:02.703133 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3234/4349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:01 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:03.729940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:03.731457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:03.748990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:03.749915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:03.750600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:03.751547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:03.752283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:03.755430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:04.402393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:04.422771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-30e406fb-577d-4345-a421-8f01f1f4c446 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1314 microversion: 2.1 time: 0.695835 Sep 14 09:47:04.424515 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1116/4350] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:03 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:47:05.452529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:05.454137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:05.467620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:05.474855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:05.475661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:05.476612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:05.477426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:05.478044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:06.273771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:06.287936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e18be18a-ed46-4a0d-9ce4-239d9165fc63 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1497 microversion: 2.1 time: 0.839667 Sep 14 09:47:06.296087 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3235/4351] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:05 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1497 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:07.150823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:07.151508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:07.177822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.190586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.191041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:07.192398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.198298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.203638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:07.335885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:47:07.587439 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f293be8-7cf6-4df7-a644-a2cd64ef04b7 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "DELETE /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 204 len: 0 microversion: 2.1 time: 0.440443 Sep 14 09:47:07.595825 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1117/4352] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:47:07 2022] DELETE /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:47:07.600106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:07.600911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:07.617179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.624834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.627986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:07.632484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:07.634118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:07.635593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:08.157202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:08.175734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1be6ff3-b729-4ecd-9a08-8c34b2837ebf tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1503 microversion: 2.1 time: 0.576871 Sep 14 09:47:08.194426 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3236/4353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:07 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1503 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:09.202473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:09.203088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:09.215035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:09.215542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:09.216012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:09.217841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:09.217841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:09.217841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:09.682405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:09.697419 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d867323-42d8-44b9-ac69-531844da96f5 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1503 microversion: 2.1 time: 0.499868 Sep 14 09:47:09.698345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1118/4354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:09 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:10.729157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:10.730079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:10.752388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:10.757545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:10.760418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:10.763791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:10.766469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:10.767317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:10.768593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:10.819221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=56 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:11.314475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:11.345876 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c35030e1-08e8-464d-bf5f-805b9a1de61d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 200 len: 1503 microversion: 2.1 time: 0.604323 Sep 14 09:47:11.348339 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3237/4355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:10 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 1503 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:11.434603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2270ddaa-78ca-4165-a087-ab809ba16a38", "name": "network-vif-deleted", "tag": "0999b24c-fb77-4a56-8306-49df34b129e3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:11.451851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:11.452464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:11.453235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:11.481681 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] Creating event network-vif-deleted:0999b24c-fb77-4a56-8306-49df34b129e3 for instance 2270ddaa-78ca-4165-a087-ab809ba16a38 on n-h1-851028-12 Sep 14 09:47:11.494479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-157eb9d4-99c7-487d-bd1f-4fa47502c958 req-62f6592b-93f5-4b52-9a1e-1ffd532bfc09 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063916 Sep 14 09:47:11.497651 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1119/4356] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:47:12.378106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:12.378736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: 2270ddaa-78ca-4165-a087-ab809ba16a38] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:12.424587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:12.425616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:12.427541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:12.430447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:12.432644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:12.433720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:12.463194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] HTTP exception thrown: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Request method failure captured: Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 HTTP/1.1 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaMDgkvoKRypIQQf2ecKshB8PHRa3MMEIYo-JGR9IwECQ1I0UX5vqOfJ80zoXMI6p7mLdNJDw5pK5xaghaiyDh0MpbJiQJ-DIJ0GY8hKfzcfvngHbC5e6vP9dgf_0YeEoOuIpM62iKfJYXFE9oB3_LYu-EF48axjR0T8XGVlZlG5_eM Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 713b87268fd74525be7905a57003105b Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesActionsTest-293900657 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_713b87268fd74525be7905a57003105b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/713b87268fd74525be7905a57003105b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/713b87268fd74525be7905a57003105b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/713b87268fd74525be7905a57003105b"}]}] Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesActionsTest-293900657 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 713b87268fd74525be7905a57003105b Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesActionsTest-293900657 Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesActionsTest-293900657-project Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d831a1b1f519408ba5b959e9a821ef2c Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesActionsTest-293900657-project Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '2270ddaa-78ca-4165-a087-ab809ba16a38'} Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:12.477375 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. Sep 14 09:47:12.482732 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:12.484556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Returning 404 to user: Instance 2270ddaa-78ca-4165-a087-ab809ba16a38 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:47:12.485757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8a0e9ae-ea00-44b2-b4a4-1a178e7ffe83 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38" status: 404 len: 111 microversion: 2.1 time: 0.112893 Sep 14 09:47:12.486890 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3238/4357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:12 2022] GET /compute/v2.1/servers/2270ddaa-78ca-4165-a087-ab809ba16a38 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:47:12.595148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1347154604", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "d9e86120-6777-4562-afa5-c8a164e388b4"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:12.690092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] validate_networks() for [('d9e86120-6777-4562-afa5-c8a164e388b4', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:47:14.133467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:47:14.134809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:47:14.135523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:47:14.136215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:47:14.136845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:47:14.187137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:14.187813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:14.188610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:14.201011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:14.201677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:14.202260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:14.224639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Getting quotas for project 713b87268fd74525be7905a57003105b. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:47:14.233710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Getting quotas for user d831a1b1f519408ba5b959e9a821ef2c and project 713b87268fd74525be7905a57003105b. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:47:14.261949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:47:14.282891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:47:14.421790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fe84836-50dc-4f6a-91fe-b954aa6e2663 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.831152 Sep 14 09:47:14.424140 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1120/4358] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:47:14.436108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da2e0f0c-9bb9-4d5e-9007-e0ca2228ab3d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:14.437371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da2e0f0c-9bb9-4d5e-9007-e0ca2228ab3d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:14.647687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da2e0f0c-9bb9-4d5e-9007-e0ca2228ab3d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:14.671440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da2e0f0c-9bb9-4d5e-9007-e0ca2228ab3d tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1214 microversion: 2.1 time: 0.239381 Sep 14 09:47:14.672077 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3239/4359] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:14 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:15.701279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:15.702166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:15.709549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:15.710307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:15.711037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:15.712358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:15.713061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:15.713665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:15.909049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:15.932665 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d1a56264-8a1b-47d9-815c-a71a175e1be6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1210 microversion: 2.1 time: 0.237054 Sep 14 09:47:15.947952 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1121/4360] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:15 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1210 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:16.995762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:16.997113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:17.008046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:17.010780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:17.012852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:17.014858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:17.016715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:17.018827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:17.216543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:17.237013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67e1a89c-6fc8-41ce-88b3-83da25f7afe6 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1272 microversion: 2.1 time: 0.262091 Sep 14 09:47:17.237918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3240/4361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:16 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:18.263454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:18.264447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:18.290480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:18.290982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:18.291433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:18.292362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:18.292864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:18.293255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:18.307489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:18.575994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:18.591313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7fde84ef-2afb-4eb9-a82f-4779a5ea3391 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1272 microversion: 2.1 time: 0.332524 Sep 14 09:47:18.591944 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1122/4362] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:18 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:19.617887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:19.618546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:19.632861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:19.634624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:19.635099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:19.638213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:19.640158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:19.642602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:19.955624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:19.973563 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b68ce3bc-1c26-43df-bec7-3f2e50c0f364 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.361101 Sep 14 09:47:19.974568 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3241/4363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:19 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:20.263653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb3d0803-e81b-4784-af83-3cbda4e34e71", "tag": "dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:20.299451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:20.300813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:20.301583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:20.338684 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] Creating event network-changed:dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc for instance bb3d0803-e81b-4784-af83-3cbda4e34e71 on n-h1-851028-12 Sep 14 09:47:20.350262 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4cf79203-1c57-4d7b-9f6d-26bc591913d9 req-6ffd34d5-d8f1-4deb-8c61-2669db23c952 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089991 Sep 14 09:47:20.356597 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1123/4364] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:47:21.004481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:21.005145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:21.016130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.017148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.017848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.018805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:21.019437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:21.020639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:21.217722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:21.230222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86ad676f-03de-4acc-af99-b1dbfa8d9471 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.233789 Sep 14 09:47:21.230965 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3242/4365] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:20 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:22.258135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:22.259034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:22.263652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:22.276790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:22.277467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:22.277929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:22.278656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:22.284070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:22.284523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:22.603159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:22.617215 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-682f537f-04ba-4911-9203-bc9884afaada tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.363410 Sep 14 09:47:22.618429 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1124/4366] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:22 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:23.641463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:23.642176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:23.659792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.662480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.663207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:23.664638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:23.665362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:23.666354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:24.094228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:24.104707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf3184ab-fe99-4269-8acc-9f265d7c7d74 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.467795 Sep 14 09:47:24.120308 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3243/4367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:23 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:25.138315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:25.142160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:25.157888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:25.193474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:25.200992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:25.202519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:25.203323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:25.205361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:25.206908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:25.208805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:26.104745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:26.118016 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8818bc1a-75c1-453e-9368-d82c346d91c4 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.985801 Sep 14 09:47:26.118503 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1125/4368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:25 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:27.142905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:27.143779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:27.163709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:27.167529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.169367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.169830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.172431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:27.174890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:27.175865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:27.978947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3d0803-e81b-4784-af83-3cbda4e34e71", "name": "network-vif-plugged", "status": "completed", "tag": "dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:28.004184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:28.004959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:28.007066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:28.043357 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] Creating event network-vif-plugged:dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc for instance bb3d0803-e81b-4784-af83-3cbda4e34e71 on n-h1-851028-12 Sep 14 09:47:28.050551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d3942d95-613c-4179-9d6b-b47904242ab4 req-78c9972b-01c8-47c0-b2f4-ea97e2333154 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075153 Sep 14 09:47:28.051994 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1126/4369] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:47:28.273327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:28.290732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b1bb032-6069-45ad-94f8-12f87de8efa1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 1.153383 Sep 14 09:47:28.304263 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3244/4370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:27 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:29.316335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:29.329031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:29.365478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:29.365974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:29.366355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:29.367070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:29.367523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:29.368025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:29.836585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:29.869375 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-349bb063-3cae-492d-acff-70842ec7a688 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1314 microversion: 2.1 time: 0.557963 Sep 14 09:47:29.875702 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1127/4371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:29 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:30.900822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:30.901735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:30.928343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:30.933817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:30.934666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:30.935780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:30.940080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:30.940818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:31.341666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:31.354855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2f8fbc6-5950-43a4-b8fd-ef0ae32c88d9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1497 microversion: 2.1 time: 0.460055 Sep 14 09:47:31.359128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3245/4372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:30 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1497 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:32.448550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:32.450602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:32.474691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.501663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.502384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:32.505434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.507182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.508239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:32.686352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:47:32.948074 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83a3f586-c792-4105-90a2-0c74223abeda tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 204 len: 0 microversion: 2.1 time: 0.515820 Sep 14 09:47:32.948972 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1128/4373] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:47:32 2022] DELETE /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:47:32.957512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:32.958280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:32.970403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.970909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.971657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:32.972354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:32.972818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:32.973820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:33.321802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:33.336517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d9bad9a-a2fa-4583-a457-910eea4d94c9 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1503 microversion: 2.1 time: 0.383221 Sep 14 09:47:33.342462 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3246/4374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:32 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1503 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:34.369657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:34.370389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:34.404485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:34.405000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:34.409767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:34.411113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:34.411606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:34.412072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:35.230687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:35.243631 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6de98106-e434-4a5f-a0b1-5d90bd1bdac1 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1503 microversion: 2.1 time: 0.879389 Sep 14 09:47:35.252827 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1129/4375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:34 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:36.063293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb3d0803-e81b-4784-af83-3cbda4e34e71", "name": "network-vif-deleted", "tag": "dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:47:36.087656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.089457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.089907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.112515 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] Creating event network-vif-deleted:dc66219d-ab78-42a2-ac0c-b1ac0eb77fdc for instance bb3d0803-e81b-4784-af83-3cbda4e34e71 on n-h1-851028-12 Sep 14 09:47:36.126225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-01431aaf-4f2a-4b61-a405-d31fbfb46165 req-2d047bea-391a-403d-a1d9-0ebe28c65045 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066613 Sep 14 09:47:36.136236 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3247/4376] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:47:36.278551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:36.279806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:36.296862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.300756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.302645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.303583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.304239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.311323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.364192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:36.365086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:36.365674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:36.366289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lazy-loading 'fault' on Instance uuid bb3d0803-e81b-4784-af83-3cbda4e34e71 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:47:36.532916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd831a1b1f519408ba5b959e9a821ef2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '713b87268fd74525be7905a57003105b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:36.547209 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0ca43f3-3c0e-4f33-91af-bf5adef8e533 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 200 len: 1304 microversion: 2.1 time: 0.273286 Sep 14 09:47:36.554731 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1130/4377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:36 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:47:37.578781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:37.581203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] [instance: bb3d0803-e81b-4784-af83-3cbda4e34e71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:37.598633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:37.601765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:37.603465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:37.605445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:37.606187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:37.608169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:37.664958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] HTTP exception thrown: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Request method failure captured: Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 HTTP/1.1 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaMDgkvoKRypIQQf2ecKshB8PHRa3MMEIYo-JGR9IwECQ1I0UX5vqOfJ80zoXMI6p7mLdNJDw5pK5xaghaiyDh0MpbJiQJ-DIJ0GY8hKfzcfvngHbC5e6vP9dgf_0YeEoOuIpM62iKfJYXFE9oB3_LYu-EF48axjR0T8XGVlZlG5_eM Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 713b87268fd74525be7905a57003105b Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesActionsTest-293900657 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_713b87268fd74525be7905a57003105b", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/713b87268fd74525be7905a57003105b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/713b87268fd74525be7905a57003105b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/713b87268fd74525be7905a57003105b"}]}] Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesActionsTest-293900657 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 713b87268fd74525be7905a57003105b Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesActionsTest-293900657 Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesActionsTest-293900657-project Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d831a1b1f519408ba5b959e9a821ef2c Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesActionsTest-293900657-project Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'bb3d0803-e81b-4784-af83-3cbda4e34e71'} Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:47:37.670388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. Sep 14 09:47:37.675841 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:47:37.678263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] Returning 404 to user: Instance bb3d0803-e81b-4784-af83-3cbda4e34e71 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:47:37.681134 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0f76148c-f350-46ce-b366-89fac2aef2a3 tempest-VolumesActionsTest-293900657 tempest-VolumesActionsTest-293900657-project] 10.222.0.90 "GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71" status: 404 len: 111 microversion: 2.1 time: 0.106374 Sep 14 09:47:37.684188 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3248/4378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:47:37 2022] GET /compute/v2.1/servers/bb3d0803-e81b-4784-af83-3cbda4e34e71 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:47:44.281123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:44.285613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:44.316038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:44.320097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:44.321831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:44.329119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:44.331602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:44.334271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:45.549486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:45.575200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:45.577257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:47:45.578778 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b7a7a33-537d-4d75-8676-c69bbe5080cb tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2954 microversion: 2.42 time: 1.302751 Sep 14 09:47:45.580504 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1131/4379] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:47:44 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2954 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:47:45.615448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:47:45.616732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:47:45.626655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=26 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:45.630108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:45.636622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:45.637276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:45.638197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:47:45.638804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:47:45.639391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:47:45.681193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:47:46.096131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e91d6c7-7846-435d-89e3-13ba7e43ea94 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.488860 Sep 14 09:47:46.097752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3249/4380] 10.222.0.90 () {60 vars in 1316 bytes} [Wed Sep 14 09:47:45 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66/os-interface => generated 1832 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:49:15.335796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:15.338468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:15.346191 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:49:15.346673 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:49:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.90) !!! Sep 14 09:49:15.935692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-11a1aa11-a28f-4dc6-8ef5-953b258a1396 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-179404793", "availability_zone": "foo_zone"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:15.942047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.aggregate [None req-11a1aa11-a28f-4dc6-8ef5-953b258a1396 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Generated uuid 83e14819-3d4d-4c7c-89c2-6c4808441f5b for aggregate {{(pid=122443) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 14 09:49:16.025942 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-11a1aa11-a28f-4dc6-8ef5-953b258a1396 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.698868 Sep 14 09:49:16.028007 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1132/4381] 10.222.0.90 () {60 vars in 1164 bytes} [Wed Sep 14 09:49:15 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:16.038916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:16.041171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:49:16.043255 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 09:49:16.043388 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 09:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.90) !!! Sep 14 09:49:16.062409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7337d902-6845-489c-80d1-e7cdb5605de7 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:16.180464 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7337d902-6845-489c-80d1-e7cdb5605de7 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.133188 Sep 14 09:49:16.188806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3250/4382] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:49:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:49:16.194394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:16.200507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:16.206462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:16.209061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:16.212504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:16.213027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:16.213464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:16.328447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35202a36-bcbd-4d67-927b-451f0597d2eb tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.139335 Sep 14 09:49:16.345990 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1133/4383] 10.222.0.90 () {58 vars in 1176 bytes} [Wed Sep 14 09:49:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:16.347486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ac58d24-e889-4172-a83a-958d9c3a23ed tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:16.372216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ac58d24-e889-4172-a83a-958d9c3a23ed tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.024875 Sep 14 09:49:16.380817 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3251/4384] 10.222.0.90 () {58 vars in 1143 bytes} [Wed Sep 14 09:49:16 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:16.387233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2c91e83-63f2-4682-9315-31c7300c781c tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-851028-12"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:16.423290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2c91e83-63f2-4682-9315-31c7300c781c tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:16.424100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2c91e83-63f2-4682-9315-31c7300c781c tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:16.425920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2c91e83-63f2-4682-9315-31c7300c781c tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:17.256404 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2c91e83-63f2-4682-9315-31c7300c781c tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.874100 Sep 14 09:49:17.271432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a43d597-f141-4ffc-8775-8ad2ccfa6a24 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:17.277703 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1134/4385] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:49:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:49:17.282900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a43d597-f141-4ffc-8775-8ad2ccfa6a24 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.016018 Sep 14 09:49:17.291419 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3252/4386] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:49:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:17.299783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0da7608-22d9-4094-8d3c-16b44e81439f tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1450433424", "availability_zone": "foo_zone"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:17.445754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0da7608-22d9-4094-8d3c-16b44e81439f tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.153020 Sep 14 09:49:17.456054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1135/4387] 10.222.0.90 () {60 vars in 1173 bytes} [Wed Sep 14 09:49:17 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:17.461531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64a4f737-5060-4187-91e6-a95a573a0da8 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:17.558057 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64a4f737-5060-4187-91e6-a95a573a0da8 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.103670 Sep 14 09:49:17.569834 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3253/4388] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:49:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:17.577211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-845fb492-2c93-4a17-b1f7-e1404dd4fd17 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:17.605307 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-845fb492-2c93-4a17-b1f7-e1404dd4fd17 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.033870 Sep 14 09:49:17.607684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1136/4389] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Sep 14 09:49:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:49:17.625457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5bd094d6-87df-4cde-a8ed-e2eb75163536 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-851028-12"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:49:17.639927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bd094d6-87df-4cde-a8ed-e2eb75163536 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:49:17.640735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bd094d6-87df-4cde-a8ed-e2eb75163536 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:49:17.641347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bd094d6-87df-4cde-a8ed-e2eb75163536 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:49:17.964012 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5bd094d6-87df-4cde-a8ed-e2eb75163536 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.343315 Sep 14 09:49:17.965518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3254/4390] 10.222.0.90 () {60 vars in 1194 bytes} [Wed Sep 14 09:49:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:49:17.979935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-497d331d-9c3b-4d2a-b626-0c17b8fb4789 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:49:18.038792 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-497d331d-9c3b-4d2a-b626-0c17b8fb4789 tempest-TestAggregatesBasicOps-1819766669 tempest-TestAggregatesBasicOps-1819766669-project-admin] 10.222.0.90 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.065356 Sep 14 09:49:18.039695 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1137/4391] 10.222.0.90 () {58 vars in 1155 bytes} [Wed Sep 14 09:49:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 14 09:50:50.649159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:50.650379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:50.662466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-545725924", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "7f7dd7b1-77a8-4d56-a59c-7e28e30d641d"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:50.749631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] validate_networks() for [('7f7dd7b1-77a8-4d56-a59c-7e28e30d641d', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:50:51.524128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:50:51.524962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:50:51.525777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:50:51.526298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:50:51.527381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:50:51.540932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.541526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.542924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.544148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:51.544867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:51.545526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:51.576255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Getting quotas for project 0fb8ad9813af4abfadafa822a97b2bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:50:51.597547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Getting quotas for user 13a7e2ea0fd24d449b37ef1322237acb and project 0fb8ad9813af4abfadafa822a97b2bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:50:51.633369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:50:51.645423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:50:51.714671 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cff18e98-795c-4e2f-a2c0-a438f57811e5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069338 Sep 14 09:50:51.718225 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3255/4392] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:50:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:50:51.748339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:51.750504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:51.752620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:50:51.769509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a40554d-72d1-409d-9fe0-61fecf51ac60 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:51.770143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a40554d-72d1-409d-9fe0-61fecf51ac60 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:52.132179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a40554d-72d1-409d-9fe0-61fecf51ac60 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:52.163473 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a40554d-72d1-409d-9fe0-61fecf51ac60 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1218 microversion: 2.1 time: 0.415442 Sep 14 09:50:52.163473 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1138/4393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:51 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:53.187579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:53.188796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:53.217176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:53.218876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:53.219659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:53.220818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:53.222967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:53.229671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:53.324193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:53.344139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-83fe7e16-9929-4754-a3a9-4d3647f2f0a0 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1270 microversion: 2.1 time: 0.162077 Sep 14 09:50:53.345316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3256/4394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:53 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:54.372862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:54.374727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:54.388277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:54.389037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:54.390657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:54.391867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:54.392591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:54.393395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:54.494815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:54.518067 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-27b605fd-6c5f-485d-9747-2d07adfd544c tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1276 microversion: 2.1 time: 0.151157 Sep 14 09:50:54.521292 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1139/4395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:54 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:55.544777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:55.547014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:55.558590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:55.560140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:55.561717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:55.562808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:55.563625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:55.564492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:55.922729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:55.932422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f46831c-8e15-403f-990d-e5804399da70 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.392659 Sep 14 09:50:55.935374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3257/4396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:55 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:56.959820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:56.960613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:56.975930 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:50:56.976587 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 (ip 10.222.0.90) !!! Sep 14 09:50:56.981375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:56.982139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:56.992673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:56.993670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:56.994345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:56.995375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:57.019219 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:50:57.019676 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 09:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 09:50:57.245370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822f6ca9-5a6e-44d4-970b-c69e0d1a3879", "tag": "e65ea207-0fc6-4ea0-9010-21c3a8dba6dc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:50:57.261482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:57.261980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:57.262414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:57.269959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:57.285109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4fff9a61-4508-4593-8b3b-8ae07ff23e63 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.330041 Sep 14 09:50:57.291621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] Creating event network-changed:e65ea207-0fc6-4ea0-9010-21c3a8dba6dc for instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 on n-h1-851028-12 Sep 14 09:50:57.298903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9e16ccd3-cd67-4b65-9674-f5ecea60aa5f req-a2e181c9-cee1-432d-9a2b-7d5dd228be3c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287765 Sep 14 09:50:57.299793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3258/4397] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:50:57.306829 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1140/4398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:56 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:58.314513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:58.315231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:58.322340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:58.322834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:58.323476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:58.324405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:58.325034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:58.325646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:58.490631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:50:58.501612 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04426fdd-c535-47c5-a201-f6a7ec206e19 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.192202 Sep 14 09:50:58.517651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3259/4399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:58 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:50:59.533623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:50:59.534827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:50:59.548512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:59.550395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:59.551248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:50:59.553095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:50:59.554900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:50:59.556031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:00.186118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:00.196517 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9530255-7d95-416b-b54a-59046c9dc411 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.666958 Sep 14 09:51:00.212812 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1141/4400] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:50:59 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:01.230143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:01.230816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:01.241914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:01.242763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:01.243393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:01.244597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:01.245452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:01.246250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:01.561913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:01.587950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:01.596990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25c7867f-07ea-4a8b-a75c-cc14d892c76f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.378637 Sep 14 09:51:01.613636 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3260/4401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:01 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:02.628299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:02.629553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:02.641911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:02.643776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:02.644499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:02.646067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:02.648422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:02.656124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:02.656124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:02.746347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:02.918162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822f6ca9-5a6e-44d4-970b-c69e0d1a3879", "name": "network-vif-plugged", "status": "completed", "tag": "e65ea207-0fc6-4ea0-9010-21c3a8dba6dc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:02.940698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:02.941036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:02.941476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:02.967628 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] Creating event network-vif-plugged:e65ea207-0fc6-4ea0-9010-21c3a8dba6dc for instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 on n-h1-851028-12 Sep 14 09:51:02.985220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-813a2fcd-4e3b-4f1e-82bd-04036012330e req-6fc1b810-e256-4568-82bf-ed298d01337b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242873 Sep 14 09:51:02.986132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3261/4402] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:03.077910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:03.095818 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5a2abb1-a077-44e2-b4fc-4e295d0d0bcb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.473684 Sep 14 09:51:03.108273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1142/4403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:02 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:04.117383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:04.118106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:04.131211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:04.136530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:04.137181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:04.138099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:04.138726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:04.139318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:04.490757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:04.507059 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-957da426-17c7-477e-b71c-24fe9068d5c4 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1318 microversion: 2.1 time: 0.395116 Sep 14 09:51:04.514265 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3262/4404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:04 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:05.544172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:05.545012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:05.561953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:05.563552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:05.566377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:05.570196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:05.571323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:05.572625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:05.992814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:06.024374 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-028714af-ad9b-43fa-ae52-2338dcbfe9b7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1508 microversion: 2.1 time: 0.486753 Sep 14 09:51:06.026732 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1143/4405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:05 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:36.832257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5df9caef-da0d-4cf3-b27a-c018b8333978", "device": "/dev/sdb"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:36.835446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:36.838379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:36.839159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=36 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:36.846518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:36.847276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:36.847824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:36.848763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:36.849370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:36.850060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:37.179392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97eb2b3f-25af-4c99-9d1e-9b83d334b7d7 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "POST /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351349 Sep 14 09:51:37.185948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3263/4406] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:51:36 2022] POST /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:39.107120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=14 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:39.109561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=30 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:39.408465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-863519389", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "4a900bee-89dd-4ccd-80c7-749080eb5aa1"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:39.492113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] validate_networks() for [('4a900bee-89dd-4ccd-80c7-749080eb5aa1', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:51:40.066164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:51:40.067005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:51:40.068495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:51:40.069149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:51:40.069820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:51:40.082062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:40.082978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:40.083668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:40.084716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:40.085457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:40.086174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:40.123832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Getting quotas for project 6d1b4b05a78744308e6d8666a2d4de75. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:51:40.133578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Getting quotas for user 00555a7c2647404da1195cf0031dab8b and project 6d1b4b05a78744308e6d8666a2d4de75. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:51:40.151063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:51:40.153915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:51:40.221435 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a4e38b2-f927-4db6-91e9-72d7edaf7e27 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119640 Sep 14 09:51:40.224481 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1144/4407] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:51:40.234869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcbb6e10-561c-47f9-aebe-2d0be4769d52 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:40.236256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcbb6e10-561c-47f9-aebe-2d0be4769d52 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:40.324731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bcbb6e10-561c-47f9-aebe-2d0be4769d52 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:40.342056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcbb6e10-561c-47f9-aebe-2d0be4769d52 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1214 microversion: 2.1 time: 0.111608 Sep 14 09:51:40.345675 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3264/4408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:40 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:41.370784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:41.374022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:41.401910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:41.403882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:41.404368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:41.405133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:41.405599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:41.406036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:41.513756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:41.522961 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-885ada3c-301a-41cf-9d08-0772b79a075c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1266 microversion: 2.1 time: 0.156169 Sep 14 09:51:41.524065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1145/4409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:41 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:42.547179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:42.548545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:42.560224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:42.560724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:42.561159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:42.561866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:42.565506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:42.571950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:42.932958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:42.942058 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-364acce7-3eff-4edf-a3dd-0cc738e264c1 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.399155 Sep 14 09:51:42.942713 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3265/4410] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:42 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:43.967962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:43.968606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:43.980837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:43.982390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:43.983763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:43.986588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:43.987242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:43.992013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:44.336904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc2c59e-326e-48ab-9944-7a9108fb6d8b", "tag": "b0c8abe9-eaf9-4e22-909f-16c474747b17"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:44.353033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:44.353612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:44.354996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:44.369834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] Creating event network-changed:b0c8abe9-eaf9-4e22-909f-16c474747b17 for instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b on n-h2-851028-12 Sep 14 09:51:44.377068 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-def3f69b-8fa7-4eb1-8d18-73c5f88d5e54 req-aaa16300-29ac-4919-90ef-52b3c689bff4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378178 Sep 14 09:51:44.378756 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3266/4411] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:44.402123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:44.414595 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02cf9502-2dbe-49b7-bcc9-8c6ace36733c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.452387 Sep 14 09:51:44.415646 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1146/4412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:43 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:45.439077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:45.439883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:45.447816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:45.448425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:45.448955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:45.449740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:45.450277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:45.450777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:45.635129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:45.654825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29fb9b7f-40a7-4898-8695-b9dab2a89681 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.219867 Sep 14 09:51:45.656517 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3267/4413] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:45 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:46.679564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:46.680874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:46.688209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:46.689084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:46.689751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:46.690653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:46.691295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:46.691975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:46.872642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:46.881920 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a3e29822-9f47-4159-8744-72ffaaa60f8f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.207011 Sep 14 09:51:46.883113 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1147/4414] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:46 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:47.910974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:47.912202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:47.929565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:47.933959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:47.934542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:47.935475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:47.935974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:47.936401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:48.671461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc2c59e-326e-48ab-9944-7a9108fb6d8b", "name": "network-vif-plugged", "status": "completed", "tag": "b0c8abe9-eaf9-4e22-909f-16c474747b17"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:48.689996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:48.690474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:48.690902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:48.732657 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] Creating event network-vif-plugged:b0c8abe9-eaf9-4e22-909f-16c474747b17 for instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b on n-h2-851028-12 Sep 14 09:51:48.744979 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ab169331-cea8-4e30-812e-54b67689c0d7 req-14eb8191-7e87-49f4-b6a1-c6f662a842ee service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077083 Sep 14 09:51:48.746171 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1148/4415] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:51:48.819029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:48.831840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f605338c-3aa3-40fe-b5c0-57f9f36c2474 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.924873 Sep 14 09:51:48.833950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3268/4416] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:47 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:49.873824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:49.875532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:49.914027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:49.914722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:49.915429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:49.918345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:49.920390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:49.921088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:50.100723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:50.143536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:50.188907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:50.203676 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a79220d8-d430-426c-beb3-3a32e01c1dbf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1314 microversion: 2.1 time: 0.340068 Sep 14 09:51:50.225165 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1149/4417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:49 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:51.255786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:51.256479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:51.266620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:51.268943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:51.269623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:51.270650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:51.271516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:51.272213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:51.272817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:51.493048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-74b14913-6063-46ab-9b37-6ec0a01b3d35 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: .version_select at 0x7f693f229040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1384146532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0xlyewCk2AkTxbV7YKsRjWXq1vqNRnM3Ny5cIK+Aa/Jfg662WL7ZcVQgowoHj1qqeHMypmLQ1JqZLpVkcoaoxQbz86T2RW1n1f28V/Vb69TNMXhdMoRUEVsc+TGS4xcg=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:51.539153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-74b14913-6063-46ab-9b37-6ec0a01b3d35 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:51:51.555019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-74b14913-6063-46ab-9b37-6ec0a01b3d35 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:51:51.601646 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-74b14913-6063-46ab-9b37-6ec0a01b3d35 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.110702 Sep 14 09:51:51.608247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:51.622255 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-907cfc9d-170d-457f-9451-e32d27dbcdb0 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1500 microversion: 2.1 time: 0.375461 Sep 14 09:51:51.622515 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1150/4418] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:51:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:51:51.623393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3269/4419] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:51 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1500 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:51.649017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:51.649927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:51.657812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:51.658761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:51.659760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:51.660897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:51.663313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:51.664501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:52.153117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:52.172365 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f18c1ad2-bedd-4f56-8733-989351ba8058 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1500 microversion: 2.1 time: 0.528581 Sep 14 09:51:52.173680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1151/4420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:51 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1500 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:52.197830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:52.198727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:52.206478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:52.207278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:52.208630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:52.209817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:52.210493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:52.211800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:52.265432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lazy-loading 'flavor' on Instance uuid 5bc2c59e-326e-48ab-9944-7a9108fb6d8b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:51:52.434691 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73ba4353-418c-4c68-9a0e-8a6cc9b1b7bd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.240776 Sep 14 09:51:52.439225 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3270/4421] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:52 2022] POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:51:52.448836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:52.449720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:52.460162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:52.462049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:52.462705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:52.465491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:52.466265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:52.466879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:52.688965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:52.698419 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-43d3402a-2b3a-4b8f-8e76-37cbde0ea81c tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1508 microversion: 2.1 time: 0.256892 Sep 14 09:51:52.699335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1152/4422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:52 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:53.727251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:53.728241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:53.742747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:53.744419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:53.745526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:53.747090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:53.747573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:53.748645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:53.785288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2044872742", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "79a0506f-6af1-4103-aa64-ad2d83506c91"}], "key_name": "tempest-TestNetworkBasicOps-1384146532", "security_groups": [{"name": "tempest-secgroup-smoke-907467850"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:53.997030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:54.008686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80d2ba51-edfa-4d55-95eb-a20c1c9d27cf tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1491 microversion: 2.1 time: 0.288650 Sep 14 09:51:54.010674 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3271/4423] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:53 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1491 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:54.037206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:54.050634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:54.060497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:54.061265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:54.061874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:54.062791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:54.063288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] validate_networks() for [('79a0506f-6af1-4103-aa64-ad2d83506c91', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:51:54.063612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:54.064244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:54.228232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25aa7df8-0e80-4659-9e13-76294968a6fd tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.197658 Sep 14 09:51:54.232877 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3272/4424] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:54 2022] POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:51:54.246668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:54.247572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:54.257791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:54.258452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:54.259788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:54.261340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:54.262563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:54.264379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:54.640211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:54.655383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f823154-dfee-4f13-8c8a-521da475fccb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1497 microversion: 2.1 time: 0.415390 Sep 14 09:51:54.656633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3273/4425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:54 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1497 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:55.212516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:51:55.213125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:51:55.214171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:51:55.214171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:51:55.214677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:51:55.237791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:55.238448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:55.239917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:55.241996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:55.242607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:55.243420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:55.276638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:51:55.283777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:51:55.301046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:51:55.308200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:51:55.403237 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28da955a-ff59-41f2-8048-9fc69fa61b88 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.621986 Sep 14 09:51:55.414810 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1153/4426] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:51:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 09:51:55.424429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d344679-4da4-4d92-88e0-9492676643be tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:55.434417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d344679-4da4-4d92-88e0-9492676643be tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:55.539634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d344679-4da4-4d92-88e0-9492676643be tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:55.549717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d344679-4da4-4d92-88e0-9492676643be tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1249 microversion: 2.1 time: 0.127583 Sep 14 09:51:55.549717 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3274/4427] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:55 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:55.713829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:55.713829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:55.713829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:55.713829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:55.713829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:55.717892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:55.717892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:55.717892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:55.885510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:55.900269 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a9a1718-9ded-44d4-8251-e072ba96e9ac tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1497 microversion: 2.1 time: 0.219182 Sep 14 09:51:55.900867 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1154/4428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:55 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:56.576495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:56.577237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:56.586118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:56.586772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:56.587323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:56.588284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:56.588820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:56.589420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:56.658215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:56.672688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9de4e669-b849-4d3f-88a2-ba3b8b6bb88d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1301 microversion: 2.1 time: 0.099700 Sep 14 09:51:56.673312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3275/4429] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:56 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:56.926048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:56.926871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:56.939347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:56.940584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:56.942946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:56.946465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:56.947357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:56.949593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.138317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:57.146752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6d0f39ce-19c9-4ff5-8591-ed559042ffa3 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1500 microversion: 2.1 time: 0.226781 Sep 14 09:51:57.153203 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1155/4430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:56 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1500 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:57.170147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:57.170698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:57.177369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.177901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.178509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.179370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.180034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.181161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.220759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lazy-loading 'flavor' on Instance uuid 5bc2c59e-326e-48ab-9944-7a9108fb6d8b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:51:57.289158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:51:57.328575 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04f0c5df-36af-4c65-907c-73c371913c5a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.161295 Sep 14 09:51:57.334603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3276/4431] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:57 2022] POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:51:57.344073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:57.345452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:57.353594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.355192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.356214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.357198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.358063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.358639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.543428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:57.553962 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0668d7da-16ef-431c-97bd-46bdd89a34c9 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1508 microversion: 2.1 time: 0.215087 Sep 14 09:51:57.555196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1156/4432] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:57 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:57.700177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:57.701980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:57.711020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.711784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.712401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:57.713328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:57.714873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:57.715461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:58.079469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:58.095098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16ed4318-899e-4d85-b85f-d4e94ee6e2b4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.399006 Sep 14 09:51:58.098320 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3277/4433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:57 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:58.581244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:58.588969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:58.640787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:58.641292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:58.641726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:58.642448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:58.642903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:58.643330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:58.889230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7f3c21-e939-48f2-bd21-6a22443e7f20", "tag": "df214092-fade-49c6-af60-7615ab2ebfc4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:58.913402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:58.926541 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c0f604a-a087-4123-92fd-8d3b9ce58d8e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1491 microversion: 2.1 time: 0.350638 Sep 14 09:51:58.928086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:58.943394 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1157/4434] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:58 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1491 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:51:58.944565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:58.946043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:58.961731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:51:58.962534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:58.981577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:58.983249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] Creating event network-changed:df214092-fade-49c6-af60-7615ab2ebfc4 for instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 on n-h1-851028-12 Sep 14 09:51:58.989016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:58.990120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:58.990890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:58.991363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:58.992496 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c28bb7bd-4d19-4d46-b65b-d856686f7b85 req-a6d9d4e8-b649-415b-8ed7-56eeb92a1ed1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104658 Sep 14 09:51:58.996295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:59.003271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3278/4435] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:51:59.124138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1df5063c-61cf-4790-bb7c-23a6610e211a tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action" status: 202 len: 0 microversion: 2.1 time: 0.166689 Sep 14 09:51:59.127739 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1158/4436] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:51:58 2022] POST /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:51:59.135729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:59.136653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:59.145949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:59.146644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:59.147373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:59.148273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:59.148874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:59.149447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:59.169156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:51:59.169948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:51:59.181938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:59.182447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:59.182997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:59.183724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:51:59.184251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:51:59.184683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:51:59.471566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:59.483686 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f74bc69d-bde3-4294-914d-6550012edfdb tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1497 microversion: 2.1 time: 0.354090 Sep 14 09:51:59.485555 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1159/4437] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:59 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1497 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:51:59.494130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:51:59.523185 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-239f4c97-3d07-47a0-a2a9-00d12fbe5cd7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.404696 Sep 14 09:51:59.523826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3279/4438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:51:59 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:00.513381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:00.514057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:00.527544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.528178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.528689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.529557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.530091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.530596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.559323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:00.561012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:00.588776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.597172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.598279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.600303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.601205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.601854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.696104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:00.704988 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de405cd3-7198-4669-916f-0681388c7f4f tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1500 microversion: 2.1 time: 0.195559 Sep 14 09:52:00.705649 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1160/4439] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:00 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1500 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:00.730003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:00.730524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:00.738713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.739251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.739720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.740955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.741432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.741874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.773348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:52:00.806582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:00.875789 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6efb3c4e-c83d-480b-a2f6-58f1e54ffd3d tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "DELETE /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 204 len: 0 microversion: 2.1 time: 0.149756 Sep 14 09:52:00.877207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1161/4440] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:52:00 2022] DELETE /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:52:00.887873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:00.888615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:00.895070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.896172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.896651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:00.897477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:00.897934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:00.898366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:01.070877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:01.081155 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-159bbee7-7773-4ea1-8d4c-20fb4aa578d8 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1506 microversion: 2.1 time: 0.197736 Sep 14 09:52:01.081764 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1162/4441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:00 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:01.100437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:01.109629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-628a54a2-a721-4e7b-806c-00d3227f9229 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.565792 Sep 14 09:52:01.111338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3280/4442] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:00 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:02.108056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:02.108633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:02.116891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:02.117382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:02.117819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:02.118550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:02.119005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:02.119432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:02.139506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:02.140237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:02.152695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:02.153186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:02.153623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:02.154328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:02.154777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:02.155382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:02.291120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:02.300278 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a1547173-218f-424a-a30a-7ccf47cc1d94 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1506 microversion: 2.1 time: 0.196287 Sep 14 09:52:02.311925 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1163/4443] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:02 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:02.337399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:02.346426 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0104a795-a967-421f-9d7e-e5ffbd1f665d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.216426 Sep 14 09:52:02.352576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3281/4444] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:02 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:03.326535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:03.327159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:03.335669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.336388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.337009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.337893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.338497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.339064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.371605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:03.372260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:03.385467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.385983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.386422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.387131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.387606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.393749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.498169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00555a7c2647404da1195cf0031dab8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d1b4b05a78744308e6d8666a2d4de75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:03.506773 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4089e1a-25fe-4509-bc62-b2efd3dae25e tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 200 len: 1464 microversion: 2.1 time: 0.184323 Sep 14 09:52:03.508696 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1164/4445] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:03 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:03.581677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc2c59e-326e-48ab-9944-7a9108fb6d8b", "name": "network-vif-deleted", "tag": "b0c8abe9-eaf9-4e22-909f-16c474747b17"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:03.593246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:03.596080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:03.596545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:03.623443 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] Creating event network-vif-deleted:b0c8abe9-eaf9-4e22-909f-16c474747b17 for instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b on n-h2-851028-12 Sep 14 09:52:03.632372 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0b72f2ff-4b4c-4328-b450-5f8e2955e00f req-7cee2e43-090d-4833-a841-4f499a27f19b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054345 Sep 14 09:52:03.632544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:03.633343 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1165/4446] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:03.641554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9a43d21-1e5c-4732-b1cb-e00940db2987 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.273812 Sep 14 09:52:03.659990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3282/4447] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:03 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:04.536994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:04.543355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] [instance: 5bc2c59e-326e-48ab-9944-7a9108fb6d8b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:04.548761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.553541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.554112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.556251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.557098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.558706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.589427 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] HTTP exception thrown: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Request method failure captured: Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b HTTP/1.1 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaQpO8PO5SPoCzdSYayjH6AKmoF_ex7u7M38lfNnRuQJKFPG1bdArrnG3m6WIexYTuc7KLJvft8C9OjDN7WwuMYRTnep8No3KHFyA2BypC8bmCBCTq0MiFN9raB9CmGUsyMi6RMh2PoXLgsZ2fzDmG85dSTbocxc31yHNuLokyw82ZI Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6d1b4b05a78744308e6d8666a2d4de75 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestServerAdvancedOps-1762744586 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6d1b4b05a78744308e6d8666a2d4de75", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d1b4b05a78744308e6d8666a2d4de75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6d1b4b05a78744308e6d8666a2d4de75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6d1b4b05a78744308e6d8666a2d4de75"}]}] Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestServerAdvancedOps-1762744586 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6d1b4b05a78744308e6d8666a2d4de75 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestServerAdvancedOps-1762744586 Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestServerAdvancedOps-1762744586-project Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 00555a7c2647404da1195cf0031dab8b Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestServerAdvancedOps-1762744586-project Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '5bc2c59e-326e-48ab-9944-7a9108fb6d8b'} Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:04.591255 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] Returning 404 to user: Instance 5bc2c59e-326e-48ab-9944-7a9108fb6d8b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:04.594869 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2216880c-96c1-419f-af51-f58bdea38241 tempest-TestServerAdvancedOps-1762744586 tempest-TestServerAdvancedOps-1762744586-project] 10.222.0.90 "GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b" status: 404 len: 111 microversion: 2.1 time: 0.065130 Sep 14 09:52:04.595297 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1166/4448] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:04 2022] GET /compute/v2.1/servers/5bc2c59e-326e-48ab-9944-7a9108fb6d8b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:52:04.666504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:04.667308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:04.677770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.678278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.678725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.679446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.679921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.691454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7f3c21-e939-48f2-bd21-6a22443e7f20", "name": "network-vif-plugged", "status": "completed", "tag": "df214092-fade-49c6-af60-7615ab2ebfc4"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:04.697382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.711419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:04.711852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:04.715402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:04.740019 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] Creating event network-vif-plugged:df214092-fade-49c6-af60-7615ab2ebfc4 for instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 on n-h1-851028-12 Sep 14 09:52:04.753486 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-49ed244d-d163-4ea9-9301-c5c7acce8eae req-224d4454-80e3-45e9-84f1-e244ac87a2c0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065373 Sep 14 09:52:04.756568 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1167/4449] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:05.132447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:05.144075 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fece2e15-2a0a-4e1d-9cb9-db105b1d9f2d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.482590 Sep 14 09:52:05.147561 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3283/4450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:04 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:06.174822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:06.176516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=10 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:06.191981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:06.194214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:06.213708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.214462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.215158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.217488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.218166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.218798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.482446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:06.491741 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5de21296-28c5-4d44-b03b-8844bd4b4e6a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1374 microversion: 2.1 time: 0.317432 Sep 14 09:52:06.492706 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1168/4451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:06 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1374 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:06.635424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:06.635947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:06.638090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:06.648663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.649158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.649603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.650308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:06.650770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:06.651187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:06.738543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lazy-loading 'services' on Instance uuid 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:52:06.816861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ad944ac-ce59-40dd-87d3-2dcd3570af80 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "DELETE /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879/os-volume_attachments/5df9caef-da0d-4cf3-b27a-c018b8333978" status: 202 len: 0 microversion: 2.1 time: 0.186521 Sep 14 09:52:06.818289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3284/4452] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:52:06 2022] DELETE /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879/os-volume_attachments/5df9caef-da0d-4cf3-b27a-c018b8333978 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:52:07.515548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:07.517838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:07.526735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.528170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.529121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.530157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.530757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.531470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.730601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:07.741655 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c1a1735-d606-45e5-a348-62ec08bb6e0d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1545 microversion: 2.1 time: 0.230741 Sep 14 09:52:07.752598 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1169/4453] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:07 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1545 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:07.767138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:07.768585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:07.774050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=49 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:07.781134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.781627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.782376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.783788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:07.784278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:07.784711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:07.950784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:07.960549 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8cf05241-1722-4b4c-ac07-1d45d3829052 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1545 microversion: 2.1 time: 0.197615 Sep 14 09:52:07.972714 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3285/4454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:07 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1545 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:10.692277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7f3c21-e939-48f2-bd21-6a22443e7f20", "tag": "df214092-fade-49c6-af60-7615ab2ebfc4"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:10.724538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:10.731987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:10.732741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:10.735503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:10.780994 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] Creating event network-changed:df214092-fade-49c6-af60-7615ab2ebfc4 for instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 on n-h1-851028-12 Sep 14 09:52:10.799304 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ced52f97-2a7f-4ff0-b0cb-c1b7cdf3b6e1 req-89594a6f-d404-48c9-a1c1-fba662fe0cb9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112258 Sep 14 09:52:10.799821 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1170/4455] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:15.039877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:15.041059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:15.050141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:15.050823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:15.051504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:15.052750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:15.053592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:15.054276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:15.102189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:52:15.263438 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5800546c-1a1f-499d-800a-39b287276d59 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "DELETE /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 204 len: 0 microversion: 2.1 time: 0.227040 Sep 14 09:52:15.269119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3286/4456] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:52:15 2022] DELETE /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:52:15.276581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:15.277854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:15.293294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:15.293753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:15.295336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:15.296811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:15.298602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:15.299255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:15.650484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:15.659506 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f43160b-a51f-45b3-80f1-c3a1e1ca0d76 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1514 microversion: 2.1 time: 0.390376 Sep 14 09:52:15.660220 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1171/4457] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:15 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:16.686841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:16.687697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:16.704702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:16.705402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:16.706521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:16.707635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:16.709574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:16.710364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:16.905385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:16.914572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02c8448b-bd39-4042-81ff-0b13f686ff0e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1514 microversion: 2.1 time: 0.231894 Sep 14 09:52:16.915595 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3287/4458] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:16 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:17.942644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:17.943618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:17.956699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:17.966744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:17.967212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:17.968011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:17.968482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:17.969460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:18.074044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822f6ca9-5a6e-44d4-970b-c69e0d1a3879", "name": "network-vif-deleted", "tag": "e65ea207-0fc6-4ea0-9010-21c3a8dba6dc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:18.091501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:18.092186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:18.093390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:18.110554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] Creating event network-vif-deleted:e65ea207-0fc6-4ea0-9010-21c3a8dba6dc for instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 on n-h1-851028-12 Sep 14 09:52:18.118808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ce66f94d-d7ba-4c78-9a70-804758f85cf2 req-57ec887f-8b0f-469b-885c-34c17e3d1f87 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048499 Sep 14 09:52:18.120315 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3288/4459] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:18.270257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:18.291485 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3330a437-5642-40fb-aa40-94787ca8b218 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 200 len: 1472 microversion: 2.1 time: 0.355836 Sep 14 09:52:18.294528 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1172/4460] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:17 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:19.319760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:19.321128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 822f6ca9-5a6e-44d4-970b-c69e0d1a3879] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:19.338550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:19.339285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:19.340212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:19.347574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:19.348409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:19.349463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:19.392754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] HTTP exception thrown: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Request method failure captured: Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 HTTP/1.1 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaOfwqFGRy1_ZgsmytTGBS9T4WjiZce-lMciToJNI57oJOfPCGzRuO-v3erAAdaKuBthLBVWh-hPpTCnDda7Kd4rORsu5UQWFxGCSyNBPvMsLV5zJq3_WEFU8ubNRazfJZK4WdZDtYisH4z4An2JWKcv_QDb7Oo2JAlOtfp1UlMYo50 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 0fb8ad9813af4abfadafa822a97b2bd0 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0fb8ad9813af4abfadafa822a97b2bd0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0fb8ad9813af4abfadafa822a97b2bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0fb8ad9813af4abfadafa822a97b2bd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0fb8ad9813af4abfadafa822a97b2bd0"}]}] Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 0fb8ad9813af4abfadafa822a97b2bd0 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesSnapshotTestJSON-425648839-project Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 13a7e2ea0fd24d449b37ef1322237acb Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesSnapshotTestJSON-425648839-project Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '822f6ca9-5a6e-44d4-970b-c69e0d1a3879'} Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:19.398663 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. Sep 14 09:52:19.402306 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:52:19.408248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Returning 404 to user: Instance 822f6ca9-5a6e-44d4-970b-c69e0d1a3879 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:19.409461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7e5b96a-1da8-4a9f-91c2-af125ad1a90f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879" status: 404 len: 111 microversion: 2.1 time: 0.096454 Sep 14 09:52:19.414228 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3289/4461] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:19 2022] GET /compute/v2.1/servers/822f6ca9-5a6e-44d4-970b-c69e0d1a3879 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:52:23.952509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203094647", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "00203452-14be-44eb-bf63-14308cc3af63"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:24.062968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] validate_networks() for [('00203452-14be-44eb-bf63-14308cc3af63', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:24.920511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:24.921135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:24.921769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:24.922336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:24.922904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:24.940952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:24.941712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:24.942299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:24.944157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:24.957274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:24.959720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:25.023275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Getting quotas for project 04a993ebf6b944f0a8ba26061750c9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:25.029877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Getting quotas for user e083f361917749abbb0dbe7d33319cad and project 04a993ebf6b944f0a8ba26061750c9fa. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:25.069608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:25.074448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:25.154951 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18b24e45-d045-4d7d-bf20-f5ac6806f6a5 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440889 Sep 14 09:52:25.163060 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1173/4462] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:52:25.185526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8371753-a047-46e3-b77e-302b9ceb021c tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:25.186150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8371753-a047-46e3-b77e-302b9ceb021c tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:25.332482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8371753-a047-46e3-b77e-302b9ceb021c tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:25.352147 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8371753-a047-46e3-b77e-302b9ceb021c tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1213 microversion: 2.1 time: 0.173546 Sep 14 09:52:25.353638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3290/4463] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:25 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:25.638609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-363aaff1-bbf5-48fc-a7ab-c7611b6d1ec9 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Action: 'create', calling method: .version_select at 0x7f693f266dc0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1710140563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoc1HMoNQ2ov+9++aJtAYa3MlfrPnpsTi2j06i9rS13M28d72azjf3rcbaOMSasjWVWgtZKWj4as3fIK6JWVGWjlbkmT7pCUZzvb1GWbg5TsTT0kNCMNjdh2jdHec28LA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:25.670459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-363aaff1-bbf5-48fc-a7ab-c7611b6d1ec9 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:25.676568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-363aaff1-bbf5-48fc-a7ab-c7611b6d1ec9 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for user 9f6bc83ba7b14834a664b995297d2985 and project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:25.704009 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-363aaff1-bbf5-48fc-a7ab-c7611b6d1ec9 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.228107 Sep 14 09:52:25.705437 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1174/4464] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:52:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:26.375138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:26.375766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:26.386270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:26.386873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:26.387391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:26.389151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:26.389701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:26.390216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:26.472984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:26.484394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c92eb5b6-01a7-4637-9385-c9d09f47a344 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1265 microversion: 2.1 time: 0.113232 Sep 14 09:52:26.486129 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3291/4465] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:26 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:27.097924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-311344735", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1710140563", "security_groups": [{"name": "tempest-secgroup-smoke-502288196"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "0d37c9a9-3b3f-4763-97df-0b29067ceb9d"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:27.375514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] validate_networks() for [('0d37c9a9-3b3f-4763-97df-0b29067ceb9d', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:27.515283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:27.516100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:27.527387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:27.528082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:27.532217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:27.533506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:27.534195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:27.534857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:27.540791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:27.668271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:27.688579 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77709745-3315-4c4f-a205-64a4c0f6efb7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1271 microversion: 2.1 time: 0.174916 Sep 14 09:52:27.693864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3292/4466] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:27 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:28.581048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:28.587739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for user 9f6bc83ba7b14834a664b995297d2985 and project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: dict_keys(['metadata_items']) {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:28.601908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:28.602400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:28.603033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:28.603720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:28.604688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:28.615502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.616019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.617035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.618520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.619032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.619550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.642503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:28.648894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Getting quotas for user 9f6bc83ba7b14834a664b995297d2985 and project cb48c4fcc42043f29ce2a999ea2a7a91. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:28.663646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:28.665288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:28.722694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:28.723995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:28.736105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.737088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.738350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.740530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:28.742077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:28.742696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:28.748227 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-174ea028-0601-4a9e-b2a8-997a2a4a4896 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.654237 Sep 14 09:52:28.749175 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1175/4467] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:52:28.762823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64f84ca8-ec03-4be8-8e0e-2253788f7c5b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:28.763883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-64f84ca8-ec03-4be8-8e0e-2253788f7c5b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:28.870838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-64f84ca8-ec03-4be8-8e0e-2253788f7c5b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:28.881838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64f84ca8-ec03-4be8-8e0e-2253788f7c5b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1302 microversion: 2.1 time: 0.123857 Sep 14 09:52:28.885439 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1176/4468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:28 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1302 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:28.893087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-68629729", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "7f7dd7b1-77a8-4d56-a59c-7e28e30d641d"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:28.981870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] validate_networks() for [('7f7dd7b1-77a8-4d56-a59c-7e28e30d641d', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:29.007839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:29.025398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-76e5f8bc-86cb-4dc2-98c9-978afc8f40d0 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.306328 Sep 14 09:52:29.040406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3293/4469] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:28 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:29.689778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:29.690386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:29.690682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:29.691093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:29.691509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:29.709829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:29.710339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:29.710869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:29.711612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:29.713751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:29.714514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:29.766631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Getting quotas for project 0fb8ad9813af4abfadafa822a97b2bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:29.774581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Getting quotas for user 13a7e2ea0fd24d449b37ef1322237acb and project 0fb8ad9813af4abfadafa822a97b2bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:29.786688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a615417a-dd4c-41e5-b96e-152864ffa977", "tag": "1cb1514a-5c79-4622-8316-1febbce06a90"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:29.804707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:29.806931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:29.813276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:29.816098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:29.822284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:29.851709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] Creating event network-changed:1cb1514a-5c79-4622-8316-1febbce06a90 for instance a615417a-dd4c-41e5-b96e-152864ffa977 on n-h2-851028-12 Sep 14 09:52:29.861103 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0fedcd69-c170-48c0-a307-3a95655a31f2 req-1fe3671c-65e0-4620-a188-37f9056489b1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078478 Sep 14 09:52:29.862638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3294/4470] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:29.900179 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5db6a50f-6cb0-46be-84ac-eb9ded46ee66 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013332 Sep 14 09:52:29.901367 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1177/4471] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:52:29.915818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:29.916560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:29.918967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-452c8926-8bef-4ea6-af32-e9015abe0488 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:29.920977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-452c8926-8bef-4ea6-af32-e9015abe0488 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:29.929171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:29.929919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:29.931978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:29.933186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:29.935570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:29.936208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:30.060391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:30.071971 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52785038-c651-4184-97a7-44b5dd4a5b24 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1354 microversion: 2.1 time: 0.162972 Sep 14 09:52:30.081788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-452c8926-8bef-4ea6-af32-e9015abe0488 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:30.092950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3295/4472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:29 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:30.099243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:30.099875 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-452c8926-8bef-4ea6-af32-e9015abe0488 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1217 microversion: 2.1 time: 0.186048 Sep 14 09:52:30.100438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:30.100578 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1178/4473] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:29 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:30.107253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:30.107680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:30.108221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:30.109099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:30.109720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:30.110295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:30.295433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:30.307129 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2f12390-7aaf-4720-978b-fa33b0cc5947 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.212762 Sep 14 09:52:30.328483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3296/4474] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:30 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:31.101059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:31.101690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:31.109921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.110419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.110868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.111589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.112092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.112528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.116158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:31.124585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:31.126019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:31.138843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.139677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.140308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.141177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.141850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.142481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.202113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:31.211256 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-361350fe-4cf6-497b-96e6-1a1ab32d98d2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1360 microversion: 2.1 time: 0.116402 Sep 14 09:52:31.212621 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1179/4475] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:31 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1360 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:31.238872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:31.249709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4f3261a-c9d1-43a3-8f98-410f54ed2f2a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1221 microversion: 2.1 time: 0.129322 Sep 14 09:52:31.252105 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3297/4476] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:31 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:31.336370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:31.336996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:31.348489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.349027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.349472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.350196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:31.357034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:31.357825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:31.703236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:31.720203 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03556409-55e0-4f27-a772-4d106effae04 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.387915 Sep 14 09:52:31.721406 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1180/4477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:31 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:32.240560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:32.241599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:32.258438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.259027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.259542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.260405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.263635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.264260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.274702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:32.275928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:32.315265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.318688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.324249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.325680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.328565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.336444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.470893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:32.486031 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24c772e0-4270-491f-b9fe-bfbc9d3402c9 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1277 microversion: 2.1 time: 0.214636 Sep 14 09:52:32.502671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1181/4478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:32 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:32.591922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:32.594807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:32.603488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.604100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.604539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.605266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.606146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.606718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.637421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:32.648336 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4871493a-1378-467a-8a5b-3135e7b72fc5 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.413876 Sep 14 09:52:32.649043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3298/4479] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:32 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:32.676459 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5faa316-68c5-4dfb-89c2-44b440d42b9f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20/action" status: 200 len: 24564 microversion: 2.1 time: 0.089567 Sep 14 09:52:32.678222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1182/4480] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:52:32 2022] POST /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20/action => generated 24564 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:52:32.690296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab723f2-9b74-43cb-8be0-a8f9f40441a7", "tag": "f6b63767-1b13-4542-9ced-66cfdfc3e188"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:32.713365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.713844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.714274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.738440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] Creating event network-changed:f6b63767-1b13-4542-9ced-66cfdfc3e188 for instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 on n-h1-851028-12 Sep 14 09:52:32.747422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:32.748162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:32.766116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.766615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.767056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.767779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:32.768269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:32.768698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:32.775309 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8c0dbad4-48c6-415e-a220-44abac077c0b req-b32f6a83-067f-4005-a40d-2ad9e4f8537a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088572 Sep 14 09:52:32.775972 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3299/4481] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:33.049650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:33.061019 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-925265aa-1bcd-46a7-9b59-3049c06599f7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.317636 Sep 14 09:52:33.062373 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1183/4482] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:32 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:33.520382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:33.521502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:33.532940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:33.533789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:33.534520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:33.535445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:33.536140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:33.537390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:33.672964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:33.674268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:33.688335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:33.688921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:33.689590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:33.690423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:33.690952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:33.691470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:33.765604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:33.774323 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7e18fd94-925b-4241-9e75-155a78374a21 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1317 microversion: 2.1 time: 0.261843 Sep 14 09:52:33.774847 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3300/4483] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:33 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:33.923094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:33.934740 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e5c95c7a-a4cf-4fc1-985b-6ad76029b8e4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.267803 Sep 14 09:52:33.935731 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1184/4484] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:33 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:34.088035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:34.089071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:34.096139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.096767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.097310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.098184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.099347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.100188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.206993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8044475e-9b4b-49bc-81ac-125781a60578", "tag": "6d258e8d-3149-4080-848b-6640749f7031"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:34.220526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.221165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.221843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.241257 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] Creating event network-changed:6d258e8d-3149-4080-848b-6640749f7031 for instance 8044475e-9b4b-49bc-81ac-125781a60578 on n-h2-851028-12 Sep 14 09:52:34.247360 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2f3842ab-4c6b-4880-9324-b172b598a1af req-c4233dc0-48a4-4f9c-8974-a2ba9789ffcf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043637 Sep 14 09:52:34.248747 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1185/4485] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:34.307985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:34.317983 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c8a200b-a727-4407-a9c0-f4ec1014037d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.235002 Sep 14 09:52:34.318603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3301/4486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:34 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:34.644379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a615417a-dd4c-41e5-b96e-152864ffa977", "name": "network-vif-plugged", "status": "completed", "tag": "1cb1514a-5c79-4622-8316-1febbce06a90"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:34.657289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.658124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.658756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.673011 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] Creating event network-vif-plugged:1cb1514a-5c79-4622-8316-1febbce06a90 for instance a615417a-dd4c-41e5-b96e-152864ffa977 on n-h2-851028-12 Sep 14 09:52:34.681118 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d43390dd-b69c-46d7-981e-8b0c9be341c2 req-a3e951cf-7c29-41ef-8fca-a37b5c880d9e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Sep 14 09:52:34.682897 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1186/4487] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:34.799436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:34.801412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:34.808354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.808925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.809439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.810222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.810777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.811278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.959356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:34.960088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:34.962334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:34.968929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.969452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.969895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:34.970602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:34.971056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:34.971483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:35.021841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:35.029886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cfdc23a-0bfa-4d56-b837-514c77021c22 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1317 microversion: 2.1 time: 0.234847 Sep 14 09:52:35.030762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3302/4488] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:34 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:35.115800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:35.123702 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab27c7e8-7b36-4b0e-904e-a619ca8b1a33 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.168663 Sep 14 09:52:35.124321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1187/4489] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:34 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:35.340977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:35.341598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:35.347845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:35.348370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:35.349401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:35.350174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:35.350631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:35.351062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:35.351620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:35.494899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:35.502731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08bb63df-a992-4bd5-8b4c-8bf1a67b05d1 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.165889 Sep 14 09:52:35.503338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3303/4490] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:35 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:36.057393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:36.061012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:36.073613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.074111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.074554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.075268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.075728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.076188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.147326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:36.148055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:36.155086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.155583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.156064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.156783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.157237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.157719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.358325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:36.369523 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbda6959-07a1-4f3c-8026-f354970cfa13 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.226762 Sep 14 09:52:36.370834 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3304/4491] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:36 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:36.527816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:36.528542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:36.537034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.537920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.538471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.539291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:36.539852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:36.540456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:36.682299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:36.688405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:36.690498 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1bb6aa19-fc29-42d6-96a1-54d6d306d2a5 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1317 microversion: 2.1 time: 0.636780 Sep 14 09:52:36.691109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1188/4492] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:36 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:36.698994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc92049a-5436-43ee-8642-f17cf7cb453f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1313 microversion: 2.1 time: 0.176488 Sep 14 09:52:36.710345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3305/4493] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:36 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:37.392961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:37.393728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:37.402009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.402504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.402938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.403731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.404215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.404645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.548361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:37.556539 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a48c7d3-b7bb-4e99-964b-00b8fce249d4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.167692 Sep 14 09:52:37.557125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1189/4494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:37 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:37.714429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:37.714998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:37.717044 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:52:37.717193 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 09:52:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 (ip 10.222.0.90) !!! Sep 14 09:52:37.721483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:37.722078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:37.728508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.728995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.729428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.730125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.730574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.730850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.731265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.731613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.732106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.732816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:37.733278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:37.733712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:37.866718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:37.870834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:37.874701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d7bdbc24-5203-4df4-87da-e6cfdd2fde03 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1496 microversion: 2.1 time: 0.157086 Sep 14 09:52:37.875288 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1190/4495] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:37 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:37.878530 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8261a21-1685-4332-8d89-34357a8e8ff3 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1317 microversion: 2.1 time: 0.168076 Sep 14 09:52:37.879097 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3306/4496] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:37 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:38.580624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:38.581813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:38.589340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.589963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.590506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.591375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.592223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.592721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.749489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:38.758742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8044475e-9b4b-49bc-81ac-125781a60578", "name": "network-vif-plugged", "status": "completed", "tag": "6d258e8d-3149-4080-848b-6640749f7031"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:38.759801 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a747c65-fefb-4724-8b7d-bea2469fbadc tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.182406 Sep 14 09:52:38.769052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1191/4497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:38 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:38.778673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:38.782753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.783238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.783671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.796904 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] Creating event network-vif-plugged:6d258e8d-3149-4080-848b-6640749f7031 for instance 8044475e-9b4b-49bc-81ac-125781a60578 on n-h2-851028-12 Sep 14 09:52:38.802170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d988ff0f-54d5-4840-bd74-27e3b836252d req-30ac398e-bd55-4340-8e87-1610d1ff4655 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047392 Sep 14 09:52:38.803294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3307/4498] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:38.905990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:38.906779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:38.915593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.916178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.916634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:38.917376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:38.917838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:38.918263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:39.114347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:39.123692 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-48843168-5109-48e1-953b-39443acfaf3a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1317 microversion: 2.1 time: 0.222490 Sep 14 09:52:39.132592 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1192/4499] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:38 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:39.787375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:39.788238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:39.794439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:39.794905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:39.795368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:39.797122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:39.798000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:39.798426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:39.946062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:39.953902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0472d17b-3e05-41be-8724-9079a116e3d1 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.171868 Sep 14 09:52:39.954481 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3308/4500] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:39 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:40.147370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:40.147588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:40.148267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.148500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.151212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:40.152266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=30 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:40.154833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.155564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.156124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.156902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.157722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.158153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.158722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.160235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.161159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.162037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.163728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.164983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.202438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:52:40.298938 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-25999869-b8e4-4809-9240-899a4bac5e4d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 204 len: 0 microversion: 2.1 time: 0.153443 Sep 14 09:52:40.299645 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1193/4501] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:52:40 2022] DELETE /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:52:40.312551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:40.313255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.320245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.320728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.321157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.321853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.322301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.322718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.333081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:40.347106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1110b86c-20c0-499a-b04f-4f2be2c16c8e tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1506 microversion: 2.1 time: 0.203451 Sep 14 09:52:40.347746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3309/4502] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:40 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:40.373896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06cda1a4-57f0-4fdb-bac3-297b46616add", "device": "/dev/sdb"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:40.376692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.383354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.383844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.384308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.385432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.385894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.386319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.465939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:40.483259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:40.491863 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2198f1bb-bbb7-4733-8389-a1b342f5340d tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1502 microversion: 2.1 time: 0.183078 Sep 14 09:52:40.504818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1194/4503] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:40 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:40.820092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab723f2-9b74-43cb-8be0-a8f9f40441a7", "name": "network-vif-plugged", "status": "completed", "tag": "f6b63767-1b13-4542-9ced-66cfdfc3e188"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:40.829701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.830172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.830599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.841631 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] Creating event network-vif-plugged:f6b63767-1b13-4542-9ced-66cfdfc3e188 for instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 on n-h1-851028-12 Sep 14 09:52:40.846548 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1ea3b413-efc8-412b-a805-975e1ecfad41 req-9cf1116b-be53-49ba-b175-bee5639a2441 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030967 Sep 14 09:52:40.847169 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1195/4504] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:40.978250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:40.978956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:40.985495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.985985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.986420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:40.987128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:40.987581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:40.988042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.005091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:52:41.129867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:41.137913 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e934e2a3-7d7b-4bb0-91dc-285f0b2f41ae tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.164666 Sep 14 09:52:41.138635 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1196/4505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:40 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:41.516256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:41.516907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:41.524263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:41.524772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:41.525204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.525913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:41.526415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:41.526802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:41.528711 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f70ebefc-a903-49ef-a9fb-de5877d57dbb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "POST /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158853 Sep 14 09:52:41.534757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3310/4506] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 09:52:40 2022] POST /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:41.704300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:41.714572 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-757fa54c-a6f9-4140-b568-2cc2922ff81f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1502 microversion: 2.1 time: 0.202141 Sep 14 09:52:41.720900 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1197/4507] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:41 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:52:42.170947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:42.172932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:42.189374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.190125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.190710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.191308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a615417a-dd4c-41e5-b96e-152864ffa977", "name": "network-vif-deleted", "tag": "1cb1514a-5c79-4622-8316-1febbce06a90"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:42.192972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.193645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.194110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.208461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.209687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.210736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.228493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] Creating event network-vif-deleted:1cb1514a-5c79-4622-8316-1febbce06a90 for instance a615417a-dd4c-41e5-b96e-152864ffa977 on n-h2-851028-12 Sep 14 09:52:42.244833 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-433ca9c4-7315-4044-916d-84a1ca193998 req-612b08ab-89f3-4143-a86c-90d7e5cf2d73 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057490 Sep 14 09:52:42.246273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1198/4508] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:42.366354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:42.375461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4562dc4-01c2-4c4f-8b42-3f8a874af3fd tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1427 microversion: 2.1 time: 0.218149 Sep 14 09:52:42.376479 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3311/4509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:42 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:42.739867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:42.741984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:42.749443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.750096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.750656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.751444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.752043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.752598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.789695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:42.790219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:42.790924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:42.791819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lazy-loading 'fault' on Instance uuid a615417a-dd4c-41e5-b96e-152864ffa977 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:52:42.843816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e083f361917749abbb0dbe7d33319cad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04a993ebf6b944f0a8ba26061750c9fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:42.853492 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07e72adb-f0da-4480-9155-b239398ee68f tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 200 len: 1303 microversion: 2.1 time: 0.118414 Sep 14 09:52:42.854157 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1199/4510] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:42 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:43.399803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:43.400574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:43.407376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.407859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.408327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.409024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.409479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.409905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.549025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:43.557709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e552279e-a473-4574-ad61-dd87549c35d0 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1608 microversion: 2.1 time: 0.162211 Sep 14 09:52:43.558309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3312/4511] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:43 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1608 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:43.580742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:43.581457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:43.587812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.588342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.588801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.589481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.589936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.590364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.739003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:43.748508 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b3b1fa9-62fa-4962-8584-131e68ac1531 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1608 microversion: 2.1 time: 0.171534 Sep 14 09:52:43.749170 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1200/4512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:43 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:43.770587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:43.771200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:43.778002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.778472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.778903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.779597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.780079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.780504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.877295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:43.877975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] [instance: a615417a-dd4c-41e5-b96e-152864ffa977] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:43.884606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.885611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.886212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.886926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:43.887381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:43.887815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:43.902778 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] HTTP exception thrown: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Request method failure captured: Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 HTTP/1.1 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaRUoT-9t6KuC5Ixji4w310F9B_6jNsZQpWcceizWofhJ3KKS8qUkL2rx-McNdN20PuvLCDVcZ8EgvE6wDs2wEfmJrpcupNi8jg3KKJYcAotlFpMf35Uj-XgSS11Y55Ve5KSAoEvXWFtG56sDO5IMrz_kKS0-MY8uOKR38flYQ2EUn0 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 04a993ebf6b944f0a8ba26061750c9fa Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-VolumesActionsTest-1356285757 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_04a993ebf6b944f0a8ba26061750c9fa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04a993ebf6b944f0a8ba26061750c9fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/04a993ebf6b944f0a8ba26061750c9fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/04a993ebf6b944f0a8ba26061750c9fa"}]}] Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-VolumesActionsTest-1356285757 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 04a993ebf6b944f0a8ba26061750c9fa Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-VolumesActionsTest-1356285757 Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-VolumesActionsTest-1356285757-project Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e083f361917749abbb0dbe7d33319cad Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-VolumesActionsTest-1356285757-project Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'a615417a-dd4c-41e5-b96e-152864ffa977'} Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:52:43.905004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] Returning 404 to user: Instance a615417a-dd4c-41e5-b96e-152864ffa977 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-211ca544-847d-405c-af0c-36983ecd88b7 tempest-VolumesActionsTest-1356285757 tempest-VolumesActionsTest-1356285757-project] 10.222.0.90 "GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977" status: 404 len: 111 microversion: 2.1 time: 0.032618 Sep 14 09:52:43.908490 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1201/4513] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:43 2022] GET /compute/v2.1/servers/a615417a-dd4c-41e5-b96e-152864ffa977 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:52:43.928016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:43.938582 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7ad8c81-2168-4674-899d-db41bf321744 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1608 microversion: 2.1 time: 0.171494 Sep 14 09:52:43.939233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3313/4514] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:43 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:46.399256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab723f2-9b74-43cb-8be0-a8f9f40441a7", "tag": "f6b63767-1b13-4542-9ced-66cfdfc3e188"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:46.412134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:46.412754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:46.413885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:46.427596 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] Creating event network-changed:f6b63767-1b13-4542-9ced-66cfdfc3e188 for instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 on n-h1-851028-12 Sep 14 09:52:46.435445 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4c12bd70-dc2e-4de4-ad94-030ff6beea5a req-ae3d10e6-0d7f-4f22-8c5d-18ecae2deeb2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040638 Sep 14 09:52:46.440589 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1202/4515] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:47.004933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75b3d296-69ff-464b-b16c-7a10f3768a9d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: .version_select at 0x7f693dd565e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-144769019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJClEo2nFmsscfnXo9vDIP4UyctT6dp4N3NXCgZuTMDvQTVNHL8RMxWGmDBOKUfxMlXfFulhjojVCQl0X89Sz0DBCF66A7CFoxg1X7to6Dp4JWR+GddB1HB5Qc28Yt6hw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:47.055501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-75b3d296-69ff-464b-b16c-7a10f3768a9d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:47.079109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-75b3d296-69ff-464b-b16c-7a10f3768a9d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:47.174756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75b3d296-69ff-464b-b16c-7a10f3768a9d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.176584 Sep 14 09:52:47.180841 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3314/4516] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:52:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:48.855651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1582217183", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "8cb8a873-644d-4e4a-a959-1e7b790703d3"}], "key_name": "tempest-TestNetworkBasicOps-144769019", "security_groups": [{"name": "tempest-secgroup-smoke-786825548"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:48.994861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] validate_networks() for [('8cb8a873-644d-4e4a-a959-1e7b790703d3', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:52:49.715675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:52:49.716186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:52:49.716671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:52:49.717092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:52:49.717509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:52:49.735092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:49.736721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:49.738143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:49.740946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:49.742453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:49.756631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:49.783254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:52:49.790163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:52:49.805513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:52:49.808381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:52:49.869925 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f87873ad-d30b-4dab-bd3c-c521f4c8b08e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.021047 Sep 14 09:52:49.871630 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1203/4517] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:52:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:52:49.884313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb8b2cc1-dc75-48e5-bd86-fb25faa5bc4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:49.885491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb8b2cc1-dc75-48e5-bd86-fb25faa5bc4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:49.948359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb8b2cc1-dc75-48e5-bd86-fb25faa5bc4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:49.957529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb8b2cc1-dc75-48e5-bd86-fb25faa5bc4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1248 microversion: 2.1 time: 0.078782 Sep 14 09:52:49.958441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3315/4518] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:49 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:50.982078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:50.982605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:50.988935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:50.989412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:50.989844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:50.990546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:50.990975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:50.992071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:51.059833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:51.077913 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51d29af0-11e9-4e6c-963b-2c79f94e9ba7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1300 microversion: 2.1 time: 0.100935 Sep 14 09:52:51.078506 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1204/4519] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:50 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:52.106262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:52.107721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:52.118422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:52.119391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:52.120110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:52.121262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:52.122300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:52.123349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:52.290098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:52.298929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97f83ca7-614a-496c-9207-32aa0e9abada tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1373 microversion: 2.1 time: 0.200940 Sep 14 09:52:52.299764 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3316/4520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:52 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:53.102921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c68b08-40a4-4d0e-8973-456656afb152", "tag": "b1f662db-9498-4e9a-aca7-015d2be92d62"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:53.115930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:53.116839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:53.117504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:53.134193 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] Creating event network-changed:b1f662db-9498-4e9a-aca7-015d2be92d62 for instance 80c68b08-40a4-4d0e-8973-456656afb152 on n-h2-851028-12 Sep 14 09:52:53.141296 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9bff1227-e306-427f-a3ea-0712513e7ebd req-7b81c638-6fc6-44b6-8456-5fd737241769 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042626 Sep 14 09:52:53.142225 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1205/4521] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:52:53.323712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:53.325448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:53.332714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:53.333441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:53.334024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:53.336127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:53.336734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:53.337303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:53.488419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:53.499181 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4befb200-9668-412d-8eb8-05019671ef3d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1373 microversion: 2.1 time: 0.179472 Sep 14 09:52:53.499773 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3317/4522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:53 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:54.524807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:54.525551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:54.533118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:54.533608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:54.534060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:54.534784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:54.535237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:54.535665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:54.903791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:54.917239 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-96191d0d-e73d-4519-a0e1-96f5d67d5611 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1373 microversion: 2.1 time: 0.394319 Sep 14 09:52:54.919765 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1206/4523] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:54 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1373 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:55.945310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:55.945930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:55.952745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:55.953233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:55.953665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:55.954354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:55.954805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:55.955225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:56.129582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:56.138168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e99acd5b-1549-443e-a9ff-b51a59b600a1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1373 microversion: 2.1 time: 0.196699 Sep 14 09:52:56.138743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3318/4524] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:55 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1373 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:56.790777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c68b08-40a4-4d0e-8973-456656afb152", "name": "network-vif-plugged", "status": "completed", "tag": "b1f662db-9498-4e9a-aca7-015d2be92d62"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:52:56.813198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:56.813999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:56.814594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:56.830555 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] Creating event network-vif-plugged:b1f662db-9498-4e9a-aca7-015d2be92d62 for instance 80c68b08-40a4-4d0e-8973-456656afb152 on n-h2-851028-12 Sep 14 09:52:56.840388 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-98a54f1a-9178-4766-aee4-88870a1e6b06 req-70787788-168d-452c-95eb-c94c0c95783d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054396 Sep 14 09:52:56.842526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1207/4525] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:52:57.166093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:57.167441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:57.175876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:57.176755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:57.177428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:57.181357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:57.181849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:57.182380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:57.349945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:57.358942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3777f65b-3f3b-4b32-907f-0f2b7b64f237 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1373 microversion: 2.1 time: 0.199013 Sep 14 09:52:57.359679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3319/4526] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:57 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1373 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:58.384947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:58.384947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:58.391540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:58.392260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:58.392861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:58.394213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:58.394808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:58.395379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:58.562412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:58.572063 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-726be05b-606d-44f8-aa6b-c87e4edeb47f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1545 microversion: 2.1 time: 0.192963 Sep 14 09:52:58.573019 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1208/4527] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:58 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1545 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:52:58.595479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:52:58.596122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:52:58.603768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:58.604345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:58.604776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:58.605489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:52:58.605939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:52:58.606357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:52:58.786392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:52:58.797406 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cabc3f8d-00f1-4d77-a1d8-34182feb8d2a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1545 microversion: 2.1 time: 0.205292 Sep 14 09:52:58.797611 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3320/4528] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:52:58 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1545 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:04.890950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:04.892515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:04.899978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:04.901047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:04.903571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:04.904313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:04.904903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:04.906320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:04.907015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:04.907646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:05.048167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lazy-loading 'services' on Instance uuid 8044475e-9b4b-49bc-81ac-125781a60578 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:05.254205 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-454f629c-e901-4f0f-9165-e90feb7b798a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578/os-volume_attachments/06cda1a4-57f0-4fdb-bac3-297b46616add" status: 202 len: 0 microversion: 2.1 time: 0.367474 Sep 14 09:53:05.259465 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1209/4529] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 09:53:04 2022] DELETE /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578/os-volume_attachments/06cda1a4-57f0-4fdb-bac3-297b46616add => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:10.671149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:10.671680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:10.674504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:10.675225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:10.676077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:10.685913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.686421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.686848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.687546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.688121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.688516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.717932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:10.815819 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2494aab2-c49a-497d-be1d-9924e10cd745 tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "DELETE /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 204 len: 0 microversion: 2.1 time: 0.147740 Sep 14 09:53:10.815819 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3321/4530] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:10 2022] DELETE /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:53:10.827091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:10.828015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:10.830170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:10.841882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.842706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.844014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:10.846134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:10.846699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:10.847840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:11.009523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:11.020733 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4dfbd994-b5ae-40d5-8534-248c45d338fb tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1512 microversion: 2.1 time: 0.198740 Sep 14 09:53:11.021430 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1210/4531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:10 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:12.046211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:12.046934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:12.054128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.054620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.055058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.056017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:12.056477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:12.056902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:12.212154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:12.221202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9fe95d0-625a-4e9b-a28e-f37ea626dffe tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1512 microversion: 2.1 time: 0.179571 Sep 14 09:53:12.221823 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3322/4532] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:12 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:13.249386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:13.250075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:13.264120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:13.264859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:13.265601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:13.266534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:13.267169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:13.267762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:13.272734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:13.394628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:13.406843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24838d58-8a38-44a9-8ced-924a3b275e8f tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1470 microversion: 2.1 time: 0.165313 Sep 14 09:53:13.408828 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1211/4533] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:13 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:13.494594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8044475e-9b4b-49bc-81ac-125781a60578", "name": "network-vif-deleted", "tag": "6d258e8d-3149-4080-848b-6640749f7031"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:13.520895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:13.522021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:13.523443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:13.554659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] Creating event network-vif-deleted:6d258e8d-3149-4080-848b-6640749f7031 for instance 8044475e-9b4b-49bc-81ac-125781a60578 on n-h2-851028-12 Sep 14 09:53:13.562238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f843ccdb-7aff-4785-b4cf-68a5babe266d req-d6e38c65-318b-4313-8f7a-bd30998907b6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071932 Sep 14 09:53:13.564749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3323/4534] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:14.435100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:14.435931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:14.443727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:14.444562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:14.445446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:14.446400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:14.447156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:14.447773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:14.491127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:14.491814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:14.492781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:14.493406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lazy-loading 'fault' on Instance uuid 8044475e-9b4b-49bc-81ac-125781a60578 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:53:14.542817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13a7e2ea0fd24d449b37ef1322237acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fb8ad9813af4abfadafa822a97b2bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:14.549978 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1a596cd-6c83-422b-bd2b-2b57cfc0030a tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 200 len: 1307 microversion: 2.1 time: 0.119200 Sep 14 09:53:14.550774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1212/4535] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:14 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 1307 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:15.584182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:15.585107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] [instance: 8044475e-9b4b-49bc-81ac-125781a60578] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:15.593040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:15.593862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:15.594998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:15.595849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:15.596522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:15.597131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:15.613765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] HTTP exception thrown: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Request method failure captured: Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 HTTP/1.1 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaOfwqFGRy1_ZgsmytTGBS9T4WjiZce-lMciToJNI57oJOfPCGzRuO-v3erAAdaKuBthLBVWh-hPpTCnDda7Kd4rORsu5UQWFxGCSyNBPvMsLV5zJq3_WEFU8ubNRazfJZK4WdZDtYisH4z4An2JWKcv_QDb7Oo2JAlOtfp1UlMYo50 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 0fb8ad9813af4abfadafa822a97b2bd0 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0fb8ad9813af4abfadafa822a97b2bd0", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0fb8ad9813af4abfadafa822a97b2bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0fb8ad9813af4abfadafa822a97b2bd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0fb8ad9813af4abfadafa822a97b2bd0"}]}] Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 0fb8ad9813af4abfadafa822a97b2bd0 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-425648839 Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-VolumesSnapshotTestJSON-425648839-project Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 13a7e2ea0fd24d449b37ef1322237acb Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-VolumesSnapshotTestJSON-425648839-project Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '8044475e-9b4b-49bc-81ac-125781a60578'} Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:15.615619 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] Returning 404 to user: Instance 8044475e-9b4b-49bc-81ac-125781a60578 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aae10fdd-1152-47f1-9dd2-6b142273376d tempest-VolumesSnapshotTestJSON-425648839 tempest-VolumesSnapshotTestJSON-425648839-project] 10.222.0.90 "GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578" status: 404 len: 111 microversion: 2.1 time: 0.040152 Sep 14 09:53:15.622177 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3324/4536] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:15 2022] GET /compute/v2.1/servers/8044475e-9b4b-49bc-81ac-125781a60578 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:21.553683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:21.554983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:21.555992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ab723f2-9b74-43cb-8be0-a8f9f40441a7", "tag": "f6b63767-1b13-4542-9ced-66cfdfc3e188"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:21.568575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.569319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.572881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.573636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.574177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.574548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.574990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.575458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.576022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.596006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] Creating event network-changed:f6b63767-1b13-4542-9ced-66cfdfc3e188 for instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 on n-h1-851028-12 Sep 14 09:53:21.610546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2ea006f6-8783-4ac1-8023-3b325cad0e99 req-e5956c07-aadc-444e-be6e-1c3e5b24bbe8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059037 Sep 14 09:53:21.617623 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3325/4537] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:21.652840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:21.850660 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8addbf6c-e91e-4909-aef1-5ad64971473b tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 204 len: 0 microversion: 2.1 time: 0.302975 Sep 14 09:53:21.851770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1213/4538] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:21 2022] DELETE /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:53:21.861109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:21.861985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:21.884323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.885688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.888076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:21.889105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:21.891300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:21.893111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:22.298132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:22.328720 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8920be3-5fba-4148-a3e1-0be27034a2c4 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1732 microversion: 2.1 time: 0.472334 Sep 14 09:53:22.329564 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3326/4539] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:21 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1732 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:23.355652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:23.357287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:23.364747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:23.365523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:23.366173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:23.367405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:23.368110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:23.368797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:23.639124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:23.652806 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3080f0e7-b9f4-4fd4-b845-519f15c8b3f2 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1732 microversion: 2.1 time: 0.302537 Sep 14 09:53:23.653730 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1214/4540] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:23 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1732 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:24.612978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ab723f2-9b74-43cb-8be0-a8f9f40441a7", "name": "network-vif-deleted", "tag": "f6b63767-1b13-4542-9ced-66cfdfc3e188"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:24.638819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.639978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.640596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.699521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] Creating event network-vif-deleted:f6b63767-1b13-4542-9ced-66cfdfc3e188 for instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 on n-h1-851028-12 Sep 14 09:53:24.708722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:24.710604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:24.715463 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f1482876-8d68-4ee1-a964-60f9d698ad60 req-35aa90c2-d31b-4ada-9379-b76512d85c3c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116543 Sep 14 09:53:24.716397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3327/4541] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:24.732269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.740559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.741013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.746038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:24.746572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:24.751000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:24.845138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6bc83ba7b14834a664b995297d2985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb48c4fcc42043f29ce2a999ea2a7a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:24.856981 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2ed46dd1-1c35-4b5c-bde8-7dd451b74f91 tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 200 len: 1383 microversion: 2.1 time: 0.159833 Sep 14 09:53:24.873786 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1215/4542] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:24 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 1383 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:25.886899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:25.889564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] [instance: 7ab723f2-9b74-43cb-8be0-a8f9f40441a7] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:25.907768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:25.908520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:25.909132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:25.909988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:25.910589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:25.911232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:25.941686 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] HTTP exception thrown: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Request method failure captured: Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 HTTP/1.1 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaRQGoJIB4v5QMv-yiKXKrFO9uLBnja1rANpZP47yKgciNarSuPJBULw_tML223fNJo1IW0OpiPTAeC7gVaCD8VtoFYzYrOwSzl9KFkPhdnLlLokgr2WEkTb_zuiHe99-p_X8-tdH8scjISdQSHnlfFFM76Gxv76m04sIRm2AoR-poQ Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: cb48c4fcc42043f29ce2a999ea2a7a91 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestServerBasicOps-1740503945 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_cb48c4fcc42043f29ce2a999ea2a7a91", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cb48c4fcc42043f29ce2a999ea2a7a91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/cb48c4fcc42043f29ce2a999ea2a7a91"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/cb48c4fcc42043f29ce2a999ea2a7a91"}]}] Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestServerBasicOps-1740503945 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: cb48c4fcc42043f29ce2a999ea2a7a91 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestServerBasicOps-1740503945 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestServerBasicOps-1740503945-project Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 9f6bc83ba7b14834a664b995297d2985 Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestServerBasicOps-1740503945-project Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '7ab723f2-9b74-43cb-8be0-a8f9f40441a7'} Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:25.943411 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Returning 404 to user: Instance 7ab723f2-9b74-43cb-8be0-a8f9f40441a7 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:25.957267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16305e79-a156-4323-9f7f-9e5411688bdf tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7" status: 404 len: 111 microversion: 2.1 time: 0.064147 Sep 14 09:53:25.960679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3328/4543] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:25 2022] GET /compute/v2.1/servers/7ab723f2-9b74-43cb-8be0-a8f9f40441a7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:26.289129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-022633f6-f367-4532-ad71-71af93a2d8de tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] Calling method '.version_select at 0x7f693f59b9d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:26.341729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-022633f6-f367-4532-ad71-71af93a2d8de tempest-TestServerBasicOps-1740503945 tempest-TestServerBasicOps-1740503945-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1710140563" status: 202 len: 0 microversion: 2.1 time: 0.058506 Sep 14 09:53:26.344914 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1216/4544] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Sep 14 09:53:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1710140563 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:28.503057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:28.503057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:28.513197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:28.517480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:28.518584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:28.520132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:28.520847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:28.521598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:28.555571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:28.764307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc146a89-8b3d-4424-94a2-b5a816ca0962 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 204 len: 0 microversion: 2.1 time: 0.266638 Sep 14 09:53:28.764912 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3329/4545] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:28 2022] DELETE /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:53:28.774956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:28.776360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:28.798784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:28.800121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:28.807207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:28.808623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:28.809712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:28.812021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:29.125764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:29.143135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0755f669-80d2-45de-a0f0-42f7ef3ebf9e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1551 microversion: 2.1 time: 0.373237 Sep 14 09:53:29.145445 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1217/4546] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:28 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1551 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:30.168707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:30.170012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:30.190103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:30.196669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:30.216562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:30.225793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:30.227156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:30.227617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:30.939320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:30.989092 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8ae833a-8437-4631-979a-b5929f29eaec tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 200 len: 1551 microversion: 2.1 time: 0.819987 Sep 14 09:53:30.993864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3330/4547] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:30 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 1551 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:31.013298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c68b08-40a4-4d0e-8973-456656afb152", "name": "network-vif-deleted", "tag": "b1f662db-9498-4e9a-aca7-015d2be92d62"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:31.043089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:31.043577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:31.044048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:31.084167 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] Creating event network-vif-deleted:b1f662db-9498-4e9a-aca7-015d2be92d62 for instance 80c68b08-40a4-4d0e-8973-456656afb152 on n-h2-851028-12 Sep 14 09:53:31.127767 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-bc32372f-6605-4c9a-85e3-1c3a73d4145e req-5543fbc5-032d-4453-b4c7-2b3902d92602 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085106 Sep 14 09:53:31.128509 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1218/4548] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:32.016519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:32.019545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 80c68b08-40a4-4d0e-8973-456656afb152] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:32.040055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:32.040644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:32.041159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:32.051963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:32.052803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:32.053747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:32.103298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] HTTP exception thrown: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Request method failure captured: Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 HTTP/1.1 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaQtuS5Rjq93UO7UiQsjIEeyC6fSwSbepbKr4VqyOSbs_gHeXnwWccFRmKTt90ib6hg35HTjroXkKohRpulDtY-YLDOmTHKt7W3CxvaM6NL9Dtli7oTIVYFK5L4wPDiwdsFNqFG23P6ghxW-DKmlCp_oBSqegZtqcfeXaIVQajojyQ0 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ed86cc38b95f4d60a3ee548165c1a90c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ed86cc38b95f4d60a3ee548165c1a90c"}]}] Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 13c2892aa35c48dcb9cb118a3adba2d0 Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '80c68b08-40a4-4d0e-8973-456656afb152'} Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:32.106806 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. Sep 14 09:53:32.110710 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:53:32.113627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Returning 404 to user: Instance 80c68b08-40a4-4d0e-8973-456656afb152 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:32.114529 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13eb6d37-91f9-40da-903f-c79d4a8401b1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152" status: 404 len: 111 microversion: 2.1 time: 0.102014 Sep 14 09:53:32.118345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3331/4549] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:32 2022] GET /compute/v2.1/servers/80c68b08-40a4-4d0e-8973-456656afb152 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:32.536097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98db8614-21cd-41dc-8d77-caf61366e64f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '.version_select at 0x7f693f3fda60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:32.618555 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-98db8614-21cd-41dc-8d77-caf61366e64f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-144769019" status: 202 len: 0 microversion: 2.1 time: 0.091138 Sep 14 09:53:32.620411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1219/4550] 10.222.0.90 () {58 vars in 1254 bytes} [Wed Sep 14 09:53:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-144769019 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:36.167419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:36.168516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:36.177392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce7f3c21-e939-48f2-bd21-6a22443e7f20", "tag": "df214092-fade-49c6-af60-7615ab2ebfc4"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:36.183583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.184299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.184895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.188019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.188724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.189981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.197957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.198454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.198899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.228830 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] Creating event network-changed:df214092-fade-49c6-af60-7615ab2ebfc4 for instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 on n-h1-851028-12 Sep 14 09:53:36.239995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-88a8b88f-d39c-45d3-8f6f-f6b6a82df589 req-2cc1544c-069f-4c5a-9288-723dfaef294c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067952 Sep 14 09:53:36.248615 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1220/4551] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:36.285820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:36.487688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38fe070c-eb4a-4a67-b326-834e5e72d492 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 204 len: 0 microversion: 2.1 time: 0.324639 Sep 14 09:53:36.492063 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3332/4552] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:53:36 2022] DELETE /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:53:36.500372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:36.501289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:36.521694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.522162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.522677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.525185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:36.526422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:36.527780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:36.805300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:36.826553 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fed63c60-1671-472c-92ad-49f4af39471a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1669 microversion: 2.1 time: 0.332512 Sep 14 09:53:36.831016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1221/4553] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:36 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:37.860911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:37.862842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:37.881265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:37.886876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:37.888148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:37.892702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:37.894514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:37.894980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:38.605385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:38.617141 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a8ba0fab-e49e-4b79-b6e3-e0aa8d92de8d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1669 microversion: 2.1 time: 0.763049 Sep 14 09:53:38.618268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3333/4554] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:37 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1669 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:39.644019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:39.644527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:39.668898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:39.669916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:39.670519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:39.671437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:39.672145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:39.672753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:39.824777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:39.833745 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0ca8e9de-8db5-40d5-a635-abb8e7ace0d9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 200 len: 1484 microversion: 2.1 time: 0.194937 Sep 14 09:53:39.844419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1222/4555] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:39 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 1484 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:53:39.911492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce7f3c21-e939-48f2-bd21-6a22443e7f20", "name": "network-vif-deleted", "tag": "df214092-fade-49c6-af60-7615ab2ebfc4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:39.958625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:39.959170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:39.960742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:40.000694 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] Creating event network-vif-deleted:df214092-fade-49c6-af60-7615ab2ebfc4 for instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 on n-h1-851028-12 Sep 14 09:53:40.010790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-36562752-dae3-47ee-85db-3bc14f8a9703 req-ae318500-e877-4232-98a5-d4f487c48a1c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110525 Sep 14 09:53:40.012115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3334/4556] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:40.867811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:40.869212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: ce7f3c21-e939-48f2-bd21-6a22443e7f20] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:40.876620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:40.877373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:40.878043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:40.878928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:40.879796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:40.880328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:40.897009 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] HTTP exception thrown: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Request method failure captured: Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 HTTP/1.1 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaQtuS5Rjq93UO7UiQsjIEeyC6fSwSbepbKr4VqyOSbs_gHeXnwWccFRmKTt90ib6hg35HTjroXkKohRpulDtY-YLDOmTHKt7W3CxvaM6NL9Dtli7oTIVYFK5L4wPDiwdsFNqFG23P6ghxW-DKmlCp_oBSqegZtqcfeXaIVQajojyQ0 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ed86cc38b95f4d60a3ee548165c1a90c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ed86cc38b95f4d60a3ee548165c1a90c"}]}] Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 13c2892aa35c48dcb9cb118a3adba2d0 Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ce7f3c21-e939-48f2-bd21-6a22443e7f20'} Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:53:40.899622 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Returning 404 to user: Instance ce7f3c21-e939-48f2-bd21-6a22443e7f20 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:53:40.904131 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3bb477dc-4155-4086-81b5-3b4eb1c319aa tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20" status: 404 len: 111 microversion: 2.1 time: 0.037342 Sep 14 09:53:40.920312 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1223/4557] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:53:40 2022] GET /compute/v2.1/servers/ce7f3c21-e939-48f2-bd21-6a22443e7f20 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:53:41.107775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77c15497-f360-407f-b588-3b2c1a208744 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '.version_select at 0x7f693e1463a0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:41.123503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:41.145320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77c15497-f360-407f-b588-3b2c1a208744 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1384146532" status: 202 len: 0 microversion: 2.1 time: 0.050512 Sep 14 09:53:41.150821 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3335/4558] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 09:53:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1384146532 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:53:49.105065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:49.105617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:49.129141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:49.135137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.140303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.145283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.151079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.153479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.154178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.225357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:49.289383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:53:49.621258 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83e36706-1325-474e-aaf6-17f4ccddcdac tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 204 len: 0 microversion: 2.42 time: 1.172681 Sep 14 09:53:49.628992 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1224/4559] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:53:48 2022] DELETE /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 0 bytes in 1189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:53:49.639883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:49.641311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:49.659479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.666074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.666814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.667797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:49.668495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:49.669135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:49.673989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:53:50.796806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:50.833621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:50.836286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:50.837850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-700caa30-4e57-480e-bd14-b3ee2031bacc tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2960 microversion: 2.42 time: 1.204676 Sep 14 09:53:50.839447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3336/4560] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:53:49 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2960 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:53:51.873987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:51.874700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:51.889152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:51.891377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:51.893211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:51.896572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:51.897220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:51.898183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:53.305826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-unplugged", "status": "completed", "tag": "d3d5f079-71b7-48d8-8017-26eb3a72851e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:53.323324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:53.338758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:53.345633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:53.346173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:53.349614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:53.351565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:53.354883 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4940e28-a387-40bb-83e4-bdf66fb931f2 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2960 microversion: 2.42 time: 1.487260 Sep 14 09:53:53.376576 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1225/4561] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:53:51 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2960 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:53:53.385989 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] Creating event network-vif-unplugged:d3d5f079-71b7-48d8-8017-26eb3a72851e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:53:53.408629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-2305b364-bf41-4088-8eea-d4bb02ca3c5c req-f77faf82-970b-4e15-b6df-04251f1b2779 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109534 Sep 14 09:53:53.410104 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3337/4562] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 14 09:53:54.393302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:54.394619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:54.435694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:54.448345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:54.448345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:54.448345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:54.448345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:54.448345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:55.305800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:55.325666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:55.327691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:55.329116 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4cbb3ee4-355c-4f73-98b2-2fb65f089d82 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2918 microversion: 2.42 time: 0.940913 Sep 14 09:53:55.332312 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1226/4563] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:53:54 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2918 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:53:55.506506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a4c1e9-27d6-45c9-96ab-722055d6840e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:55.535867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:55.536565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:55.537178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:55.578762 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] Creating event network-vif-unplugged:c4a4c1e9-27d6-45c9-96ab-722055d6840e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:53:55.598214 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4ffb196a-9070-49a7-9a21-0d7f1508617b req-5998f339-c597-44ab-ac2f-a6c2ad767017 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096587 Sep 14 09:53:55.601390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3338/4564] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:53:55.885357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-deleted", "tag": "650232e0-bf9d-48c7-b1ee-0e6bad48bf2c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:55.916043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:55.916537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:55.916976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:55.959037 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] Creating event network-vif-deleted:650232e0-bf9d-48c7-b1ee-0e6bad48bf2c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:53:55.982742 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-06522ecc-2ee2-4830-9fc4-e8dfb7b304a0 req-53fb448f-a4ee-48ba-b02f-cfc36a18af71 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101432 Sep 14 09:53:55.985474 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1227/4565] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:56.366674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:56.367760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:56.393321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:56.394594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:56.396437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:56.400819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:56.401667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:56.402723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:57.545448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:57.571267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:57.580695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:57.590858 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0ad40de-f386-4075-9c9b-25ad1ee3cc7a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2757 microversion: 2.42 time: 1.226779 Sep 14 09:53:57.593609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3339/4566] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:53:56 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2757 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:53:57.765912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-unplugged", "status": "completed", "tag": "62f138f2-9474-49d5-9e39-c258023394ad"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:57.806749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:57.807516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:57.808777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:57.858514 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] Creating event network-vif-unplugged:62f138f2-9474-49d5-9e39-c258023394ad for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:53:57.869106 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d8df43cf-a5ef-432a-b073-429f4bd086ff req-8c67bce4-36ca-46aa-8ada-259ac1adb6b8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111750 Sep 14 09:53:57.874755 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1228/4567] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:58.074736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-deleted", "tag": "9e37e8af-ab20-4671-a729-1e8eb2016b5c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:53:58.106630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:58.107969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:58.109329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:58.158478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] Creating event network-vif-deleted:9e37e8af-ab20-4671-a729-1e8eb2016b5c for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:53:58.184766 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7d8030a1-37fa-4b2a-8e23-a619ac8b77f6 req-5826be94-c250-47ab-b257-670049c736f9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115332 Sep 14 09:53:58.185705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3340/4568] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:53:58.624830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:53:58.630549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:53:58.660051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:58.661021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:58.664315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:58.666453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:53:58.667228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:53:58.669943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:53:59.400979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:59.415773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:59.436793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:53:59.438196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-344c9af4-b2ad-4332-a9ac-921a79680ed3 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2549 microversion: 2.42 time: 0.817703 Sep 14 09:53:59.443932 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1229/4569] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:53:58 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2549 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:00.300232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-deleted", "tag": "c4a4c1e9-27d6-45c9-96ab-722055d6840e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:00.342328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:00.347169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:00.347652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:00.373352 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] Creating event network-vif-deleted:c4a4c1e9-27d6-45c9-96ab-722055d6840e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:54:00.388210 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d467a39f-f767-436b-8115-1687f1beb224 req-0f663808-8ffb-46b6-9bd2-ba93b8595514 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093475 Sep 14 09:54:00.389204 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3341/4570] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:00.471381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:00.472824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:00.504404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:00.505021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:00.505457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:00.506216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:00.506675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:00.507668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:00.591219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-unplugged", "status": "completed", "tag": "4bf16b4c-2b78-4a74-ba97-6d3324f7804e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:00.621192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:00.623292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:00.624084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:00.655647 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] Creating event network-vif-unplugged:4bf16b4c-2b78-4a74-ba97-6d3324f7804e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:54:00.677382 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d66437f0-6d0a-458d-89da-f96af02c110e req-efb55c52-9c21-48f6-8121-73772ed4c576 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091032 Sep 14 09:54:00.681201 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3342/4571] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:54:01.784523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:01.801206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:01.806180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:01.809394 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-36ec12ac-c35e-496f-bea8-032884239e8e tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 2210 microversion: 2.42 time: 1.342059 Sep 14 09:54:01.816590 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1230/4572] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:00 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 2210 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:02.506317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-deleted", "tag": "4bf16b4c-2b78-4a74-ba97-6d3324f7804e"}, {"server_uuid": "b1d9e66d-7bc1-4d71-8aa3-0929a9872b66", "name": "network-vif-deleted", "tag": "62f138f2-9474-49d5-9e39-c258023394ad"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:02.559569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:02.567314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:02.571471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:02.612576 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Creating event network-vif-deleted:4bf16b4c-2b78-4a74-ba97-6d3324f7804e for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:54:02.617366 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] Creating event network-vif-deleted:62f138f2-9474-49d5-9e39-c258023394ad for instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 on n-h2-851028-12 Sep 14 09:54:02.631167 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-79dbe954-1dfa-432f-813a-6e06641558c8 req-c5bfa900-c706-4385-af89-4d20806d7e19 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.128319 Sep 14 09:54:02.642405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3343/4573] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:02.849285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:02.850638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:02.879325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:02.880000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:02.880452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:02.900465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:02.901456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:02.902088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:03.364685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:03.385990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:03.387554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:03.391539 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a36e3765-6c90-43a5-8d79-cd770bdcc68f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.546450 Sep 14 09:54:03.415817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1231/4574] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:02 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:54:03.671722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8369aa7-52ad-4b2e-8309-fcc7dc25de8c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: .version_select at 0x7f693e1463a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1837510637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAca4TpL8X81Rfu91k5a4bFFgcCGi+dDbZpbKz4N9QPTGmvyIlwCkWDcC6ke8x0UsDjhiuxGcQJzZ1D1oyA2NsMiJ9GD+01xxuWQK+5WvP6fA9dBoXol1ZcfP/iRxxaFg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:03.726419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b8369aa7-52ad-4b2e-8309-fcc7dc25de8c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:03.762091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b8369aa7-52ad-4b2e-8309-fcc7dc25de8c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:03.826010 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8369aa7-52ad-4b2e-8309-fcc7dc25de8c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.158170 Sep 14 09:54:03.827314 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3344/4575] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:54:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:04.425264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:04.426040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:04.461539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:04.469095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:04.469556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:04.470326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:04.470783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:04.477173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:04.731946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:04.754951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:04.756738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:04.768645 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4663a97b-ffa6-4242-9828-91f7920fefb8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.344724 Sep 14 09:54:04.782090 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1232/4576] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:04 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:05.809108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:05.809108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:05.818893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:05.830709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:05.832492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:05.836973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:05.837724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:05.838327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:06.091434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:06.112118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:06.113614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:06.122934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25258d1f-f72b-4782-ab46-4826409d7663 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.325640 Sep 14 09:54:06.132085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3345/4577] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:05 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:07.166710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:07.167380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:07.190423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:07.209595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:07.211369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:07.213890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:07.214704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:07.215613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:07.520248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:07.538223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-209913705", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "89ff030e-06eb-4998-a676-7a520818a987"}], "key_name": "tempest-TestNetworkBasicOps-1837510637", "security_groups": [{"name": "tempest-secgroup-smoke-1498041540"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:07.547708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:07.566147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:07.567792 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5c7df26f-b51b-4d8b-8ed6-c02260981522 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.411764 Sep 14 09:54:07.573840 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1233/4578] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:07 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:08.059833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] validate_networks() for [('89ff030e-06eb-4998-a676-7a520818a987', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:54:08.602464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:08.603489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:08.623916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:08.624587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:08.625251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:08.631634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:08.632978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:08.634171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:08.841262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:08.854289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:08.869387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:08.872348 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3db232a4-0c16-4cce-8c04-90c55ff73862 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.273815 Sep 14 09:54:08.879169 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1234/4579] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:08 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:54:09.910398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:09.911086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:09.925137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:09.925645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:09.926094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:09.928753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:09.946816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:09.949809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:10.077881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:10.101959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:10.103984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:10.105468 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a1976448-3883-4788-bdc3-12aa757f00b8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.199687 Sep 14 09:54:10.110509 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1235/4580] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:09 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:10.946580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:54:10.947175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:54:10.947467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:54:10.948048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:54:10.948468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:54:10.968401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:10.968942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:10.969387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:10.970122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:10.970621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:10.971050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:11.059717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:11.068205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Getting quotas for user 13c2892aa35c48dcb9cb118a3adba2d0 and project ed86cc38b95f4d60a3ee548165c1a90c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:11.100176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:54:11.105742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:54:11.157177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:11.159047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:11.207297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:11.209177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:11.213742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:11.215971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:11.217921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:11.222628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:11.252337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf91b36c-2bce-4f6d-a474-2b64d639d800 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.717456 Sep 14 09:54:11.255869 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3346/4581] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:54:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 3722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:54:11.284731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdb9853b-cc9b-446f-8865-958b091fe04c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:11.289678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdb9853b-cc9b-446f-8865-958b091fe04c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:11.425580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:11.444403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:11.448094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:11.454556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cdb9853b-cc9b-446f-8865-958b091fe04c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:11.459827 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-526dfe91-b87c-4a80-837a-983fbac7e0d5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.321745 Sep 14 09:54:11.465920 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1236/4582] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:11 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:11.482650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdb9853b-cc9b-446f-8865-958b091fe04c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1248 microversion: 2.1 time: 0.221037 Sep 14 09:54:11.483832 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3347/4583] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:11 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1248 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:12.531673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:12.533891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c580c46-962f-4a19-abf1-37830c6ccb4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:12.536168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c580c46-962f-4a19-abf1-37830c6ccb4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:12.536449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:12.573394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:12.579672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:12.588867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:12.589954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:12.591964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:12.592589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:12.703992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c580c46-962f-4a19-abf1-37830c6ccb4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:12.719528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c580c46-962f-4a19-abf1-37830c6ccb4c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1248 microversion: 2.1 time: 0.190284 Sep 14 09:54:12.721623 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3348/4584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:12 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1248 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:12.782861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:12.799861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:12.802263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:12.803823 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-026d9510-bca9-408b-aeb1-041587ec7b99 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.281966 Sep 14 09:54:12.805854 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1237/4585] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:12 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:13.769349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:13.769970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:13.799542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:13.800095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:13.803246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:13.804434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:13.805308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:13.805774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:13.855238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:13.856429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:13.895421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:13.895963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:13.899751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:13.900721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:13.901284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:13.901823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:14.002111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:14.019258 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7513286-c32b-44cc-a98a-f99bd183052d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1300 microversion: 2.1 time: 0.254522 Sep 14 09:54:14.025654 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3349/4586] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:13 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:14.122466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:14.137030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:14.146555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:14.151119 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b4041194-354b-410f-ac26-04b43df4b83c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.301750 Sep 14 09:54:14.152788 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1238/4587] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:13 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:54:15.055677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:15.056932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:15.071569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:15.072485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:15.073686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:15.074582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:15.075215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:15.076882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:15.182800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:15.184050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:15.197390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:15.198067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:15.198664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:15.200443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:15.206519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:15.207211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:15.349905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:15.365987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:15.368611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:15.370090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7d3f00a8-d2c4-4818-878b-fceeabf49f71 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.191388 Sep 14 09:54:15.386481 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1239/4588] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:15 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:15.427576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:15.441222 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef8d32fd-196a-42ff-a65d-12edb22dbdb9 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1306 microversion: 2.1 time: 0.389496 Sep 14 09:54:15.441857 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3350/4589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:15 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1306 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:54:16.411299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:16.412517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:16.421684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.426011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.428466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.430097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.432528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.433146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.457217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:16.471770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:16.473022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:16.488661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.490550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.490550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.493234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:16.494982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:16.506722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:16.586750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:16.608067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:16.614246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:16.615647 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97e87b94-0ca8-4af3-8b8d-23b837032a5b tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.215955 Sep 14 09:54:16.642051 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1240/4590] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:16 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:16.914028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:16.938447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aab6bbed-7d74-48ad-9f64-4cb20f31204d tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.470645 Sep 14 09:54:16.939296 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3351/4591] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:16 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:17.473595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee53fc9-4007-43c6-965c-1344190e61d5", "tag": "75b59d6b-a681-4a38-8027-ede1835233f0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:17.519818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:17.520412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:17.520860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:17.571554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] Creating event network-changed:75b59d6b-a681-4a38-8027-ede1835233f0 for instance 7ee53fc9-4007-43c6-965c-1344190e61d5 on n-h1-851028-12 Sep 14 09:54:17.589390 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-09083531-c0ae-41ec-8b92-66a6bfe1c11e req-c113fdd4-9cae-4d6a-a06f-ea35720da263 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118834 Sep 14 09:54:17.594235 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1241/4592] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:17.650799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:17.651486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:17.665369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:17.665881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:17.666328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:17.667942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:17.669981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:17.671292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:17.832093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:17.854135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:17.858195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:17.860673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bbb59a6-f7a0-47c7-8f14-b72a06ee366c tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.214915 Sep 14 09:54:17.871066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3352/4593] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:17 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:17.962145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:17.962862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:17.972347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:17.975480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:17.980840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:17.981894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:17.982543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:17.986536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:18.322823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:18.333482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-04734c5d-c658-47da-828c-b1a1cf60a91a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.375408 Sep 14 09:54:18.348482 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1242/4594] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:17 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:18.903174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:18.904157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:18.910801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:18.911816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:18.912387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:18.913789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:18.914523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:18.915208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:19.002914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:19.015306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:19.017752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:19.019244 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b616ee8-2c4d-4e16-98a7-592fdfcabbd4 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.119968 Sep 14 09:54:19.036918 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3353/4595] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:18 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:19.360899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:19.362299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:19.370567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:19.379691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:19.380829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:19.381478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:19.382777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:19.383660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:19.384844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:19.648844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:19.666948 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f82c754-612d-47ac-aec7-1f23f5080bd3 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.310050 Sep 14 09:54:19.670226 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1243/4596] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:19 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:20.049289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:20.050790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:20.065770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:20.067684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.071705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.072434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:20.073344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.073957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.075528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:20.087486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=62 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:20.224132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:20.245916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:20.248775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:20.250500 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b31f810-3a2a-4216-9345-6d0b5e5a33d8 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.205387 Sep 14 09:54:20.272407 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3354/4597] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:20 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:20.693219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:20.694358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:20.708528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.709182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.709766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:20.710695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:20.711382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:20.714598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:21.068885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:21.081557 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a76df084-851b-4b59-beaf-c7c4609c7213 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.392056 Sep 14 09:54:21.083662 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1244/4598] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:20 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:21.278598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:21.280162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:21.283768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:21.291237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:21.292323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:21.293201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:21.294149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:21.294821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:21.295473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:21.797409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:21.808454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:21.811632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:21.813142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c295ed02-15dc-4d59-89a8-8e57e9e17347 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.538448 Sep 14 09:54:21.814235 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3355/4599] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:21 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:22.125216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:22.128438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:22.152404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:22.152925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:22.153477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:22.156022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:22.157164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:22.158529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:22.458050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:22.470566 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e57d93d6-43a6-461f-b7c8-007d09948751 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.365336 Sep 14 09:54:22.471557 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1245/4600] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:22 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:22.842805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:22.843449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:22.846529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=14 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:22.858848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:22.859350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:22.860089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:22.860794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:22.861413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:22.864898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.023600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:23.062364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:23.067436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:23.069199 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dede4ae3-472f-4d8c-9176-5cad052b3731 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.230721 Sep 14 09:54:23.088846 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3356/4601] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:22 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:23.487835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee53fc9-4007-43c6-965c-1344190e61d5", "name": "network-vif-plugged", "status": "completed", "tag": "75b59d6b-a681-4a38-8027-ede1835233f0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:23.500044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:23.501024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:23.514131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:23.515732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:23.519233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.522076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:23.523238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:23.528673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.530144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:23.530854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:23.535396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:23.573081 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] Creating event network-vif-plugged:75b59d6b-a681-4a38-8027-ede1835233f0 for instance 7ee53fc9-4007-43c6-965c-1344190e61d5 on n-h1-851028-12 Sep 14 09:54:23.604718 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-84b873b4-10bc-4d3f-8581-ceff4c089d90 req-2ef6b950-64c7-42cf-9657-bcd38687a66a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116744 Sep 14 09:54:23.608079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1246/4602] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:23.772269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:23.781913 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-28d77b20-a885-47fd-9a83-9ba7015b5a8e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.286623 Sep 14 09:54:23.783075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3357/4603] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:23 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:54:24.107571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:24.108976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:24.117669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.118180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.118798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:24.119809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.120462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.120894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:24.208301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:24.224975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:24.228080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:24.229790 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-49a1f46f-2061-4fa9-9550-4a3bfc5f372a tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.127228 Sep 14 09:54:24.230862 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1247/4604] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:24 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:24.814970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:24.817558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:24.829617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.830428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.831078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:24.832130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:24.832794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:24.836201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:25.145871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:25.159266 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d451d43-a87f-472b-8a40-c64c8bbc6bb1 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1374 microversion: 2.1 time: 0.352283 Sep 14 09:54:25.173476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3358/4605] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:24 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1374 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:54:25.259296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:25.261554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:25.269563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:25.270158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:25.271201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:25.277147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:25.277650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:25.278102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:25.390192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:25.406873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:25.410157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:25.412999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e994053c-7011-4b06-aae2-532ae48285df tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.158265 Sep 14 09:54:25.415186 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1248/4606] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:25 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:26.185860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:26.186471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:26.206791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.207528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.208139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.208999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.209596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.210167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.415766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.429212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3bfbf98b-3a64-48e8-952f-6635a8a7bdf4 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1547 microversion: 2.1 time: 0.246001 Sep 14 09:54:26.430128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3359/4607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:26 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1547 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:26.455779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:26.463233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:26.464157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:26.464860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:26.474898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.479761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.480637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.480846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.481809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.482318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.482937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.483613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.485730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:26.486115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.486776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:26.488161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:26.621881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.655934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.659587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.663574 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40b0796d-c51d-40d5-a5f5-7983a3d04a03 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.211332 Sep 14 09:54:26.665064 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1249/4608] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:26 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:26.719132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:26.727277 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20f6b432-5a93-484c-93ee-9a53fb7b021c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1547 microversion: 2.1 time: 0.269724 Sep 14 09:54:26.727855 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3360/4609] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:26 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1547 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:27.692684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:27.693308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:27.708923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:27.714997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:27.715981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:27.716944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:27.717620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:27.718234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:27.839388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:27.864990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:27.870428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:27.872107 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fbe8760e-28ee-4b46-9e1a-fb50c70cbe36 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1604 microversion: 2.42 time: 0.184214 Sep 14 09:54:27.876733 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1250/4610] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:27 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:28.901124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:28.901742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:28.911016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:28.912019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:28.912569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:28.913430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:28.914015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:28.914544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:28.952564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:28.953157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:28.953678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:28.954209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lazy-loading 'fault' on Instance uuid b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:54:29.030872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:29.044178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:29.045818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'daace12fcd1a407784d449d118b05e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd910602cfc27484496a75e9c30aba211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:29.047594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ace4b7bd-b3b0-4ce3-824e-91803e37b035 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 200 len: 1609 microversion: 2.42 time: 0.151477 Sep 14 09:54:29.048454 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3361/4611] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:28 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 1609 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:54:30.044745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee53fc9-4007-43c6-965c-1344190e61d5", "tag": "75b59d6b-a681-4a38-8027-ede1835233f0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:30.059108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.060062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.060898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.079033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:30.081282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:30.088980 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] Creating event network-changed:75b59d6b-a681-4a38-8027-ede1835233f0 for instance 7ee53fc9-4007-43c6-965c-1344190e61d5 on n-h1-851028-12 Sep 14 09:54:30.112083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.112983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.115535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.116649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:30.117711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:30.118219 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-47650608-86ec-4d15-b03d-9580b100ae04 req-ea6a19d2-4a79-4dfa-8338-058d7c943afc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076803 Sep 14 09:54:30.119766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:30.120400 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1251/4612] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:30.140654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] HTTP exception thrown: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Request method failure captured: Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 HTTP/1.1 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaJT64NPLXQ2FZinPJcpkVNoOBIBxp--hSrbWFjRxnSu9sxWD7kJl-XdDw2kJee31gMj_O5A-Ukb7tjTZVHK66CDhH4nKHNLRNMPTBBZDscnb2GVrW0DHtpBUfqR0zaEpirTUOBazZo-uJDNhcuMrkat_iXuaNXTnK5YxztIWoNpP4s Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d910602cfc27484496a75e9c30aba211", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d910602cfc27484496a75e9c30aba211"}]}] Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: daace12fcd1a407784d449d118b05e16 Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b1d9e66d-7bc1-4d71-8aa3-0929a9872b66'} Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:30.142720 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:30.146443 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:30.149013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Returning 404 to user: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:54:30.150277 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1860754-b686-4f20-92e3-6732f3da4db5 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 404 len: 111 microversion: 2.42 time: 0.077244 Sep 14 09:54:30.151450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3362/4613] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:30 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 14 09:54:30.161423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-09668615-19ed-40c2-ba1d-c5b10f485ade tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '.version_select at 0x7f693f5580d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:30.210470 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-09668615-19ed-40c2-ba1d-c5b10f485ade tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568626865" status: 204 len: 0 microversion: 2.42 time: 0.054292 Sep 14 09:54:30.217046 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1252/4614] 10.222.0.90 () {60 vars in 1262 bytes} [Wed Sep 14 09:54:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568626865 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 09:54:36.303831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:36.305245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:36.327739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:36.330501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:36.330971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:36.331726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:36.337339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:36.337841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:36.381855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] HTTP exception thrown: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Request method failure captured: Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 HTTP/1.1 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaJT64NPLXQ2FZinPJcpkVNoOBIBxp--hSrbWFjRxnSu9sxWD7kJl-XdDw2kJee31gMj_O5A-Ukb7tjTZVHK66CDhH4nKHNLRNMPTBBZDscnb2GVrW0DHtpBUfqR0zaEpirTUOBazZo-uJDNhcuMrkat_iXuaNXTnK5YxztIWoNpP4s Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d910602cfc27484496a75e9c30aba211", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d910602cfc27484496a75e9c30aba211"}]}] Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: daace12fcd1a407784d449d118b05e16 Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b1d9e66d-7bc1-4d71-8aa3-0929a9872b66'} Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:54:36.385008 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Returning 404 to user: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:54:36.389388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94350a77-32cf-47db-8e12-c40d77292c70 tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 404 len: 111 microversion: 2.42 time: 0.093695 Sep 14 09:54:36.393529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3363/4615] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:54:36 2022] DELETE /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:54:36.399104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:36.399871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] [instance: b1d9e66d-7bc1-4d71-8aa3-0929a9872b66] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:36.410289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:36.411069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:36.411683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:36.412593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:36.413345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:36.414922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:36.436196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] HTTP exception thrown: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Request method failure captured: Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 HTTP/1.1 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaJT64NPLXQ2FZinPJcpkVNoOBIBxp--hSrbWFjRxnSu9sxWD7kJl-XdDw2kJee31gMj_O5A-Ukb7tjTZVHK66CDhH4nKHNLRNMPTBBZDscnb2GVrW0DHtpBUfqR0zaEpirTUOBazZo-uJDNhcuMrkat_iXuaNXTnK5YxztIWoNpP4s Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.42 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d910602cfc27484496a75e9c30aba211", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d910602cfc27484496a75e9c30aba211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d910602cfc27484496a75e9c30aba211"}]}] Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d910602cfc27484496a75e9c30aba211 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-739230354 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: daace12fcd1a407784d449d118b05e16 Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TaggedBootDevicesTest_v242-739230354-project Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b1d9e66d-7bc1-4d71-8aa3-0929a9872b66'} Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.438181 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. Sep 14 09:54:36.442685 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:54:36.444323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] Returning 404 to user: Instance b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:54:36.445839 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f1b70a51-9794-4508-99f8-86ea9f36b77f tempest-TaggedBootDevicesTest_v242-739230354 tempest-TaggedBootDevicesTest_v242-739230354-project] 10.222.0.90 "GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66" status: 404 len: 111 microversion: 2.42 time: 0.051739 Sep 14 09:54:36.450862 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1253/4616] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:54:36 2022] GET /compute/v2.1/servers/b1d9e66d-7bc1-4d71-8aa3-0929a9872b66 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:54:39.338424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e047f88-26f6-4bad-9f09-0bc9e9d2469e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Action: 'create', calling method: .version_select at 0x7f693dd35f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1557429075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhlnwaxIe0020I7WPcgVU2RFCk34oy8g+zoU+k38JR9cuOeYcnSuPUvdhPQDAZvIDOjaKQPdmHYDe+ZkXvCsZoTA1Ox3xGUKvpDwE8Yky/e2ydKw+YaISyv7dNhshFOOg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:39.356906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2e047f88-26f6-4bad-9f09-0bc9e9d2469e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for project 5368428be82f4fb6933ec75a1d410e31. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:39.363395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2e047f88-26f6-4bad-9f09-0bc9e9d2469e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for user ee09acc6e8184849bf71cbe9bebc0ec3 and project 5368428be82f4fb6933ec75a1d410e31. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:39.394406 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e047f88-26f6-4bad-9f09-0bc9e9d2469e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.336271 Sep 14 09:54:39.404065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3364/4617] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:54:39 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:54:50.729378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:50.731604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:50.743492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:50.744243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=59 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:50.757786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:50.758517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:50.759135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:50.760061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:50.760683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:50.761524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:50.873800 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0467a069-45fa-4098-9db9-1e4d8872039e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5/action" status: 200 len: 24569 microversion: 2.1 time: 0.149309 Sep 14 09:54:50.878752 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1254/4618] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:54:50 2022] POST /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5/action => generated 24569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:54:51.673001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1953297975-access_point-165169242", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "cdd804c3-f0cd-41bf-a977-1400d0372fef"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1557429075", "security_groups": [{"name": "tempest-secgroup_access--2139509243"}, {"name": "tempest-secgroup_general--1778821567"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:51.703709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=53 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:51.707280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:51.718474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:54:52.231824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] validate_networks() for [('cdd804c3-f0cd-41bf-a977-1400d0372fef', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:54:53.619654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:54:53.626775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:54:53.627757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:54:53.628390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:54:53.629709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:54:53.675103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:53.675633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:53.678645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:53.687943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:53.690373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:53.693096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:53.769345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for project 5368428be82f4fb6933ec75a1d410e31. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:54:53.794326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for user ee09acc6e8184849bf71cbe9bebc0ec3 and project 5368428be82f4fb6933ec75a1d410e31. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:54:53.859192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:54:53.862235 n-d-851028-12 devstack@n-api.service[122444]: WARNING nova.utils [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1953297975-access_point-165169242 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1953297975-ac Sep 14 09:54:53.863029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:54:54.082160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5207065f-8ea5-4e33-b5e7-dbe1bcf377ed tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.413179 Sep 14 09:54:54.088271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3365/4619] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:54:51 2022] POST /compute/v2.1/servers => generated 458 bytes in 2420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:54:54.099089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-403775e8-835f-4a20-a43b-f9178c828daa tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:54.120084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-403775e8-835f-4a20-a43b-f9178c828daa tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:54.343626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-403775e8-835f-4a20-a43b-f9178c828daa tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:54.354844 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-403775e8-835f-4a20-a43b-f9178c828daa tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1294 microversion: 2.1 time: 0.263473 Sep 14 09:54:54.375935 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1255/4620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:54 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1294 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:55.390274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:55.391622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:55.404521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:55.409190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:55.412029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:55.415155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:55.419819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:55.421069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:55.596403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:55.608476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89e6b840-b062-4f60-8000-70eaa23c7216 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1346 microversion: 2.1 time: 0.223428 Sep 14 09:54:55.609455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3366/4621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:55 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:56.641807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:56.643055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:56.660966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:56.662788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:56.663254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:56.664573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:56.665031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:56.677712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:56.996266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:57.010764 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9c29d2b-b477-4133-a9a5-22a74c2f65c9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1352 microversion: 2.1 time: 0.372463 Sep 14 09:54:57.014006 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1256/4622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:56 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1352 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:57.477945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:54:57.480496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:57.504238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:57.504734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:57.505177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:57.506117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:57.506585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:57.522358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:57.638572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4218f2b7-8337-4b6a-98a2-72dc16a1313a tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "POST /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5/action" status: 200 len: 32645 microversion: 2.1 time: 0.170063 Sep 14 09:54:57.639302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3367/4623] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:54:57 2022] POST /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5/action => generated 32645 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:54:58.050772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:58.060140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:58.093519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:58.094505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:58.097047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:58.098423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:58.099109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:58.099752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:58.388801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:54:58.410472 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9d4bce5-3520-494e-a2e8-678f3fec52b8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1352 microversion: 2.1 time: 0.368923 Sep 14 09:54:58.411661 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1257/4624] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:58 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1352 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:54:59.439348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:54:59.442563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:54:59.469119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:59.470843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:59.471355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:54:59.472193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:54:59.482163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:54:59.482822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:00.464920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:00.474945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:00.477263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c81ea390-8b00-4f07-bcc2-a99a2ea6bff6 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 1.041253 Sep 14 09:55:00.478003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:00.495239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:00.496023 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3368/4625] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:54:59 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:00.497677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:00.499094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:00.500106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:00.503374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:00.504327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:00.512337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee53fc9-4007-43c6-965c-1344190e61d5", "tag": "75b59d6b-a681-4a38-8027-ede1835233f0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:00.536253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:00.536773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:00.540360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:00.556639 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] Creating event network-changed:75b59d6b-a681-4a38-8027-ede1835233f0 for instance 7ee53fc9-4007-43c6-965c-1344190e61d5 on n-h1-851028-12 Sep 14 09:55:00.563584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-517926e9-ab10-4467-92be-a9a486e5acd3 req-c6b42758-9e63-492c-b47c-00772f908b88 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057029 Sep 14 09:55:00.567277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3369/4626] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:00.579760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:55:00.811100 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dc9d910c-1356-4536-8561-d99c3e5f438c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 204 len: 0 microversion: 2.1 time: 0.337904 Sep 14 09:55:00.812126 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1258/4627] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:55:00 2022] DELETE /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:55:00.823455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:00.824399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:00.853941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:00.854448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:00.865531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:00.866426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:00.874001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:00.874520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:01.521700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:01.522399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:01.534980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:01.574354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e089d76f-b631-4725-bea4-b6b8026a91c5 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1672 microversion: 2.1 time: 0.736266 Sep 14 09:55:01.576444 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3370/4628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:00 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1672 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:01.582070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:01.586789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:01.588304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:01.600706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:01.601829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:01.608773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.318276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:02.322515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:02.325053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:02.329091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.330177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:02.332729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:02.333404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.435674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2662b1fe-5ebb-4250-8e49-bc3463be411d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.477663 Sep 14 09:55:02.438684 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3371/4629] 10.222.0.90 () {58 vars in 1185 bytes} [Wed Sep 14 09:55:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:02.450351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18279dd9-b598-4b74-84f2-8c3fb60075ab", "tag": "9499b88d-9323-4f5f-9376-2cc881a7cbca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:02.495460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:02.495874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:02.504215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.541471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] Creating event network-changed:9499b88d-9323-4f5f-9376-2cc881a7cbca for instance 18279dd9-b598-4b74-84f2-8c3fb60075ab on n-h2-851028-12 Sep 14 09:55:02.551605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-17b825a1-9084-401b-a758-2b12ff448206 req-6dd4a53b-da1a-4f3c-ad7a-eb2683e68748 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111008 Sep 14 09:55:02.569467 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3372/4630] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:02.603705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:02.607420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:02.613767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:02.624202 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d5e61e7-94a9-439f-b1c0-80a0314c5c51 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 1.106709 Sep 14 09:55:02.625330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:02.626326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:02.626461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.632216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:02.633472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:02.633924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:02.636543 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1259/4631] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:01 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:02.739724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1284476040", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "availability_zone": "nova:n-h1-851028-12", "networks": [{"uuid": "f0a44995-6c6c-4f94-8e1b-9a58bd99d694"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:02.886042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] validate_networks() for [('f0a44995-6c6c-4f94-8e1b-9a58bd99d694', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:55:03.827652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:03.836415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:03.861567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-634c6361-70b1-4d9c-ab1d-9ca32f32992c tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1672 microversion: 2.1 time: 1.263053 Sep 14 09:55:03.865752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3373/4632] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:02 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1672 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:03.878311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:03.878944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:03.887266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:03.889620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:03.891823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:03.892818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:03.900770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:03.901611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.329052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:04.348201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-763f8524-7a1e-4ce8-ad57-d076424391de tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.481053 Sep 14 09:55:04.348980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:04.357283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3374/4633] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:03 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:04.456169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:55:04.457119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:55:04.458420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:55:04.459228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:55:04.459830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:55:04.478341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.480207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.481737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.482682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.484232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.485669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.543763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Getting quotas for project 82f453c75f2c4f66bbdf05891b104978. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:55:04.584682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Getting quotas for user aab1aea454344cf78ca613217358b01b and project 82f453c75f2c4f66bbdf05891b104978. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:55:04.637450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:55:04.639382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:55:04.729482 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [be59cc52-97ae-4966-8931-cdc730e22819] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 09:55:04.735112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee53fc9-4007-43c6-965c-1344190e61d5", "name": "network-vif-deleted", "tag": "75b59d6b-a681-4a38-8027-ede1835233f0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:04.764471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.765560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.768776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.819030 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] Creating event network-vif-deleted:75b59d6b-a681-4a38-8027-ede1835233f0 for instance 7ee53fc9-4007-43c6-965c-1344190e61d5 on n-h1-851028-12 Sep 14 09:55:04.829369 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-89a151aa-095f-4361-9c17-c4bbd324c407 req-68df31ac-889c-4608-98c0-d2e96951662a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099634 Sep 14 09:55:04.832649 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3375/4634] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:04.891953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:04.892932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:04.902743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.903539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.904196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.905368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.906073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.907064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.953895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:04.954674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:04.955284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:04.955803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lazy-loading 'fault' on Instance uuid 7ee53fc9-4007-43c6-965c-1344190e61d5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:55:05.023402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13c2892aa35c48dcb9cb118a3adba2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed86cc38b95f4d60a3ee548165c1a90c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:05.035881 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b776b75-d85a-492b-a025-5132ed0f520e tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 200 len: 1338 microversion: 2.1 time: 0.149330 Sep 14 09:55:05.036988 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3376/4635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:04 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:05.390596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:05.391209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:05.399321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:05.405410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:05.406096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:05.406857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:05.407317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:05.408268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:05.622486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:05.631285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-212b39d5-0b87-4d75-b8b0-2ae4d849061e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.244500 Sep 14 09:55:05.632363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3377/4636] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:05 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:05.741166 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [be59cc52-97ae-4966-8931-cdc730e22819] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 41792. Sep 14 09:55:05.760777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-047446eb-05ae-4dbf-9978-fb8ac8bb0e86 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.025028 Sep 14 09:55:05.763864 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1260/4637] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:55:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:55:05.774465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5d643eca-8be0-48ae-baf6-9af89aa66e38 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:05.775079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5d643eca-8be0-48ae-baf6-9af89aa66e38 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:05.866064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5d643eca-8be0-48ae-baf6-9af89aa66e38 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1329 microversion: 2.1 time: 0.095881 Sep 14 09:55:05.872630 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3378/4638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:05 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:06.063154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:06.063784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] [instance: 7ee53fc9-4007-43c6-965c-1344190e61d5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:06.076710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.077216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.078968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:06.079876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.081188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.084054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:06.122271 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] HTTP exception thrown: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Request method failure captured: Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 HTTP/1.1 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaQtuS5Rjq93UO7UiQsjIEeyC6fSwSbepbKr4VqyOSbs_gHeXnwWccFRmKTt90ib6hg35HTjroXkKohRpulDtY-YLDOmTHKt7W3CxvaM6NL9Dtli7oTIVYFK5L4wPDiwdsFNqFG23P6ghxW-DKmlCp_oBSqegZtqcfeXaIVQajojyQ0 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ed86cc38b95f4d60a3ee548165c1a90c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ed86cc38b95f4d60a3ee548165c1a90c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ed86cc38b95f4d60a3ee548165c1a90c"}]}] Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkBasicOps-834621470 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ed86cc38b95f4d60a3ee548165c1a90c Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkBasicOps-834621470 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 13c2892aa35c48dcb9cb118a3adba2d0 Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkBasicOps-834621470-project Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '7ee53fc9-4007-43c6-965c-1344190e61d5'} Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:06.128648 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. Sep 14 09:55:06.133527 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:06.141819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Returning 404 to user: Instance 7ee53fc9-4007-43c6-965c-1344190e61d5 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:06.146910 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5a13cab-7b1f-4b80-aa90-25d73959ea5f tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5" status: 404 len: 111 microversion: 2.1 time: 0.087641 Sep 14 09:55:06.148846 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1261/4639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:06 2022] GET /compute/v2.1/servers/7ee53fc9-4007-43c6-965c-1344190e61d5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:55:06.434233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b363dc53-6d9e-469d-b768-6d6d431f3dc7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] Calling method '.version_select at 0x7f693dd5aca0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:06.512951 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b363dc53-6d9e-469d-b768-6d6d431f3dc7 tempest-TestNetworkBasicOps-834621470 tempest-TestNetworkBasicOps-834621470-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1837510637" status: 202 len: 0 microversion: 2.1 time: 0.084286 Sep 14 09:55:06.513595 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3379/4640] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 09:55:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1837510637 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:55:06.658931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:06.660130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:06.676962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.677569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.678163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:06.679216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.680104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.680644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:06.903837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:06.905231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:06.922442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.935716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.957561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:06.970990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:06.971682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:06.974068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:07.262912 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-160cf4c3-e6e1-4d24-98a2-2a29845a80c0 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1346 microversion: 2.1 time: 0.371564 Sep 14 09:55:07.263532 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3380/4641] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:06 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1346 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:07.363966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:07.373304 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64d1cafc-852a-42ec-9fe0-fb0324c9bf7e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.721120 Sep 14 09:55:07.384411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1262/4642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:06 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:08.292048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:08.293407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:08.329098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:08.330575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:08.331294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:08.332514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:08.333258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:08.333899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:08.410749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:08.411377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:08.431148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:08.431642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:08.432123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:08.432858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:08.433320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:08.433752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:08.478784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b58080c-c368-4b2e-8966-8748a603eb69 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1424 microversion: 2.1 time: 0.190935 Sep 14 09:55:08.483945 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3381/4643] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:08 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1424 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:08.936657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:08.948713 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6722fbd-fb28-4be7-9b71-7fb68291f025 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.541648 Sep 14 09:55:08.954479 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1263/4644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:08 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:09.506694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:09.508892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:09.516581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:09.517427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:09.518077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:09.519001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:09.519651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:09.520317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:09.846080 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7a2e672-f5a7-4118-91c8-d12708ac2d1d tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1424 microversion: 2.1 time: 0.341553 Sep 14 09:55:09.849254 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3382/4645] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:09 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1424 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:09.973866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:09.974935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:09.986938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:09.987547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:09.988133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:09.988961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:09.989521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:09.991009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:09.999627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18279dd9-b598-4b74-84f2-8c3fb60075ab", "name": "network-vif-plugged", "status": "completed", "tag": "9499b88d-9323-4f5f-9376-2cc881a7cbca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:10.029244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:10.029923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:10.034698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:10.072888 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] Creating event network-vif-plugged:9499b88d-9323-4f5f-9376-2cc881a7cbca for instance 18279dd9-b598-4b74-84f2-8c3fb60075ab on n-h2-851028-12 Sep 14 09:55:10.080557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e29ffb25-599a-4edb-a7b3-55431a6c07ff req-a4c0296e-06a0-4e37-bcb3-d2a72b968e2e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085021 Sep 14 09:55:10.088324 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3383/4646] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:10.601763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:10.611882 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc15fccd-0b3b-4054-9b12-5dc867e98c77 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.641331 Sep 14 09:55:10.613312 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1264/4647] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:09 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:10.876752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:10.880133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:10.900169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:10.900169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:10.900499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:10.902322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:10.904101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:10.905940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:11.312683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c14d8e4d-d219-4b92-b6aa-6875043318f8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.443962 Sep 14 09:55:11.313399 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3384/4648] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:10 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:11.641056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:11.642629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:11.668295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:11.671252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:11.688533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:11.689328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:11.689835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:11.690262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:11.715383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38539bf2-0fce-4c71-bcde-3766a052d3ff", "tag": "201b550c-46ea-49d9-b8c2-018c5913411b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:11.750692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:11.751280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:11.751729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:11.788284 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] Creating event network-changed:201b550c-46ea-49d9-b8c2-018c5913411b for instance 38539bf2-0fce-4c71-bcde-3766a052d3ff on n-h1-851028-12 Sep 14 09:55:11.817086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ff2543ee-df5c-42e2-be62-39108faff655 req-d8c10cc2-7687-4b44-8cd3-c29a6596d643 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106141 Sep 14 09:55:11.817708 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3385/4649] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:12.151141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:12.163479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51039adf-5b4c-43e0-8c1c-c3ad49ee1730 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1472 microversion: 2.1 time: 0.526812 Sep 14 09:55:12.164507 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1265/4650] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:11 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1472 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:12.339924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:12.341057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:12.349860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:12.359136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:12.362334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:12.362953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:12.365925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:12.366497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:12.367213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:12.777398 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a75c748-2dc6-4d2e-8f70-2e0915dcc058 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.443023 Sep 14 09:55:12.780999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3386/4651] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:12 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:13.190639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:13.191253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:13.206229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.206733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.207171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.207924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.208378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.208803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.473513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:13.483398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ccd521b-7df9-4952-ab2d-bb22f87f1da3 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1643 microversion: 2.1 time: 0.296632 Sep 14 09:55:13.484719 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1266/4652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:13 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1643 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:13.507079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:13.507736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:13.514982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.515667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.516432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.517427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.518054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.518924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.799982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:13.800868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:13.808885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.809549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.810167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.811239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.811855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.812562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.817268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:13.826452 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51e2b01e-3bdd-4b97-b42f-7bc615e426e1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1643 microversion: 2.1 time: 0.323210 Sep 14 09:55:13.830493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3387/4653] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:13 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1643 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:13.858445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:13.859335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:13.874437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.877618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.879814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.880680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:13.882040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:13.884296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:13.892953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:14.426993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-352a8d99-bf8b-421e-9d45-eb5d0233e481 tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1796 microversion: 2.1 time: 0.577950 Sep 14 09:55:14.427604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3388/4654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:13 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1796 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:14.507938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:14.559669 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35058ad6-b8bc-4ea3-bae2-86e896190a7b tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.763256 Sep 14 09:55:14.576526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1267/4655] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:13 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:15.598528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:15.599145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:15.615688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:15.616314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:15.617186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:15.618603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:15.619345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:15.620502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:15.862890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:15.942393 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94ee8997-97c1-4bcf-b0bc-1d2f1614e711 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.347492 Sep 14 09:55:15.948233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3389/4656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:15 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:16.974616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:16.975362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:16.989415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:17.000167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:17.000844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:17.001363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:17.003958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:17.006512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:17.007690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:17.028481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18279dd9-b598-4b74-84f2-8c3fb60075ab", "tag": "9499b88d-9323-4f5f-9376-2cc881a7cbca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:17.054208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:17.055575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:17.057429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:17.084419 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] Creating event network-changed:9499b88d-9323-4f5f-9376-2cc881a7cbca for instance 18279dd9-b598-4b74-84f2-8c3fb60075ab on n-h2-851028-12 Sep 14 09:55:17.104317 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-50e7cdea-82db-4bed-9b59-f6234c205355 req-afb2ae2a-679e-4277-bcf2-abea9462385c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079132 Sep 14 09:55:17.106943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3390/4657] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:17.714811 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-364a26b9-6bd1-4191-9f00-7b2b16fc6a74 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.743742 Sep 14 09:55:17.728226 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1268/4658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:16 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:17.970065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38539bf2-0fce-4c71-bcde-3766a052d3ff", "name": "network-vif-plugged", "status": "completed", "tag": "201b550c-46ea-49d9-b8c2-018c5913411b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:18.008343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:18.010131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:18.010912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:18.024981 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] Creating event network-vif-plugged:201b550c-46ea-49d9-b8c2-018c5913411b for instance 38539bf2-0fce-4c71-bcde-3766a052d3ff on n-h1-851028-12 Sep 14 09:55:18.031919 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5c6e3bf1-b241-4ad7-8455-7925c456bb21 req-95a445f9-192d-4b82-9718-64e89b8dd2c0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065817 Sep 14 09:55:18.033783 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3391/4659] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:18.738914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:18.739528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:18.759646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:18.760476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:18.761077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:18.761963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:18.762581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:18.763166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:19.246251 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7d8f7e85-92db-49b1-ba3b-5f504ef66ebb tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1466 microversion: 2.1 time: 0.510041 Sep 14 09:55:19.263198 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1269/4660] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:18 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1466 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:20.274091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:20.275667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:20.282248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.283543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.288139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:20.295460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.296249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.296876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:20.684505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8810a5ea-ce13-4104-9cec-cdd3aa6f0b7a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1651 microversion: 2.1 time: 0.417197 Sep 14 09:55:20.685347 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3392/4661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:20 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1651 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:20.712862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:20.714226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:20.722087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.722939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.723619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:20.724623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.725267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.725877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:20.904421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:20.910652 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f16f90d-9708-4e7b-a18a-fce2621ab6f4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1651 microversion: 2.1 time: 0.203003 Sep 14 09:55:20.911261 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1270/4662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:20 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1651 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:20.939052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:20.939715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:20.947278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.950218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.958556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:20.959552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:20.964965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:20.965652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:21.752238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a54d57d3-b3d5-4d3d-b9e6-e874ce9ffaba tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1651 microversion: 2.1 time: 0.817169 Sep 14 09:55:21.780709 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3393/4663] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:20 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1651 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:21.952270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1509328091", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "availability_zone": "nova:n-h2-851028-12", "networks": [{"uuid": "f0a44995-6c6c-4f94-8e1b-9a58bd99d694"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:21.978798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:22.066901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] validate_networks() for [('f0a44995-6c6c-4f94-8e1b-9a58bd99d694', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:55:23.032386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:55:23.038351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:55:23.039728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:55:23.040710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:55:23.040928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:55:23.059978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:23.065553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:23.069900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:23.070604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:23.071087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:23.071523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:23.137467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Getting quotas for project 82f453c75f2c4f66bbdf05891b104978. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:55:23.158059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Getting quotas for user aab1aea454344cf78ca613217358b01b and project 82f453c75f2c4f66bbdf05891b104978. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:55:23.215282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:55:23.225128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:55:23.340743 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5fc3af7a-b0c8-41f6-94fa-0d0221d811b1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394125 Sep 14 09:55:23.349263 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1271/4664] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:55:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:55:23.352994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e95e910c-857f-4518-9e87-648c8fc8261f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:23.354377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e95e910c-857f-4518-9e87-648c8fc8261f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:23.372995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:23.588526 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e95e910c-857f-4518-9e87-648c8fc8261f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1329 microversion: 2.1 time: 0.239237 Sep 14 09:55:23.595128 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3394/4665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:23 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1329 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:23.946178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1766261510", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "b00c160d-6532-40f2-bc58-b8644ccca63a"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:24.053722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] validate_networks() for [('b00c160d-6532-40f2-bc58-b8644ccca63a', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:55:24.617115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:24.621015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:24.644073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:24.644830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:24.645492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:24.646425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:24.648715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:24.649808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:24.934332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ebf75e0-0d92-4a29-8bed-612f5b18abe9 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1338 microversion: 2.1 time: 0.327018 Sep 14 09:55:24.935643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3395/4666] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:24 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1338 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:25.122197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:55:25.123580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:55:25.124351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:55:25.125096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:55:25.125750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:55:25.192190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:25.192677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:25.194523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:25.197077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:25.197581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:25.199333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:25.291690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Getting quotas for project 2ac67d16c1de4730a9b4455eec1a6a60. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:55:25.315221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Getting quotas for user 0d84b2a30a354962b9d92cdcd6255f11 and project 2ac67d16c1de4730a9b4455eec1a6a60. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:55:25.440279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:55:25.450206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:55:25.669787 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44a9cfc9-d3bc-4828-a9c3-25ef375de825 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.029373 Sep 14 09:55:25.676457 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1272/4667] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 09:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 09:55:25.684924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:25.685676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:25.936705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:25.959655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:25.960347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:25.965777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:25.967613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:25.969964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:25.970467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:25.970910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:25.971634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:25.972228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:25.972552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:25.974937 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4b1bc29-17d1-4648-b62b-5f9d80c8c829 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1259 microversion: 2.21 time: 0.296694 Sep 14 09:55:25.975552 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3396/4668] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:25 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1259 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:26.179425 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e3551ad-9c8a-46b4-830a-757085b69af8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1424 microversion: 2.1 time: 0.224629 Sep 14 09:55:26.180412 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1273/4669] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:25 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1424 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:27.009920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:27.010502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:27.038775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:27.045511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:27.045944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:27.049592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:27.051872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:27.052518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:27.204113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:27.204736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:27.216918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:27.217415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:27.217855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:27.218564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:27.219018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:27.219444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:27.596814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:27.613545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:27.617712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:27.627755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab7799c4-2927-45a7-95b7-b1a0d5855334 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1311 microversion: 2.21 time: 0.622914 Sep 14 09:55:27.628880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3397/4670] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:26 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1311 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:28.334317 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3dee84c9-68c6-49d1-9ed8-c5b49480455f tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 1.134037 Sep 14 09:55:28.359111 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1274/4671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:27 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:28.659455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:28.660175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:28.674707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:28.675207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:28.675647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:28.676400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:28.678726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:28.680452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:28.919220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:28.946886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:28.950674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:28.954498 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af2fbc6e-9199-4400-a9a2-8a0b3d761b94 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1317 microversion: 2.21 time: 0.299689 Sep 14 09:55:28.955106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3398/4672] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:28 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:29.324658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e137f-4d79-44d9-89d1-22cad4f56ac3", "tag": "833fbe0d-ae8e-434d-b7f9-dbf96f24845e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:29.363813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:29.364525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:29.378729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:29.390898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:29.394611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:29.396063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:29.404624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:29.404790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:29.405434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:29.409790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:29.412194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:29.461699 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] Creating event network-changed:833fbe0d-ae8e-434d-b7f9-dbf96f24845e for instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 on n-h2-851028-12 Sep 14 09:55:29.483279 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-dfa8a034-b114-4119-b733-2d30351dd820 req-c6a9e5d1-6da3-4dcd-8923-6c701cac7850 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173693 Sep 14 09:55:29.485916 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1275/4673] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:29.993694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:29.995195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:30.007914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:30.008778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:30.009483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:30.010572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:30.011276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:30.011950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:30.071135 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b7961255-461c-4b10-8392-226ca85e72a4 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.711312 Sep 14 09:55:30.099338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3399/4674] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:29 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:30.526306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:30.534839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:30.545749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:30.546977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-74bffc8d-5500-47db-aa7d-b06cd6e3081c tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.568380 Sep 14 09:55:30.556973 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1276/4675] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:29 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:30.895440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9dc2266-3794-497a-9f0b-7fa75062a4b6", "tag": "9d0fb833-a3f2-49bb-9eb0-1fc96c67881e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:30.940728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:30.941906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:30.945846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:31.001021 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] Creating event network-changed:9d0fb833-a3f2-49bb-9eb0-1fc96c67881e for instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 on n-h1-851028-12 Sep 14 09:55:31.019545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-63366e99-c615-4614-88dc-2b3c05573720 req-7b098c07-8445-4025-9807-40ac13ef9941 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130624 Sep 14 09:55:31.027363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3400/4676] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:31.107416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:31.108084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:31.123380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:31.124174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:31.124776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:31.125659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:31.126284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:31.126887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:31.442021 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6b2e4cda-720c-4385-a544-5c838027abb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.334639 Sep 14 09:55:31.443746 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1277/4677] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:31 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:31.610626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:31.611347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:31.627696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:31.628225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:31.628668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:31.629382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:31.629839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:31.634877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:31.961427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:31.975205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:31.983824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:31.985840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1c05cbe-ff99-4f50-9bb1-27a5d24e46ba tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.386132 Sep 14 09:55:31.994459 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3401/4678] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:31 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:32.466142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:32.466987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:32.479085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:32.480963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:32.481571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:32.488274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:32.489089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:32.489937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:32.990606 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4623b2e7-94ee-4b67-868e-f04f87a28cd3 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.527275 Sep 14 09:55:32.992892 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1278/4679] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:32 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:33.014730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:33.016081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:33.042852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:33.043662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:33.045192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:33.049099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:33.052245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:33.052952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:33.506391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:33.517590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:33.525683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:33.527274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2992f5e-c63c-44fa-8732-e65c71e15585 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.516395 Sep 14 09:55:33.529748 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3402/4680] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:33 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:34.026610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:34.027496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:34.051005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:34.052445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:34.056101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:34.060431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:34.064007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:34.066189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:34.337301 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b111212-7a22-4197-a908-214f6208edb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.320162 Sep 14 09:55:34.341106 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1279/4681] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:34 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:34.557281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:34.561539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:34.573182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:34.573688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:34.574128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:34.574843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:34.575294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:34.575727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:34.884358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:34.905072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:34.906760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:34.908053 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18c722e5-60cb-4d3a-989f-476d187228e7 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.356462 Sep 14 09:55:34.908663 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3403/4682] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:34 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:35.363158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:35.363767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:35.368518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:35.372861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:35.379201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:35.379602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:35.380103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:35.380820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:35.381277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:35.381969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:35.741378 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b8e748b-a559-43e4-b39a-9593e558c022 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.382456 Sep 14 09:55:35.743841 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1280/4683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:35 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:35.940370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:35.941000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:35.948809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:35.953742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:35.956063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:35.956565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:35.957306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:35.958040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:35.958380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:36.218936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:36.244812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:36.246577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:36.247973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe559e78-2322-4a5a-b283-99fcb77909f2 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.313565 Sep 14 09:55:36.249420 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3404/4684] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:35 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:36.650905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125e137f-4d79-44d9-89d1-22cad4f56ac3", "name": "network-vif-plugged", "status": "completed", "tag": "833fbe0d-ae8e-434d-b7f9-dbf96f24845e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:36.676975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:36.678309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:36.678786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:36.695877 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] Creating event network-vif-plugged:833fbe0d-ae8e-434d-b7f9-dbf96f24845e for instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 on n-h2-851028-12 Sep 14 09:55:36.702398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-318a9fef-d03b-4aa7-9152-6994cdd5825a req-8e55028c-7abc-4b53-87a5-8d6491db0f73 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055573 Sep 14 09:55:36.703512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1281/4685] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:36.766770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:36.767394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:36.777547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:36.778553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:36.779195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:36.782238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:36.782971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:36.783688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:37.110932 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-913fd9c3-52e4-4135-bb4b-3ff34204bd2a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1466 microversion: 2.1 time: 0.347938 Sep 14 09:55:37.124307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3405/4686] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:36 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1466 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:37.276210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:37.277305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:37.285678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:37.287069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:37.287690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:37.289551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:37.290177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:37.290776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:37.465539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:37.475748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:37.479215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:37.480836 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e404bfd4-3f31-49dd-be5e-b5402549cb44 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.210161 Sep 14 09:55:37.481737 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1282/4687] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:37 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:38.145618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:38.146925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:38.155702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.156983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.157648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.158837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.159527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.160239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.506777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:38.508433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:38.517483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.518237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.519472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.527852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.528657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.529263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.555161 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3988af3-740d-4599-b290-1b7d966d3b75 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1650 microversion: 2.1 time: 0.412280 Sep 14 09:55:38.556192 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3406/4688] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:38 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1650 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:38.580659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:38.581294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:38.591310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.592145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.592770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.593798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.594733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.595510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.738732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:38.749759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:38.752776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:38.755648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c4176d4-910f-4bc7-a0ca-f959a51be73d tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.252494 Sep 14 09:55:38.756591 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1283/4689] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:38 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:55:38.895860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-df1a3d13-162d-45ce-93ee-263befd34ec1 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1650 microversion: 2.1 time: 0.319446 Sep 14 09:55:38.912289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3407/4690] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:38 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1650 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:38.920784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:38.921485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:38.928844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.931310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.931752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:38.932527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:38.933461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:38.933461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.093930 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-203d0322-8129-48b7-9beb-135e9152f943 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1650 microversion: 2.1 time: 0.176957 Sep 14 09:55:39.108150 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1284/4691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:38 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1650 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:39.119665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:39.120209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:39.127334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.128166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.128956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.130117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.133365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.134272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.169309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:55:39.176987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:39.313925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-665e7dd4-badb-4112-b0c1-2c4c55bea1e8 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "DELETE /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 204 len: 0 microversion: 2.1 time: 0.199714 Sep 14 09:55:39.314542 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3408/4692] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:55:39 2022] DELETE /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:55:39.323403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:39.324263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:39.331413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.331924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.332434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.333170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.333636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.334070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.549719 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb2ae352-e3e5-4855-9320-7bd7469228cc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1656 microversion: 2.1 time: 0.230645 Sep 14 09:55:39.550921 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1285/4693] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:39 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1656 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:39.741607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc2266-3794-497a-9f0b-7fa75062a4b6", "name": "network-vif-plugged", "status": "completed", "tag": "9d0fb833-a3f2-49bb-9eb0-1fc96c67881e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:39.766625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.767812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.768305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.782641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:39.783251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:39.793916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.795506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.797038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.801115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:39.802494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:39.804771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:39.816479 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] Creating event network-vif-plugged:9d0fb833-a3f2-49bb-9eb0-1fc96c67881e for instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 on n-h1-851028-12 Sep 14 09:55:39.823791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c97938d7-8571-4dc1-a458-96a14ef019f3 req-ad2dda60-b1d5-4c7a-8faa-b110cee65196 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088029 Sep 14 09:55:39.825208 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3409/4694] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:40.008906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:40.025930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:40.029223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:40.031883 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca71d0b3-670f-4cd4-ba4c-8e03c404a4a0 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.252081 Sep 14 09:55:40.035098 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1286/4695] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:39 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:55:40.578415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:40.579874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:40.610082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:40.611039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:40.612906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:40.614759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:40.616301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:40.618056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:40.821209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bde2b92-4096-446d-847a-e81f443b9e71 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1656 microversion: 2.1 time: 0.245619 Sep 14 09:55:40.837223 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3410/4696] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:40 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1656 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:41.061634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:41.062256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:41.090309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.099658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.100488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.102013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.102948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.103617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.487165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:41.501333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:41.507413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:41.509922 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24987cde-5dfb-450e-8e62-bc42641c0bcd tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1359 microversion: 2.21 time: 0.452494 Sep 14 09:55:41.511128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1287/4697] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:41 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1359 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:41.591137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125e137f-4d79-44d9-89d1-22cad4f56ac3", "name": "network-vif-deleted", "tag": "833fbe0d-ae8e-434d-b7f9-dbf96f24845e"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:41.606676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.607886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.608940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.626650 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] Creating event network-vif-deleted:833fbe0d-ae8e-434d-b7f9-dbf96f24845e for instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 on n-h2-851028-12 Sep 14 09:55:41.634858 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-da4d3c19-302a-4b90-b2ca-6cb7fb8f51a9 req-3c9c8e74-77ec-4e05-ae70-a77e03524d99 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050193 Sep 14 09:55:41.641024 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3411/4698] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:41.848535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:41.849164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:41.856400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.857103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.857965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.859386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.860089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.860715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.916252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:41.917387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:41.918153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:41.918801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lazy-loading 'fault' on Instance uuid 125e137f-4d79-44d9-89d1-22cad4f56ac3 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:55:42.000972 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ad1da5d-000a-45a0-939f-c8bc97b5fc28 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 200 len: 1456 microversion: 2.1 time: 0.155077 Sep 14 09:55:42.002054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1288/4699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:41 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 1456 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:42.511848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-483580072", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66933b55-11a3-4245-98c5-766eee60b089", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:42.542507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:42.543691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:42.553916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.555206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.555842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:42.556728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.557332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.558079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:42.589186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:55:42.748466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:42.758382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:42.765959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:42.768682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:42.769941 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b00948ba-374d-43c0-8269-f645abc6c3db tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1551 microversion: 2.21 time: 0.235247 Sep 14 09:55:42.781291 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1289/4700] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:42 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1551 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:55:42.801638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:42.802744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:42.810629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.811107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.811733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:42.812979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.813598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.814182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:42.846077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:55:42.950516 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee506925-6196-460d-994b-7bec0729d8bc tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 204 len: 0 microversion: 2.21 time: 0.152859 Sep 14 09:55:42.955471 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1290/4701] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:55:42 2022] DELETE /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 09:55:42.962496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:42.963217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:42.970459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.971239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.971691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:42.972461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:42.972930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:42.973365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.174019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:55:43.174989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:55:43.175637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:55:43.176285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:55:43.176845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:55:43.187164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:43.192098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.193023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.193640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.194706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.196214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.196868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.198112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:43.200813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:43.202466 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-71722a33-a02d-4f50-97d7-df52ba57d606 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1557 microversion: 2.21 time: 0.245310 Sep 14 09:55:43.204015 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1291/4702] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:42 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1557 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:43.210038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:43.211311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 125e137f-4d79-44d9-89d1-22cad4f56ac3] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:43.218109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.218600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.219520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.220257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.220709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.221133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.221568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:55:43.228846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:55:43.244648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] HTTP exception thrown: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Request method failure captured: Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 HTTP/1.1 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaT1xqhhd_FqS6b_aL-Fi0p_-68sf-iNnqIGoQGeCgxHfMxz8mw1xQsLaPu-s33PvPN1M7xhCz68SSHXvzTnPeuar0tmAwrgeQ_nvvbiBHkmoApM31ClPyW806pWsjl_aZxq6JuU2qLJrGkpJmm_v6TZU4BfbUR3uM-nqGhiul5XeFo Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 82f453c75f2c4f66bbdf05891b104978 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestServerMultinode-1098265587 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_82f453c75f2c4f66bbdf05891b104978", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/82f453c75f2c4f66bbdf05891b104978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/82f453c75f2c4f66bbdf05891b104978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/82f453c75f2c4f66bbdf05891b104978"}]}] Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestServerMultinode-1098265587 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 82f453c75f2c4f66bbdf05891b104978 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestServerMultinode-1098265587 Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestServerMultinode-1098265587-project-admin Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: aab1aea454344cf78ca613217358b01b Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestServerMultinode-1098265587-project-admin Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '125e137f-4d79-44d9-89d1-22cad4f56ac3'} Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:43.246418 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Returning 404 to user: Instance 125e137f-4d79-44d9-89d1-22cad4f56ac3 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:43.250938 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2fe7df8-e1e1-4290-baea-940c6dbff9ec tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3" status: 404 len: 111 microversion: 2.1 time: 0.042881 Sep 14 09:55:43.252335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1292/4703] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:43 2022] GET /compute/v2.1/servers/125e137f-4d79-44d9-89d1-22cad4f56ac3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:55:43.259881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:43.260429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:43.268980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.269575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.270144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.270888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.271938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.273693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.321394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:55:43.324440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66933b55-11a3-4245-98c5-766eee60b089',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:55:43.326840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:55:43.424450 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e84a37d-9ed3-476b-b81a-c413b3d7bbb2 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "DELETE /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 204 len: 0 microversion: 2.1 time: 0.170184 Sep 14 09:55:43.427941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1293/4704] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:55:43 2022] DELETE /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:55:43.438855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:43.439572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:43.450625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.451137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.451692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.456320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:43.460866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:43.461669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:43.530139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-957a2812-516e-4cdb-a57a-3302dea84f7c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023433 Sep 14 09:55:43.531096 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3412/4705] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:55:43.550652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-984d0787-a716-4358-9333-aa7cdd4fadc6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:43.551489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-984d0787-a716-4358-9333-aa7cdd4fadc6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:43.619240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-984d0787-a716-4358-9333-aa7cdd4fadc6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:43.635480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-984d0787-a716-4358-9333-aa7cdd4fadc6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1056 microversion: 2.1 time: 0.092934 Sep 14 09:55:43.649658 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3413/4706] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:43 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1056 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:43.738214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c421fe3b-34ff-4cc8-ad87-460e6358429a tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1657 microversion: 2.1 time: 0.304486 Sep 14 09:55:43.744487 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1294/4707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:43 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1657 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:44.234332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:44.235557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:44.249076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.250088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.250682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.251843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.252473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.253375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.513128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:44.524940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:44.527083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:44.528691 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b564961-c670-4f4b-8701-a563abe2eab3 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1557 microversion: 2.21 time: 0.299098 Sep 14 09:55:44.529874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3414/4708] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:44 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1557 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:44.661053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:44.661928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:44.670549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.671262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.671702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.672431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.673046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.673632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.742673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:44.751616 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-999897c9-c632-4f16-8db9-208d6f8f0a98 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1154 microversion: 2.1 time: 0.094548 Sep 14 09:55:44.752468 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1295/4709] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:44 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1154 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:44.770861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:44.771541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:44.779204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.779700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.780171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.780880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:44.781336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:44.781765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:44.988663 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60986e29-834a-4917-b6a2-15a2a68d7f22 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1657 microversion: 2.1 time: 0.221563 Sep 14 09:55:45.000954 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3415/4710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:44 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1657 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:45.555562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:45.556408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:45.565733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:45.568552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:45.569253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:45.572273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:45.572988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:45.573660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:45.778770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:45.781798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:45.797762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:45.798647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:45.799325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:45.800339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:45.803569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:45.804856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:46.002437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:46.022511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:46.025301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:46.026833 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d6766d92-5d5d-4c09-a1d5-6abee40abcc1 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1557 microversion: 2.21 time: 0.476089 Sep 14 09:55:46.028917 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1296/4711] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:45 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1557 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 09:55:46.043340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:46.048135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:46.060584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:46.061410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:46.074972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:46.077177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:46.078702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:46.084651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:46.349960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:46.361808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01cb6eed-f559-4415-bc43-e65f1c3affdf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1214 microversion: 2.1 time: 0.587661 Sep 14 09:55:46.367182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3416/4712] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:45 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1214 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:46.801281 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-99ba3fd1-23fc-423a-8485-9fbfbfbff140 tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 200 len: 1657 microversion: 2.1 time: 0.769164 Sep 14 09:55:46.816127 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1297/4713] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:46 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 1657 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:46.835847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38539bf2-0fce-4c71-bcde-3766a052d3ff", "name": "network-vif-deleted", "tag": "201b550c-46ea-49d9-b8c2-018c5913411b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:46.866414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:46.871378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:46.879252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:46.948292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] Creating event network-vif-deleted:201b550c-46ea-49d9-b8c2-018c5913411b for instance 38539bf2-0fce-4c71-bcde-3766a052d3ff on n-h1-851028-12 Sep 14 09:55:46.968130 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cf7551fe-9d00-45e6-a5e1-7b721f2ec1ce req-dc9cc987-6ba7-46d5-a55a-a6696c72361e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136034 Sep 14 09:55:46.971583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3417/4714] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:47.057747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:47.059236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:47.077513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.081332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.081973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.089059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.089780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.090515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.251357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:47.290444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:47.297892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d84b2a30a354962b9d92cdcd6255f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ac67d16c1de4730a9b4455eec1a6a60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:47.299296 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35c6a583-2f76-45f9-87bf-b0019ee3cb04 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 200 len: 1344 microversion: 2.21 time: 0.247499 Sep 14 09:55:47.300345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1298/4715] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:47 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 1344 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 09:55:47.402695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:47.403666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:47.415687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a816781-8218-49f4-8b7b-39658498becd", "tag": "88efdc6a-879e-4437-8b64-0fbd8bec7585"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:47.422984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:47.427018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.437559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.438225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.438840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.441332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.447956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.448545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.478941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.480598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.517822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] Creating event network-changed:88efdc6a-879e-4437-8b64-0fbd8bec7585 for instance 9a816781-8218-49f4-8b7b-39658498becd on n-h2-851028-12 Sep 14 09:55:47.528522 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1c7d3e02-b80a-4f20-b819-e5b4934a762c req-a872875e-549d-45c8-9c4c-f8b10d43225b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116264 Sep 14 09:55:47.535151 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1299/4716] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:55:47.765583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:47.775829 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-74fb3c84-b87d-4edc-83ce-a21977fbd260 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1214 microversion: 2.1 time: 0.377793 Sep 14 09:55:47.776760 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3418/4717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:47 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:47.829542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:47.830571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] [instance: 38539bf2-0fce-4c71-bcde-3766a052d3ff] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:47.851778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.852599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.853185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.854064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:47.854682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:47.855286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:47.889799 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] HTTP exception thrown: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Request method failure captured: Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff HTTP/1.1 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaT1xqhhd_FqS6b_aL-Fi0p_-68sf-iNnqIGoQGeCgxHfMxz8mw1xQsLaPu-s33PvPN1M7xhCz68SSHXvzTnPeuar0tmAwrgeQ_nvvbiBHkmoApM31ClPyW806pWsjl_aZxq6JuU2qLJrGkpJmm_v6TZU4BfbUR3uM-nqGhiul5XeFo Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 82f453c75f2c4f66bbdf05891b104978 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestServerMultinode-1098265587 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_82f453c75f2c4f66bbdf05891b104978", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/82f453c75f2c4f66bbdf05891b104978"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/82f453c75f2c4f66bbdf05891b104978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/82f453c75f2c4f66bbdf05891b104978"}]}] Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestServerMultinode-1098265587 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 82f453c75f2c4f66bbdf05891b104978 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestServerMultinode-1098265587 Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestServerMultinode-1098265587-project-admin Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: aab1aea454344cf78ca613217358b01b Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestServerMultinode-1098265587-project-admin Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '38539bf2-0fce-4c71-bcde-3766a052d3ff'} Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:47.891571 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] Returning 404 to user: Instance 38539bf2-0fce-4c71-bcde-3766a052d3ff could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-444255ee-6ccf-4a58-8af5-e17806e9e1dc tempest-TestServerMultinode-1098265587 tempest-TestServerMultinode-1098265587-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff" status: 404 len: 111 microversion: 2.1 time: 0.067546 Sep 14 09:55:47.895642 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1300/4718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:47 2022] GET /compute/v2.1/servers/38539bf2-0fce-4c71-bcde-3766a052d3ff => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:55:48.327838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:48.327838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:48.343643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.344188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.344636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.345352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.345807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.346237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.384228 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] HTTP exception thrown: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Request method failure captured: Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 HTTP/1.1 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaULZq2eTkr7RffWKkWeJEClKBQj0QI3PMKr9Hw0sJwli2xIVQJkG-LTwZZ29TEZ3PM4zf8gS8XyW1-sYsLuxlGOE5t6MDXS-BoyO8Z6osWN8uN-Nr-GNW68sOD9visPvNb09VuSmY5X2Hy9O_6LhadB9GSIKxRyiQh8Ck4ODSnKMq8 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ac67d16c1de4730a9b4455eec1a6a60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ac67d16c1de4730a9b4455eec1a6a60"}]}] Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0d84b2a30a354962b9d92cdcd6255f11 Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e9dc2266-3794-497a-9f0b-7fa75062a4b6'} Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.385460 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Returning 404 to user: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e0d0d51c-3f06-4e4c-bddc-be7c2cea3a43 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 404 len: 111 microversion: 2.21 time: 0.063730 Sep 14 09:55:48.391371 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3419/4719] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:48 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:55:48.400842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '.version_select at 0x7f693fb86a60>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:48.402061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:48.411357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.412847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.413616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.421013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.421820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.422424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.562571 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-be97e185-ce2d-46a4-9ced-2b8eaea364f4 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.168082 Sep 14 09:55:48.563556 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1301/4720] 10.222.0.90 () {60 vars in 1337 bytes} [Wed Sep 14 09:55:48 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6/os-instance-actions => generated 611 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 09:55:48.580492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:48.581005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:48.591863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.593195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.593654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.596893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.597676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.599063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.663530 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] HTTP exception thrown: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Request method failure captured: Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 HTTP/1.1 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaULZq2eTkr7RffWKkWeJEClKBQj0QI3PMKr9Hw0sJwli2xIVQJkG-LTwZZ29TEZ3PM4zf8gS8XyW1-sYsLuxlGOE5t6MDXS-BoyO8Z6osWN8uN-Nr-GNW68sOD9visPvNb09VuSmY5X2Hy9O_6LhadB9GSIKxRyiQh8Ck4ODSnKMq8 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ac67d16c1de4730a9b4455eec1a6a60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ac67d16c1de4730a9b4455eec1a6a60"}]}] Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0d84b2a30a354962b9d92cdcd6255f11 Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e9dc2266-3794-497a-9f0b-7fa75062a4b6'} Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:48.666063 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.670552 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.672436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Returning 404 to user: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:48.675734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3dbbdef6-5a8d-4754-9561-e6a99d908eef tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 404 len: 111 microversion: 2.21 time: 0.099649 Sep 14 09:55:48.680739 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3420/4721] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 09:55:48 2022] DELETE /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:55:48.689526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:48.690289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] [instance: e9dc2266-3794-497a-9f0b-7fa75062a4b6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:48.703663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.704566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.706005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.713407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.714082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.714648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.744103 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] HTTP exception thrown: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Request method failure captured: Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 HTTP/1.1 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaULZq2eTkr7RffWKkWeJEClKBQj0QI3PMKr9Hw0sJwli2xIVQJkG-LTwZZ29TEZ3PM4zf8gS8XyW1-sYsLuxlGOE5t6MDXS-BoyO8Z6osWN8uN-Nr-GNW68sOD9visPvNb09VuSmY5X2Hy9O_6LhadB9GSIKxRyiQh8Ck4ODSnKMq8 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.21 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ac67d16c1de4730a9b4455eec1a6a60", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ac67d16c1de4730a9b4455eec1a6a60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ac67d16c1de4730a9b4455eec1a6a60"}]}] Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ac67d16c1de4730a9b4455eec1a6a60 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-222599816 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0d84b2a30a354962b9d92cdcd6255f11 Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-InstanceActionsV221TestJSON-222599816-project Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e9dc2266-3794-497a-9f0b-7fa75062a4b6'} Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.747037 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. Sep 14 09:55:48.751581 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:55:48.754383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] Returning 404 to user: Instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:55:48.756315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de6a48e6-5a9e-4135-a079-bcf835c10919 tempest-InstanceActionsV221TestJSON-222599816 tempest-InstanceActionsV221TestJSON-222599816-project] 10.222.0.90 "GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6" status: 404 len: 111 microversion: 2.21 time: 0.070402 Sep 14 09:55:48.757112 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1302/4722] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 09:55:48 2022] GET /compute/v2.1/servers/e9dc2266-3794-497a-9f0b-7fa75062a4b6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 09:55:48.802590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:48.805436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:48.819013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.820805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.821594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.822536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:48.823010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:48.823449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:48.999520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9dc2266-3794-497a-9f0b-7fa75062a4b6", "name": "network-vif-deleted", "tag": "9d0fb833-a3f2-49bb-9eb0-1fc96c67881e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:55:49.027266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:49.028036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:49.028715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:49.054112 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] Creating event network-vif-deleted:9d0fb833-a3f2-49bb-9eb0-1fc96c67881e for instance e9dc2266-3794-497a-9f0b-7fa75062a4b6 on n-h1-851028-12 Sep 14 09:55:49.073804 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5bc889f7-137d-464a-b7c6-6e6bbb6b751d req-343e9f8f-6a91-45ce-8c6f-e4fb005a13a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078814 Sep 14 09:55:49.074683 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1303/4723] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:55:49.092669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:49.102838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-665fd3d2-84d1-47e2-8511-e80fad98d18f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1214 microversion: 2.1 time: 0.307063 Sep 14 09:55:49.103453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3421/4724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:48 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:50.128817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:50.131576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:50.145848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:50.146362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:50.146807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:50.147527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:50.148011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:50.149176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:50.660377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:50.685331 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f47b7cb-3758-4202-8bb4-fe08e74e8643 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1214 microversion: 2.1 time: 0.560633 Sep 14 09:55:50.685955 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1304/4725] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:50 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1214 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:51.714376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:51.714921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:51.725932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:51.726298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:51.726912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:51.727792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:51.728234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:51.728664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:52.504220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:52.515645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b7fbda16-ea56-41cf-8292-007f33c20f57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1214 microversion: 2.1 time: 0.806152 Sep 14 09:55:52.518117 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3422/4726] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:51 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1214 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:53.545639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:53.546614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:53.574759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:53.578829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:53.579584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:53.587021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:53.589689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:53.590833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:54.355420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:54.372105 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2349ea1-4ef2-4ffd-9a6d-9c5047fd7ad4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.831392 Sep 14 09:55:54.375152 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1305/4727] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:53 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:55.403254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:55.404878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:55.412915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:55.415322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:55.416094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:55.426600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:55.431006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:55.431457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:55.432238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:55.432707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:55.433140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:55.739307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:55.759752 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64745830-f789-4360-b3cc-0a0432d2ea94 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.358584 Sep 14 09:55:55.760911 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3423/4728] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:55 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:55:56.789857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:56.790532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:56.808899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:56.809438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:56.809884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:56.814495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:56.816658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:56.817734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:56.862192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:55:57.168720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:57.183426 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3464c60-7d85-4665-ab12-629dbd0f9e90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.399549 Sep 14 09:55:57.185343 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1306/4729] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:56 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:55:58.217223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:55:58.217842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:55:58.250847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:58.251634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:58.252331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:58.253362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:55:58.254105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:55:58.254763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:55:59.063682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:55:59.089424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3af80d91-c3f3-44fd-8d05-9dcde15362d4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.878369 Sep 14 09:55:59.103141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3424/4730] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:55:58 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:00.118880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:00.119555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:00.141591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:00.142096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:00.142610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:00.143342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:00.144628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:00.144948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:00.424113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:00.433285 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0a748bec-a73d-44c4-88f0-9f4ca6f76a57 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.318949 Sep 14 09:56:00.433897 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1307/4731] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:00 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:01.457861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:01.458488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:01.466382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:01.467597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:01.468143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:01.469059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:01.469545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:01.469973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:02.023643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1262593107", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "52ae5d5b-6406-4b73-9515-d500eeded0a8"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1557429075", "security_groups": []}, "os:scheduler_hints": {"different_host": ["18279dd9-b598-4b74-84f2-8c3fb60075ab"]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:02.109697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] validate_networks() for [('52ae5d5b-6406-4b73-9515-d500eeded0a8', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:56:02.142662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:02.153828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02231627-d2fd-40d7-9b60-c199b53b65d3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.700437 Sep 14 09:56:02.160083 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3425/4732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:01 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:03.177149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:03.177748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:03.197893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:03.198424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:03.198853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:03.199576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:03.200064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:03.200494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:03.580782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:56:03.581288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:56:03.581778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:56:03.582197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:56:03.582614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:56:03.596727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:03.597441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:03.598610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:03.599513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:03.600258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:03.600862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:03.628746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for project 5368428be82f4fb6933ec75a1d410e31. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:56:03.636783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Getting quotas for user ee09acc6e8184849bf71cbe9bebc0ec3 and project 5368428be82f4fb6933ec75a1d410e31. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:56:03.655305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:56:03.659839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:56:03.725947 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6c0d9d31-3558-40cc-8508-64cb42c6b0fb tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.712205 Sep 14 09:56:03.726946 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1308/4733] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:56:02 2022] POST /compute/v2.1/servers => generated 361 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:56:03.744486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4162b6f5-1a84-4a42-a95d-51904b2ddf52 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:03.750165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4162b6f5-1a84-4a42-a95d-51904b2ddf52 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:03.782939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:03.797576 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4984362b-3095-4981-81a8-d263b0b38dbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.624278 Sep 14 09:56:03.817995 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3426/4734] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:03 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:03.945517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4162b6f5-1a84-4a42-a95d-51904b2ddf52 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:03.967534 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4162b6f5-1a84-4a42-a95d-51904b2ddf52 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1242 microversion: 2.1 time: 0.233078 Sep 14 09:56:03.970994 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1309/4735] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:03 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:04.824925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:04.825545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:04.840245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:04.840747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:04.841185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:04.842087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:04.842708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:04.843284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:04.994929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:04.995937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:05.013099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:05.014000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:05.018771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:05.019729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:05.020605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:05.023261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:05.144412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:05.154801 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff53d992-8380-4e14-9237-40141f00c106 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1238 microversion: 2.1 time: 0.164939 Sep 14 09:56:05.159442 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1310/4736] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:04 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1238 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:05.192977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:05.203454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5faff8b-52e6-4303-affe-40a423725a09 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.382300 Sep 14 09:56:05.205822 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3427/4737] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:04 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:06.189111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:06.189730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:06.204312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:06.212419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:06.213068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:06.213910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:06.214459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:06.214967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:06.231686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:06.232423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:06.258394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:06.260022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:06.265730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:06.266666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:06.267732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:06.273268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:06.477967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:06.492931 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a7fd1c51-1162-4880-b40c-05aa44bf40d1 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.306065 Sep 14 09:56:06.496698 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1311/4738] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:06 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:07.330287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a816781-8218-49f4-8b7b-39658498becd", "name": "network-vif-plugged", "status": "completed", "tag": "88efdc6a-879e-4437-8b64-0fbd8bec7585"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:07.369926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:07.375490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:07.376150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:07.432379 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] Creating event network-vif-plugged:88efdc6a-879e-4437-8b64-0fbd8bec7585 for instance 9a816781-8218-49f4-8b7b-39658498becd on n-h2-851028-12 Sep 14 09:56:07.442702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:07.458146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:07.469838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8648c12a-b9bf-43dc-b5e6-98484a96e68e req-5e653443-1a4d-4831-80a4-eaac2a751a35 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.667058 Sep 14 09:56:07.475765 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1312/4739] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:07.483047 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-376f332c-33cd-4bd9-b25b-745e77b77aba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 1.255488 Sep 14 09:56:07.488453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3428/4740] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:06 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:07.528812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:07.529953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:07.557932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:07.560584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:07.561649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:07.563569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:07.568120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:07.568723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:08.050921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:08.068073 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4410872f-7bdc-44d8-8488-44d6e4daaf03 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.551265 Sep 14 09:56:08.071240 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1313/4741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:07 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:08.516812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:08.518214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:08.562962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:08.581441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:08.582307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:08.583323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:08.585829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:08.587035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:09.100447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:09.101874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:09.120228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:09.120849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:09.121456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:09.123094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:09.123722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:09.124383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:09.247256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:09.266230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f227b70b-3664-403a-aa75-256aa66c9c32 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1202 microversion: 2.1 time: 0.756842 Sep 14 09:56:09.293371 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3429/4742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:08 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1202 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:09.349337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:09.362972 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae4b9021-9a69-4786-9e73-e63f9e82c052 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.265401 Sep 14 09:56:09.364567 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1314/4743] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:09 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:09.849479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aae167fd-7d21-4a30-8017-a99271c13c63 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: .version_select at 0x7f693e1174c0>, body: {"keypair": {"name": "tempest-keypair-1439653605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8IXisAZQx2e8K6cxxMo/FRkE8EbUSUsiCUm7DQgVb2sdmcjP5TQlE+1A2usT3KovVeE8dXN0fdGkVibKZzXU1oCGcT2l34IQiHdoB3ISaG57lwtd6RwChyJ8ADciXY/w=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:09.886795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aae167fd-7d21-4a30-8017-a99271c13c63 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:56:09.906273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-aae167fd-7d21-4a30-8017-a99271c13c63 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:56:09.965062 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aae167fd-7d21-4a30-8017-a99271c13c63 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.447445 Sep 14 09:56:09.966735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3430/4744] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:56:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:10.026014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464589b4-49f2-463c-88ca-05af1291d352", "tag": "2d344d7f-0522-4d70-85d2-2e25a9bec314"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:10.050217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:10.052258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:10.052715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:10.090185 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] Creating event network-changed:2d344d7f-0522-4d70-85d2-2e25a9bec314 for instance 464589b4-49f2-463c-88ca-05af1291d352 on n-h1-851028-12 Sep 14 09:56:10.103567 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-13b2aa47-8096-4835-908f-749d4ea13568 req-bc84dfbe-1e59-4c86-9f33-6b01962d05c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305124 Sep 14 09:56:10.112588 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1315/4745] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:10.305919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:10.307380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:10.318949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:10.330589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:10.331487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:10.334024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:10.335280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:10.339646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:10.410139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:10.411857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:10.428120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:10.429006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:10.429700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:10.435501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:10.436353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:10.437546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:10.790824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:10.807011 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-42aaf5dc-e7e1-4437-a266-6d65138d8ed8 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.399112 Sep 14 09:56:10.809112 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1316/4746] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:10 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:11.304115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:11.320625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc1a9731-1fba-4d9f-8af1-954c885cce7f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1389 microversion: 2.1 time: 1.026730 Sep 14 09:56:11.343190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3431/4747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:10 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1389 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:11.348638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:11.349886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:11.358152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.358948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.359634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:11.361284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.362001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.363107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:11.815838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:11.832953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:11.833579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:11.838751 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ec55292d-2318-4467-aae6-096f231e5349 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1389 microversion: 2.1 time: 0.493350 Sep 14 09:56:11.841485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1317/4748] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:11 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1389 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:11.866013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.868228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.868786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:11.870855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:11.871703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.872203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:11.872448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.874521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:11.886453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.887814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.891336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:11.892306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:11.894435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:11.895064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:12.078978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:12.089371 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1778b1f4-45b4-44f0-8164-b712e7368c20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.260747 Sep 14 09:56:12.102119 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3432/4749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:11 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:12.293674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:12.302704 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-98587c2c-4ce5-4173-86bc-a0485e0666d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1389 microversion: 2.1 time: 0.438647 Sep 14 09:56:12.303310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1318/4750] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:11 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1389 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:12.330052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:12.330660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:12.339997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:12.342437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:12.342969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:12.346583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:12.347143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:12.347655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:12.408954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:56:12.591276 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f078c546-af9a-469f-9fca-55eff5d6eec6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 204 len: 0 microversion: 2.1 time: 0.264631 Sep 14 09:56:12.592641 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3433/4751] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:56:12 2022] DELETE /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:56:12.602194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:12.603039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:12.615500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:12.618170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:12.618658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:12.619436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:12.621043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:12.622243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:13.114624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:13.115488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:13.126357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:13.130740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:13.131300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:13.134143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:13.134810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:13.139040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:13.241276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:13.252252 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1287b625-4400-4181-ae7b-21ddfd65f339 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1395 microversion: 2.1 time: 0.654962 Sep 14 09:56:13.288316 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1319/4752] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:12 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1395 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:13.399790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:13.411721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3d055502-572e-4615-af8d-be5b6a0e4423 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.301659 Sep 14 09:56:13.420145 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3434/4753] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:13 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:13.463625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2022782725", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f52c1506-ea12-48d0-a2b1-2b338e6679a6"}], "security_groups": [{"name": "tempest-securitygroup--213058724"}], "key_name": "tempest-keypair-1439653605", "user_data": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:13.610805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:13.845677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] validate_networks() for [('f52c1506-ea12-48d0-a2b1-2b338e6679a6', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:56:13.963380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:14.283294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:14.283793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:14.302630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:14.306334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:14.311502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:14.312446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:14.313028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:14.315398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:14.544984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:14.552922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c1c2ccca-357a-431c-aca2-5706398d0ee8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1395 microversion: 2.1 time: 0.274482 Sep 14 09:56:14.553736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3435/4754] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:14 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1395 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:14.567974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:14.568601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:14.577281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:14.578023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:14.578650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:14.584066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:14.584770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:14.586165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:14.685784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:14.698634 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7aaa964-1361-4ccf-a64b-f7084889ac20 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.142872 Sep 14 09:56:14.699349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3436/4755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:14 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:15.248930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:56:15.249545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:56:15.249821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:56:15.250239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:56:15.250665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:56:15.265799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.266290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.266734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.267470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.267949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.268664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.291104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:56:15.297316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:56:15.320309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:56:15.325303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:56:15.471918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-69baa873-31b7-4212-8a84-8e86e3883865 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.012899 Sep 14 09:56:15.473310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1320/4756] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:56:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:56:15.493915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-032727d8-2502-4c8b-a364-5d3b916a0766 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:15.494871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-032727d8-2502-4c8b-a364-5d3b916a0766 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:15.581132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:15.581853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:15.603194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.603702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.604202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.611718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.615400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.616200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.866655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-032727d8-2502-4c8b-a364-5d3b916a0766 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:15.876155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-032727d8-2502-4c8b-a364-5d3b916a0766 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1239 microversion: 2.1 time: 0.392538 Sep 14 09:56:15.885686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3437/4757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:15 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1239 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:15.891284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:15.900421 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9dc89f72-59be-4cb0-bafe-0993e757f0f8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1353 microversion: 2.1 time: 0.323585 Sep 14 09:56:15.918285 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1321/4758] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:15 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1353 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:15.926120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:15.926759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:15.931511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a816781-8218-49f4-8b7b-39658498becd", "name": "network-vif-deleted", "tag": "88efdc6a-879e-4437-8b64-0fbd8bec7585"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:15.963611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.964183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.964639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.965381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.965913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.966257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:15.971486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:15.979669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:15.980425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:16.031787 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] Creating event network-vif-deleted:88efdc6a-879e-4437-8b64-0fbd8bec7585 for instance 9a816781-8218-49f4-8b7b-39658498becd on n-h2-851028-12 Sep 14 09:56:16.053820 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-33635c28-29d0-4e15-b717-02e03fd7c67c req-dd3ceb07-2959-47ea-b9e3-49718666ddcd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165250 Sep 14 09:56:16.062488 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3438/4759] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:16.249171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:16.263728 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8769b1fd-9686-435e-a18b-5164fbb8bb37 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.343861 Sep 14 09:56:16.279605 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1322/4760] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:15 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:16.914867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:16.915954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:16.928834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:16.929985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:16.939851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:16.946520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:16.947093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:16.947872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:16.950037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:16.950495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:16.965406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:16.968294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:16.968986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:16.970965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:16.972394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:16.974504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:17.207463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:17.265013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-33a010e8-39a8-4e23-82f9-c48eea2d8b70 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.333752 Sep 14 09:56:17.269924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1323/4761] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:16 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:17.291277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:17.292054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:17.293260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:17.308464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:17.315934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d1a7923-c267-4feb-9d27-fef7529b433b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1243 microversion: 2.1 time: 0.406419 Sep 14 09:56:17.316324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:17.316960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:17.318404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3439/4762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:16 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1243 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:17.319621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:17.321115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:17.321574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:17.565261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:17.574224 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fa46bf11-9d0f-426d-a598-ca6a0c06e115 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.287117 Sep 14 09:56:17.581371 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1324/4763] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:17 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:18.110109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464589b4-49f2-463c-88ca-05af1291d352", "name": "network-vif-plugged", "status": "completed", "tag": "2d344d7f-0522-4d70-85d2-2e25a9bec314"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:18.141557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.155543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.156312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.188086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] Creating event network-vif-plugged:2d344d7f-0522-4d70-85d2-2e25a9bec314 for instance 464589b4-49f2-463c-88ca-05af1291d352 on n-h1-851028-12 Sep 14 09:56:18.193963 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ac9f8c11-56df-43b7-b9a5-34cc86ca7bf6 req-e736730d-f71c-44e5-834f-05b4dda7d28d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088057 Sep 14 09:56:18.196268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3440/4764] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:18.293745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:18.296373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:18.311965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:18.322931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.326192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.326908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.327882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.346309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:18.349441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:18.355057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.355991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.371615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.378132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.378996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.396941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.397723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.400812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.551749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:18.564395 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8fa2ebaf-3b27-4250-9843-ef37ae3b2c86 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.274641 Sep 14 09:56:18.580721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1325/4765] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:18 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:18.590827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:18.605840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:18.606468 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a715711-7d44-4937-96d5-8e326f1c0ad5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1297 microversion: 2.1 time: 0.266122 Sep 14 09:56:18.606721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:18.607793 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3441/4766] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:18 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1297 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:18.628437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.628931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.629364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.630074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:18.630526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:18.630950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:18.760218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:18.762468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:18.769692 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47d8da4d-32a5-4084-9593-568c85519371 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1300 microversion: 2.1 time: 0.168660 Sep 14 09:56:18.771393 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1326/4767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:18 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:19.591511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:19.592416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:19.601664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.603454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.605163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:19.606376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.607069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.607672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:19.631698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:19.633607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:19.642053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.642788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.643613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:19.644564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.645651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.646434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:19.742649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:19.745096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:19.752027 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3f5d32f-b0d2-4fd6-86b5-29c6ae4f91a6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.164557 Sep 14 09:56:19.763109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46ce239e-0233-4d8b-9316-d2396f772912 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1297 microversion: 2.1 time: 0.135619 Sep 14 09:56:19.769525 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3442/4768] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:19 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:19.780796 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1327/4769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:19 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:19.806098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:19.806768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:19.822721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.823436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.823689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:19.824454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:19.824918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:19.825552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.505033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:20.513996 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-feaf2716-5085-4483-9cf6-6f4d34cea994 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1473 microversion: 2.1 time: 0.712573 Sep 14 09:56:20.515198 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3443/4770] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:19 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1473 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:20.541927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:20.542825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:20.553085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.554280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.555407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.556438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.557103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.558525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.731280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:20.750328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c20da190-92eb-461b-9ade-7e14d9dd22d9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1473 microversion: 2.1 time: 0.212244 Sep 14 09:56:20.751821 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1328/4771] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:20 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:20.790615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:20.791254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:20.791392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:20.792116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:20.809446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.810164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.810733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.811808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.812366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.813058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.813983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.815315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:20.816002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.816564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:20.817251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:20.818676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:21.012812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:21.047801 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb6a0063-f97c-48bf-945b-42c7ebe128a9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.268661 Sep 14 09:56:21.052615 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3444/4772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:20 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:21.085524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:21.091367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:21.127433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:21.130207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:21.130980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:21.131939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:21.136370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:21.136945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:21.185644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:21.204177 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c54a1d0-1c1e-460c-8be1-37b4c1e5634c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.407201 Sep 14 09:56:21.205209 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1329/4773] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:20 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:21.469469 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-645b6a1b-c950-41fa-aeda-fd72356a3ecb tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1626 microversion: 2.1 time: 0.414519 Sep 14 09:56:21.470359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3445/4774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:21 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1626 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:21.495170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:21.496233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:21.502582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:21.504085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:21.504771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:21.505750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:21.506436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:21.507099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:21.845110 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f406efe0-5f10-4152-8fda-ccb73e007f5b tempest-TestSecurityGroupsBasicOps-1770620365 tempest-TestSecurityGroupsBasicOps-1770620365-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1915 microversion: 2.1 time: 0.354819 Sep 14 09:56:21.847230 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1330/4775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:21 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1915 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:22.039870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:22.040602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:22.052022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.052629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.055929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.057449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.060305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.061088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.104448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:22.106476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:22.137396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.141428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.141609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:56:22.142349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.143434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.144903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.145347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.256160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:22.320957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:22.330968 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-43b336c7-69b8-4329-b4ee-97b071bcf84e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.235918 Sep 14 09:56:22.335525 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1331/4776] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:22 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:22.348992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:22.349640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:22.381720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.383424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.384109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.386092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.386739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.387370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.404476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-062aac21-759a-4182-9cdc-87eea0e591e7 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "DELETE /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 204 len: 0 microversion: 2.1 time: 0.368502 Sep 14 09:56:22.405205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3446/4777] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:56:22 2022] DELETE /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:56:22.416363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:22.417180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:22.432047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.433218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.433717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.434451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.437702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.438422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.703068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:22.715631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:22.719132 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e664c25-69ad-44ee-a22a-cb1d6752a1b9 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1479 microversion: 2.1 time: 0.303522 Sep 14 09:56:22.720469 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3447/4778] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:22 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1479 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:22.740850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:22.744999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9da5e7bc-5431-4378-9b87-8a94200fcb33 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.402017 Sep 14 09:56:22.748370 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1332/4779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:22 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:22.771701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:22.772960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:22.774042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:22.830041 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] Creating event network-changed:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:56:22.856496 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4c940e84-fc69-4fbf-a35d-224bb5eb056d req-f675ba76-0ffa-41ec-a860-b189fac2f247 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134057 Sep 14 09:56:22.858317 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3448/4780] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:23.366072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:23.373102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:23.419994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.425541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.427609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:23.429231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.437312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.438091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:23.687104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:23.700915 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fd4f1ccf-69d2-440a-a822-5e579707c4e4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 200 len: 1187 microversion: 2.1 time: 0.346520 Sep 14 09:56:23.701938 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1333/4781] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:23 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 1187 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:23.750115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:23.750854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:23.767353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.775110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:23.775758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:23.780325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.784203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:23.784934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.785427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.785872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:23.790150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.790651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.791094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:23.791821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:23.798081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:23.798626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:24.107241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:24.157513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bedad61-c337-49c7-b52c-7698ace6a180 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1479 microversion: 2.1 time: 0.415158 Sep 14 09:56:24.171683 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3449/4782] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:23 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1479 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:24.432578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:24.457186 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2de5a280-9f71-43b3-9fd4-edee76beb25c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.688115 Sep 14 09:56:24.464196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1334/4783] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:23 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:24.734355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:24.736101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 9a816781-8218-49f4-8b7b-39658498becd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:24.769316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:24.770914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:24.773950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:24.775258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:24.784889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:24.785519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:24.852585 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd HTTP/1.1 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9a816781-8218-49f4-8b7b-39658498becd'} Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:24.881012 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:56:24.886479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance 9a816781-8218-49f4-8b7b-39658498becd could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:56:24.903314 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-493af25a-52e8-4e9a-80d8-ccf126535b1e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd" status: 404 len: 111 microversion: 2.1 time: 0.156617 Sep 14 09:56:24.904138 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3450/4784] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:24 2022] GET /compute/v2.1/servers/9a816781-8218-49f4-8b7b-39658498becd => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:56:25.202575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:25.203481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:25.232428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:25.235395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:25.248032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:25.248883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:25.249375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:25.249823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:25.336682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:25.337952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:25.486673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:25.487983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:25.508826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:25.512597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:25.513100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:25.513540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:25.516453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:25.516931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:25.520669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:25.872865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:26.130075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:26.142420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c62e8c38-f3a5-42cc-b8f1-d211002023cc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.663426 Sep 14 09:56:26.164738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3451/4785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:25 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:26.182837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464589b4-49f2-463c-88ca-05af1291d352", "name": "network-vif-deleted", "tag": "2d344d7f-0522-4d70-85d2-2e25a9bec314"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:26.210501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:26.211754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:26.213069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:26.246974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] Creating event network-vif-deleted:2d344d7f-0522-4d70-85d2-2e25a9bec314 for instance 464589b4-49f2-463c-88ca-05af1291d352 on n-h1-851028-12 Sep 14 09:56:26.258942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e76db1a9-82d3-420a-aec6-5a9f48a5d769 req-b3d6e753-add3-4775-a4ee-78a79cb97965 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092768 Sep 14 09:56:26.260084 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3452/4786] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:26.359035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:26.369482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-acf203f9-ace5-41db-b6b4-a724cb139158 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1479 microversion: 2.1 time: 1.174956 Sep 14 09:56:26.371757 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1335/4787] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:25 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1479 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:27.176304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:27.177190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:27.188518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:27.191001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:27.193804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:27.197222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:27.198024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:27.202714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:27.394612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:27.395334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:27.408566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:27.410799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:27.411875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:27.418207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:27.419014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:27.420361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:27.510708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:27.511599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:27.512298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:27.513323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lazy-loading 'fault' on Instance uuid 464589b4-49f2-463c-88ca-05af1291d352 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:56:27.573535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:27.589097 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dcf11793-6168-4a3d-ace7-d7d3fcb43547 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 200 len: 1332 microversion: 2.1 time: 0.199079 Sep 14 09:56:27.590187 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1336/4788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:27 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 1332 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:27.657289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:27.673106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53a0c690-e942-42e8-a082-1b6488a9da26 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.501702 Sep 14 09:56:27.674343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3453/4789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:27 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:28.614624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:28.615205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 464589b4-49f2-463c-88ca-05af1291d352] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:28.627404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:28.627946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:28.628371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:28.629094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:28.629551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:28.629976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:28.661244 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] HTTP exception thrown: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Request method failure captured: Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 HTTP/1.1 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaTdG37HZeelz5veESXROBnKrFRY0zwJ-gDetPAApslxzTWOb7epdk5oMX7pDKqsIfILHLqD46z40yUyoLs4d7BzCkWRY8Xi2I0QRuk7AxhD8saeE-f5nSZqg32TYYdUSFofVkW92lhUuGW3zdd0mArgMEejqGSjJrf66HDV93M9AKc Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 5368428be82f4fb6933ec75a1d410e31 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5368428be82f4fb6933ec75a1d410e31", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5368428be82f4fb6933ec75a1d410e31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5368428be82f4fb6933ec75a1d410e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5368428be82f4fb6933ec75a1d410e31"}]}] Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 5368428be82f4fb6933ec75a1d410e31 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestSecurityGroupsBasicOps-1953297975-project Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ee09acc6e8184849bf71cbe9bebc0ec3 Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1953297975-project Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '464589b4-49f2-463c-88ca-05af1291d352'} Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:28.662998 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Returning 404 to user: Instance 464589b4-49f2-463c-88ca-05af1291d352 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:56:28.671964 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8e6720e-47d5-4697-935e-d44a9cf5290e tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352" status: 404 len: 111 microversion: 2.1 time: 0.054780 Sep 14 09:56:28.680657 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1337/4790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:28 2022] GET /compute/v2.1/servers/464589b4-49f2-463c-88ca-05af1291d352 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:56:28.702134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:28.703445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:28.723615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:28.724412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:28.725049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:28.725935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:28.727265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:28.728198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:29.268778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:29.280895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdd00382-4aec-4a30-98e4-5148333b038f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.582521 Sep 14 09:56:29.281974 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3454/4791] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:28 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:30.307830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:30.309283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:30.317849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:30.318343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:30.322093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:30.323069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:30.323550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:30.342020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:30.867881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:30.879467 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca24a583-27b5-44f7-a5b6-fb231881aaa7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.577235 Sep 14 09:56:30.880107 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1338/4792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:30 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:31.911807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:31.912497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:31.935229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:31.935784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:31.940061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:31.942320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:31.946622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:31.947637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:32.330228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:32.351053 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3eaddab-9322-43d6-b019-90c22cc2c3f1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.445490 Sep 14 09:56:32.360421 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3455/4793] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:32.589096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-plugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:32.607259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:32.608037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:32.608638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:32.649309 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] Creating event network-vif-plugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:56:32.671513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ec8a8fce-13ae-4a02-ae4b-41c7ad475804 req-69e40f7b-a6c3-4abe-94ed-757da69231f3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094103 Sep 14 09:56:32.676576 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1339/4794] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:33.382704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:33.384063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:33.403979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:33.404726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:33.410227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:33.411207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:33.412075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:33.412988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:33.792389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:33.807363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2f16df59-e964-4505-b2b3-a82db15af60d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1364 microversion: 2.1 time: 0.425731 Sep 14 09:56:33.821186 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3456/4795] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:33 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:34.350413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-97049393", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9d5ccb84-193b-4382-b154-ee372ac69f64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:34.442067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:56:34.846653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:34.848153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:34.858685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:34.861333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:34.862718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:34.865594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:34.868876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:34.869784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:34.917084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:56:34.917560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:56:34.918137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:56:34.918659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:56:34.919169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:56:34.928621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:34.929237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:34.930343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:34.931154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:34.931709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:34.932261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:34.951270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:56:34.957738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:56:35.032352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:56:35.034790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d5ccb84-193b-4382-b154-ee372ac69f64',volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:56:35.107152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:35.127749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edaa58c4-79ab-4776-a82a-cdf0da6ff4aa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1552 microversion: 2.1 time: 0.286029 Sep 14 09:56:35.144220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3457/4796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:34 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1552 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:35.181288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:35.182673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:35.189874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:35.190508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:35.191155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:35.192009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:35.193091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:35.193764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:35.286912 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fb2f6cd-02d3-4d9d-909d-265d2b25f0ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941633 Sep 14 09:56:35.287563 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1340/4797] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:56:35.304264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c2fef69-c2ab-49d3-bc1b-dc174585042d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:35.305700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2c2fef69-c2ab-49d3-bc1b-dc174585042d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:35.356519 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5072a212-9abf-4586-9895-f259f645d33a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200666 Sep 14 09:56:35.357441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3458/4798] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 09:56:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:35.384611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2c2fef69-c2ab-49d3-bc1b-dc174585042d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:35.394218 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c2fef69-c2ab-49d3-bc1b-dc174585042d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1055 microversion: 2.1 time: 0.097888 Sep 14 09:56:35.395527 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1341/4799] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:35 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1055 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:36.418503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:36.419747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:36.427026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.427800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.428684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.430123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.430791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.431533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.588470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:36.590738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:36.591242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:36.598478 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d0489c8-a6b0-4806-b75f-806c67d01dce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1153 microversion: 2.1 time: 0.184935 Sep 14 09:56:36.598981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.599477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.599943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.600632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.603278 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3459/4800] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:36 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1153 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:36.607934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.611341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.627818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18279dd9-b598-4b74-84f2-8c3fb60075ab", "tag": "9499b88d-9323-4f5f-9376-2cc881a7cbca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:36.654571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.655495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.656347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.676018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:56:36.685997 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] Creating event network-changed:9499b88d-9323-4f5f-9376-2cc881a7cbca for instance 18279dd9-b598-4b74-84f2-8c3fb60075ab on n-h2-851028-12 Sep 14 09:56:36.693881 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b15d685d-507c-4346-8cba-14c0139fc993 req-35243d90-bbc9-4e10-8c8e-7960b2762c5c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070018 Sep 14 09:56:36.694989 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3460/4801] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:36.815381 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e13e1df-0ee1-4d65-a441-1c44d5f65bca tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "DELETE /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 204 len: 0 microversion: 2.1 time: 0.228303 Sep 14 09:56:36.816681 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1342/4802] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:56:36 2022] DELETE /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:56:36.828101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:36.829127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:36.837134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.838202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.838825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:36.839782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:36.841878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:36.842510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:37.200880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:37.218653 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae8046a3-cf57-4e32-ab77-e9fe137bb1c4 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1768 microversion: 2.1 time: 0.394636 Sep 14 09:56:37.241668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3461/4803] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:36 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1768 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:37.625105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:37.626459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:37.636962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:37.639455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:37.641744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:37.642884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:37.644395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:37.644934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:38.030473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:38.041406 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-487be32c-25b5-49b5-9c59-f5224445da50 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1171 microversion: 2.1 time: 0.420635 Sep 14 09:56:38.042021 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1343/4804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:37 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1171 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:38.245414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:38.246694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:38.262859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:38.263720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:38.264343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:38.265211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:38.265818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:38.266395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:38.733006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:38.743225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:38.757001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70b7a189-4c28-4516-94ee-2d997f0d8235 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1768 microversion: 2.1 time: 0.515726 Sep 14 09:56:38.758147 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3462/4805] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:38 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1768 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:38.759457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:38.760191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:38.760817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:38.785212 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] Creating event network-changed:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:56:38.806109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d7b88a95-01c8-4633-8031-b803d959d996 req-d198748a-30a7-4b46-9b7d-86ccd2a43c17 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071704 Sep 14 09:56:38.807121 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1344/4806] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:56:39.065426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:39.066072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:39.079632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:39.080419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:39.081038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:39.082097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:39.082710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:39.084923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:39.433525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:39.451838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7680a45-b204-4120-9732-3569acb6f437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.390878 Sep 14 09:56:39.452781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3463/4807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:39 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:39.787614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:39.788528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:39.808298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:39.812489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:39.813037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:39.814035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:39.819295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:39.821187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:39.835060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:39.943717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:39.948076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:39.954994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:39.955646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lazy-loading 'fault' on Instance uuid 18279dd9-b598-4b74-84f2-8c3fb60075ab {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:56:40.139602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee09acc6e8184849bf71cbe9bebc0ec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5368428be82f4fb6933ec75a1d410e31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:40.153903 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-58305c1b-9d65-4153-bd60-ae42a7c082ec tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 200 len: 1384 microversion: 2.1 time: 0.371783 Sep 14 09:56:40.155308 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1345/4808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:39 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 1384 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:40.201600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01ebeda-9f94-46b2-9647-0f4865f94c43", "tag": "da77d02d-7fc6-4a5a-8fe1-cb60a5b12651"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:40.220583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:40.221354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:40.221953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:40.250402 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] Creating event network-changed:da77d02d-7fc6-4a5a-8fe1-cb60a5b12651 for instance b01ebeda-9f94-46b2-9647-0f4865f94c43 on n-h2-851028-12 Sep 14 09:56:40.258447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c96d9f5c-c1da-4fc0-894c-0210f2324685 req-afc3d55d-5976-448d-8c07-d3defaba2489 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060130 Sep 14 09:56:40.266888 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3464/4809] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:40.479217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:40.480081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:40.487025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:40.487966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:40.488568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:40.489873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:40.490492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:40.491257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:40.725418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:40.733892 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c7364af0-008c-4275-ab53-6ffeddb67139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.260798 Sep 14 09:56:40.735026 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1346/4810] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:40 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:40.862560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18279dd9-b598-4b74-84f2-8c3fb60075ab", "name": "network-vif-deleted", "tag": "9499b88d-9323-4f5f-9376-2cc881a7cbca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:40.873879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:40.874506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:40.875183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:40.890138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] Creating event network-vif-deleted:9499b88d-9323-4f5f-9376-2cc881a7cbca for instance 18279dd9-b598-4b74-84f2-8c3fb60075ab on n-h2-851028-12 Sep 14 09:56:40.895486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-57711100-b481-406d-aa1d-b03780cfe6d6 req-e7c1e793-ff59-48b0-9461-2a05e72cce8d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037744 Sep 14 09:56:40.896705 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3465/4811] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:41.184715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:41.185344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] [instance: 18279dd9-b598-4b74-84f2-8c3fb60075ab] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:41.193435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:41.193985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:41.194438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:41.195282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:41.196097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:41.196538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:41.217164 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] HTTP exception thrown: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Request method failure captured: Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab HTTP/1.1 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaTdG37HZeelz5veESXROBnKrFRY0zwJ-gDetPAApslxzTWOb7epdk5oMX7pDKqsIfILHLqD46z40yUyoLs4d7BzCkWRY8Xi2I0QRuk7AxhD8saeE-f5nSZqg32TYYdUSFofVkW92lhUuGW3zdd0mArgMEejqGSjJrf66HDV93M9AKc Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 5368428be82f4fb6933ec75a1d410e31 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5368428be82f4fb6933ec75a1d410e31", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5368428be82f4fb6933ec75a1d410e31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5368428be82f4fb6933ec75a1d410e31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5368428be82f4fb6933ec75a1d410e31"}]}] Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 5368428be82f4fb6933ec75a1d410e31 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1953297975 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestSecurityGroupsBasicOps-1953297975-project Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ee09acc6e8184849bf71cbe9bebc0ec3 Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1953297975-project Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '18279dd9-b598-4b74-84f2-8c3fb60075ab'} Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:41.218938 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Returning 404 to user: Instance 18279dd9-b598-4b74-84f2-8c3fb60075ab could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:56:41.223959 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af53c189-3828-47f3-98d9-93a2c6ddb532 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab" status: 404 len: 111 microversion: 2.1 time: 0.041698 Sep 14 09:56:41.225868 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1347/4812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:41 2022] GET /compute/v2.1/servers/18279dd9-b598-4b74-84f2-8c3fb60075ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:56:41.761561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:41.762273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:41.773233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:41.774518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:41.775353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:41.776179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:41.776714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:41.777220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:41.801527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:41.962207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:41.986822 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-69fdc388-8b8c-49ae-b01a-a34d14195cfe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.230439 Sep 14 09:56:41.987449 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3466/4813] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:41 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:43.011524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:43.012440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:43.020127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:43.020755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:43.022899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:43.024623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:43.025136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:43.025639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:43.290860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:43.300390 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f57b8ebb-40c8-4470-96f4-82998dd79018 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.293166 Sep 14 09:56:43.301063 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1348/4814] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:43 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:44.326017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:44.326655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:44.336959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:44.338048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:44.338675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:44.342510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:44.343296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:44.344122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:44.601202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:44.611006 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-413a4416-713b-41b4-9901-1785c523f2bb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.289361 Sep 14 09:56:44.611948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3467/4815] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:44 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:45.145593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c3dfad4-e763-476e-b91e-1792fd503823 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] Calling method '.version_select at 0x7f6947a3f790>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:45.152506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:45.177206 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c3dfad4-e763-476e-b91e-1792fd503823 tempest-TestSecurityGroupsBasicOps-1953297975 tempest-TestSecurityGroupsBasicOps-1953297975-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1557429075" status: 202 len: 0 microversion: 2.1 time: 0.035599 Sep 14 09:56:45.177904 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1349/4816] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 09:56:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1557429075 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:56:45.635966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:45.636515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:45.646881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:45.647354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:45.647805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:45.648826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:45.649432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:45.649880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:45.904774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:45.917212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73a3fbdb-29b2-481f-b0ec-63b53e026297 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1213 microversion: 2.1 time: 0.286462 Sep 14 09:56:45.918176 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3468/4817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:45 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1213 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:46.954964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:46.960996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:46.961916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:46.969234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:46.969793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:46.970239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:46.970955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:46.971416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:46.971847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:47.161473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:47.171180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0b610162-d4c8-40c7-9401-c8b7158f8336 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.216813 Sep 14 09:56:47.176642 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1350/4818] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:46 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:48.199677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:48.200416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:48.207500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:48.208021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:48.208458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:48.209144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:48.209595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:48.210018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:48.354049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:48.361781 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb084a94-b5bb-4f13-b24a-c0bb8f14816d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.166950 Sep 14 09:56:48.362366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3469/4819] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:48 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:49.386485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:49.387101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:49.390417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:49.395703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:49.396407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:49.396721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:49.397459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:49.397917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:49.399063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:49.550726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:49.559181 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5fb82d2-ddb2-4ae6-b218-1bbd9a1c4ef9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.177132 Sep 14 09:56:49.559765 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1351/4820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:49 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:50.583512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:50.584677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:50.592323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:50.592812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:50.593250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:50.594239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:50.594697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:50.595746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:50.737089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:50.746000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9903774-9c37-40f5-8b9b-e09a388baacf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.166966 Sep 14 09:56:50.746841 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3470/4821] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:50 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:51.769763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:51.770378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:51.777908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:51.778392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:51.778825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:51.779517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:51.779999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:51.780426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:51.920660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:51.929356 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8afcec61-32ea-4805-ad64-40c5f428a5eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.163566 Sep 14 09:56:51.930811 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1352/4822] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:51 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:52.953288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:52.953900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:52.961599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:52.962117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:52.962555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:52.963252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:52.963704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:52.964164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:53.108514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:53.116818 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5d9cd91-c75d-4125-9ecd-93dc90e9e7ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.167437 Sep 14 09:56:53.118137 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3471/4823] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:52 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:54.140514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:54.141134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:54.148098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:54.148734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:54.149430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:54.150236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:54.150699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:54.151135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:54.330163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:54.342100 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f936cbba-672c-4289-bd99-fa574695ae13 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.205321 Sep 14 09:56:54.342936 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1353/4824] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:54 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:56:55.366120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:55.366831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:55.374451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:55.375016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:55.375544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:55.376341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:55.376868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:55.377400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:55.527999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:55.534170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a1c74c1-63fe-4df1-84a1-a87fefb60029 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.172180 Sep 14 09:56:55.535517 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3472/4825] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:55 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:56.224633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01ebeda-9f94-46b2-9647-0f4865f94c43", "name": "network-vif-plugged", "status": "completed", "tag": "da77d02d-7fc6-4a5a-8fe1-cb60a5b12651"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:56:56.247685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:56.248650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:56.249082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:56.263276 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] Creating event network-vif-plugged:da77d02d-7fc6-4a5a-8fe1-cb60a5b12651 for instance b01ebeda-9f94-46b2-9647-0f4865f94c43 on n-h2-851028-12 Sep 14 09:56:56.269391 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-6060e31f-91c5-49b4-8060-724cb49281ec req-fc5e1632-407f-44dd-a75b-b4bc5ac4ed1c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047994 Sep 14 09:56:56.270224 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1354/4826] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:56:56.558259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:56.558799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:56.561497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=43 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:56:56.567020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:56.567506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:56.567968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:56.568674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:56.569121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:56.569542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:56.717255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:56.727060 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a9891a5-6a61-484a-9aa6-fbdd8352a02a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1201 microversion: 2.1 time: 0.173414 Sep 14 09:56:56.727670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3473/4827] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:56 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1201 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:57.750940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:57.751655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:57.759303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:57.759790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:57.760261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:57.760968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:57.761432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:57.761936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:57.906896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:57.915705 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd2a4265-5e09-4a74-bd4d-c207fc17b79a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1388 microversion: 2.1 time: 0.169045 Sep 14 09:56:57.916241 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1355/4828] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:57 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:57.939456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:57.941004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:57.950366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:57.950864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:57.951310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:57.952068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:57.952537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:57.952970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.417040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:58.426619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f5ed9ce-701f-4281-8f68-dfbd87fe64e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1388 microversion: 2.1 time: 0.491268 Sep 14 09:56:58.427283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3474/4829] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:57 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1388 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:58.449511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:58.450178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:58.457071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.457637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.458108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.458819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.459278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.459714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.604355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:58.612254 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0553063-4214-4158-b1a0-23a5fdcaf93e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1388 microversion: 2.1 time: 0.166760 Sep 14 09:56:58.612858 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1356/4830] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:58 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1388 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:58.636948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:58.637181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:58.644622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.645139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.645590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.646735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.647666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.648556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.676864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:56:58.767915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80852e9d-faf0-4b03-88a3-e6d0951f00b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 204 len: 0 microversion: 2.1 time: 0.135834 Sep 14 09:56:58.768807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3475/4831] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:56:58 2022] DELETE /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:56:58.780692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:58.781314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:58.788308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.788795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.789411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.790608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:58.790608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:58.791002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:58.927759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:56:58.937644 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-997c0521-a452-4b66-aa52-7b7234600a72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1394 microversion: 2.1 time: 0.163791 Sep 14 09:56:58.939463 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1357/4832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:58 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1394 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:56:59.963555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:56:59.964299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:56:59.975371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:59.975867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:59.976338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:56:59.977708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:56:59.978172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:56:59.978603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:00.120572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:00.128757 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-726ffaaa-408e-432b-8f31-72c6dc58f062 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1394 microversion: 2.1 time: 0.170120 Sep 14 09:57:00.129359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3476/4833] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:56:59 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1394 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:57:01.007497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01ebeda-9f94-46b2-9647-0f4865f94c43", "name": "network-vif-deleted", "tag": "da77d02d-7fc6-4a5a-8fe1-cb60a5b12651"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:01.021264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:01.021752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:01.022189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:01.034786 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] Creating event network-vif-deleted:da77d02d-7fc6-4a5a-8fe1-cb60a5b12651 for instance b01ebeda-9f94-46b2-9647-0f4865f94c43 on n-h2-851028-12 Sep 14 09:57:01.040973 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-b950f294-d56c-452a-93f5-44124dc4ee19 req-5ab6aacc-edba-4687-94f0-8ccbc52f2e6c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302865 Sep 14 09:57:01.041776 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1358/4834] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:01.153412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:01.154307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:01.165879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:01.166633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:01.167245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:01.173613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:01.174372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:01.174810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:01.252270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:01.262081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0754e1e-78ea-4e2b-bdcc-0e9a453e1aa6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1186 microversion: 2.1 time: 0.113809 Sep 14 09:57:01.262646 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3477/4835] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:01 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:02.287722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:02.288464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:02.296121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:02.296609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:02.297048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:02.297878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:02.298338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:02.298893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:02.371144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:02.379131 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-14e427fc-e013-4418-92fd-ab5705d99f4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1186 microversion: 2.1 time: 0.096255 Sep 14 09:57:02.379717 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1359/4836] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:02 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:03.403367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:03.404592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:03.412047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:03.412544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:03.412982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:03.413686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:03.414637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:03.414637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:03.482922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:03.491139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81d2962c-7647-4535-a913-c2a7b4b4e09a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1186 microversion: 2.1 time: 0.092592 Sep 14 09:57:03.491721 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3478/4837] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:03 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:04.514798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:04.515474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:04.522491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:04.522989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:04.524016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:04.524779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:04.525305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:04.525717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:04.592045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:04.600220 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21bb1662-745f-4015-addd-ed0d441f15b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 200 len: 1186 microversion: 2.1 time: 0.089324 Sep 14 09:57:04.600810 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1360/4838] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:04 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:05.622979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:05.623539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b01ebeda-9f94-46b2-9647-0f4865f94c43] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:05.631533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:05.632070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:05.632521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:05.633897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:05.634361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:05.634794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:05.650449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 HTTP/1.1 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b01ebeda-9f94-46b2-9647-0f4865f94c43'} Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:57:05.652302 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance b01ebeda-9f94-46b2-9647-0f4865f94c43 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53083c62-f0dd-4722-a293-14327ae71bdb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43" status: 404 len: 111 microversion: 2.1 time: 0.034941 Sep 14 09:57:05.656684 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3479/4839] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:05 2022] GET /compute/v2.1/servers/b01ebeda-9f94-46b2-9647-0f4865f94c43 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:57:10.886037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8235fc19-e2ea-486e-825a-2f22392c21f5 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Action: 'create', calling method: .version_select at 0x7f693f8464c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-559816418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCe86+RqN9J0apUxoXD+E5n3/0via1Opg1z47bgtYbmDBJj0MjP4B9ZUXk3i/qmzUD3LspwpjXe2PfzPzZIXUKuzPFbxlR3loV88p4Oa/MMQjQmJB8xs4QXF7SPwyBoN8A=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:10.905598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-8235fc19-e2ea-486e-825a-2f22392c21f5 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Getting quotas for project ad5acaec787a487d810ea5a099370530. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:57:10.910815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-8235fc19-e2ea-486e-825a-2f22392c21f5 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Getting quotas for user 1d10720d0b764d6586dafab1215e0cdc and project ad5acaec787a487d810ea5a099370530. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:57:10.938211 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8235fc19-e2ea-486e-825a-2f22392c21f5 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.057466 Sep 14 09:57:10.938835 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1361/4840] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:57:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:11.489317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:11.490770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:11.504215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:11.504945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:11.505648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:11.506784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:11.507570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:11.509626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:11.713104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:11.725481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44852911-2a97-4098-9a74-9081ab8b64d0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.244655 Sep 14 09:57:11.740284 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3480/4841] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:11 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:11.749892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:11.751152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:11.760223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:11.761129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:11.762027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:11.763667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:11.764312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:11.764909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:11.768167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=80 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:11.973243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:11.986460 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-659a36de-fa61-4f7e-8649-4690a87ee53d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.241278 Sep 14 09:57:11.987196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1362/4842] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:11 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:12.011428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:12.012093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:12.018260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.018911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.019536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.020417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.020872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.021510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.024919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:12.169875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:12.178994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6928b363-dc95-4f44-b51b-60c3e01e791c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.172523 Sep 14 09:57:12.179589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3481/4843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:12 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:12.203360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2043580526"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:12.205973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:12.214652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.215151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.215876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.216610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.217076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.217505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.278759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1923871911", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0d8000c0-92fc-472f-b822-035a47da0fc5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-559816418", "security_groups": [{"name": "tempest-secgroup-smoke-114913777"}], "networks": [{"uuid": "5f341390-9d7e-44a5-b86f-c6ea4212800d"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:12.421169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] validate_networks() for [('5f341390-9d7e-44a5-b86f-c6ea4212800d', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:57:12.447490 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-87ec6447-a911-4398-a91c-c735d20ae83f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.248113 Sep 14 09:57:12.448978 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1363/4844] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:57:12 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:57:12.963579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:57:12.964105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:57:12.964503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:57:12.964917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:57:12.965332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:57:12.975569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.976090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.977314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.978397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:12.978863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:12.979295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:12.998027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Getting quotas for project ad5acaec787a487d810ea5a099370530. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:57:13.003523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Getting quotas for user 1d10720d0b764d6586dafab1215e0cdc and project ad5acaec787a487d810ea5a099370530. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:57:13.065723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:57:13.067884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d8000c0-92fc-472f-b822-035a47da0fc5',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:57:13.235253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78ecba05-402a-4bb1-92be-091f2f57d149 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.960541 Sep 14 09:57:13.236321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3482/4845] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:57:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:57:13.248944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-87779d8c-939b-4a40-b674-36bb290c0271 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:13.249640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-87779d8c-939b-4a40-b674-36bb290c0271 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:13.309598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-87779d8c-939b-4a40-b674-36bb290c0271 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:13.318965 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-87779d8c-939b-4a40-b674-36bb290c0271 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1098 microversion: 2.1 time: 0.074121 Sep 14 09:57:13.319561 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1364/4846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:13 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1098 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:57:14.348413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:14.349741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:14.360281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:14.361250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:14.361891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:14.362784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:14.363407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:14.364027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:14.448449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:14.460211 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f30b4d3-a567-4667-b165-72202a4b8117 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1204 microversion: 2.1 time: 0.117774 Sep 14 09:57:14.462149 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3483/4847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:14 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:15.486360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:15.487669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:15.516290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:15.517718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:15.518952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:15.519682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:15.521958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:15.522398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:15.794905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:15.808913 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e9db1b0-4bba-4d74-87a3-416b78767b76 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1281 microversion: 2.1 time: 0.324659 Sep 14 09:57:15.809607 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1365/4848] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:15 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1281 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:16.409176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:16.459614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:16.460162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:16.460605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:16.506481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] Creating event network-changed:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:57:16.518532 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ea7d0cbe-7e40-4bd0-b3b4-65ae52b5565f req-40a8b08d-0441-41a1-9ef7-bf105a9cea7d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113867 Sep 14 09:57:16.519267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3484/4849] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:16.834682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:16.836825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:16.844247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:16.844742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:16.845182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:16.845903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:16.846361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:16.846797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:17.159264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:17.168828 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-16d8762b-4c32-4836-a805-9d3e5c453024 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1281 microversion: 2.1 time: 0.338015 Sep 14 09:57:17.173415 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1366/4850] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:16 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:18.006248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-plugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:18.042202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:18.044746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:18.046859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:18.076867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] Creating event network-vif-plugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:57:18.094261 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c73d4ad1-a1f8-4e9a-bd23-b1e3f02e5fa3 req-4f2b0c3b-0643-4804-9cc9-a5989ad324ef service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084514 Sep 14 09:57:18.097246 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3485/4851] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:18.197920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:18.199989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:18.210502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:18.211851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:18.212626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:18.220480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:18.225497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:18.226572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:18.434959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:18.445205 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-154125c0-56ab-4885-8653-42d349631764 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1281 microversion: 2.1 time: 0.252344 Sep 14 09:57:18.449424 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1367/4852] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:18 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:19.473594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:19.474220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:19.481919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:19.482648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:19.483280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:19.484183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:19.484796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:19.485384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:19.710080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:19.721473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1e29c4a-a9c5-48ef-91a4-4e6c712df30d tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1281 microversion: 2.1 time: 0.252729 Sep 14 09:57:19.722899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3486/4853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:19 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1281 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:20.750830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:20.751556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:20.755372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:20.761241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:20.762001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:20.762620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:20.764595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:20.765227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:20.765824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:21.006928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:21.017408 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1013d8d3-cf2c-4a02-b577-bb6d5ef33c2f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1281 microversion: 2.1 time: 0.271778 Sep 14 09:57:21.035491 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1368/4854] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:20 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:22.043726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:22.044494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:22.052021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:22.052746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:22.053377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:22.054261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:22.055449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:22.056223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:22.309521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:22.321936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-892dcbc5-4b75-4aaf-a8f8-d8e23988d006 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.284018 Sep 14 09:57:22.340817 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3487/4855] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:22 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:23.345961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:23.350992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:23.350992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:23.362377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:23.362871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:23.363309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:23.364061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:23.364513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:23.364946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:23.544505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:23.558700 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a150d95-d136-4225-b45a-d702dc709ea9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.212871 Sep 14 09:57:23.558700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1369/4856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:23 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:24.581779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:24.582480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:24.585764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:24.589986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:24.595945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:24.596843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:24.597623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:24.598631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:24.599494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:24.600189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:24.765380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:24.775093 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06089061-7842-4d7a-a089-cda963e4c06f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.197232 Sep 14 09:57:24.775696 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3488/4857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:24 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:25.805511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:25.806964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:25.814946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:25.815743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:25.816400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:25.817315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:25.817987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:25.818633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:26.010608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:26.021101 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d36e4e4d-2b4a-48d2-af87-c30693d58dcd tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.221990 Sep 14 09:57:26.032900 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1370/4858] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:25 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:27.048139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:27.048754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:27.057251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:27.059493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:27.060392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:27.061168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:27.062084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:27.062821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:27.063257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:27.265173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:27.284999 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb3fd50e-0431-4ebc-8c95-8f18ef2dcda9 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.241357 Sep 14 09:57:27.302313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3489/4859] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:27 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:28.009910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:28.010520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:28.022187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.022673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.023107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.024079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.024741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.025840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.176573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:28.184574 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e2cdb459-323d-4255-aa41-5370b574f609 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.178728 Sep 14 09:57:28.185155 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1371/4860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:28 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:28.209095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-482192885"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:28.212844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:28.219862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.220382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.220821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.221522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.221979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.222406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.308974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:28.309774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:28.316315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.316931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.317474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.318298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:28.318878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:28.319524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:28.462677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af473ee5-c343-4fb1-a60e-d5dfa15a4f94 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.258234 Sep 14 09:57:28.467994 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3490/4861] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:57:28 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:57:28.469697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:28.492345 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f418e60b-05be-4084-b556-7a376e35fb7f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.187211 Sep 14 09:57:28.493272 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1372/4862] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:28 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:57:29.517471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:29.518179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:29.525135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:29.525625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:29.526060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:29.526762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:29.527389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:29.527816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:29.670156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:29.678930 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-58ebcb03-1002-4613-9dbb-257840be912f tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.166495 Sep 14 09:57:29.679526 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3491/4863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:29 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:30.705115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:30.705685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:30.713077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:30.713568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:30.714013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:30.714719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:30.715176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:30.715606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:30.850721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:30.859588 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1fc78cfc-cb81-4a5c-a412-ef97bc3980e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.158772 Sep 14 09:57:30.860196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1373/4864] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:30 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:31.886979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:31.886979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:31.903191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:31.904029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:31.904776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:31.906155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:31.906647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:31.907163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:32.067846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-unplugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:32.083650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:32.084175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:32.084611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:32.121942 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] Creating event network-vif-unplugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:57:32.127550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:32.139424 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e2bfca23-6ff8-448a-9100-0d8f7cb54f49 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.259987 Sep 14 09:57:32.140055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3492/4865] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:31 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:32.152572 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-41a4c24c-75eb-4e13-9199-6f025c99a22a req-8bdd88da-421e-434e-a5ac-e97e5f9a4926 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071985 Sep 14 09:57:32.154993 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1374/4866] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:33.165438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:33.167021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:33.178596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:33.179339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:33.180159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:33.181205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:33.181872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:33.182502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:33.377733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:33.386456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8dfa178a-b672-40f9-8436-a2ef267204b8 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.225186 Sep 14 09:57:33.387046 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3493/4867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:33 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:33.515366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2131022345", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7fa6281e-bbe3-4176-b9c2-34847b9da705", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:33.627359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:57:34.188407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "name": "network-vif-plugged", "status": "completed", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}, {"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-plugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:34.201762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:34.202636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:34.203425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:34.212341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:57:34.212733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:57:34.213209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:57:34.213620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:57:34.214032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:57:34.222935 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Creating event network-vif-plugged:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:57:34.223942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] Creating event network-vif-plugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:57:34.228382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:34.228879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:34.229321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:34.230060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:34.230520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:34.230947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:34.238019 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d92e94c6-5739-4dd4-b13c-4ffc6aba2b14 req-79b48552-69ce-43eb-a327-2c41cd07f00b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057242 Sep 14 09:57:34.239449 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3494/4868] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:57:34.257664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:57:34.266899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:57:34.293188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:57:34.295515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7fa6281e-bbe3-4176-b9c2-34847b9da705',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:57:34.390439 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06037b42-ddc2-420d-b673-99e1c8ee07d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879619 Sep 14 09:57:34.406374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cf79b35-1472-4d7e-bc91-62053b71fec2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:34.407606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cf79b35-1472-4d7e-bc91-62053b71fec2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:34.409895 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1375/4869] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:57:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:57:34.415636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:34.421378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:34.451557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:34.465518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:34.466351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:34.475078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:34.475848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:34.476343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:34.503398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cf79b35-1472-4d7e-bc91-62053b71fec2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:34.513492 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cf79b35-1472-4d7e-bc91-62053b71fec2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1057 microversion: 2.1 time: 0.114010 Sep 14 09:57:34.514764 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3495/4870] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:34 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1057 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:34.686525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:34.699621 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56d4e338-ea81-453e-b9d2-177ad7316919 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1269 microversion: 2.1 time: 0.288379 Sep 14 09:57:34.700512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1376/4871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:34 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1269 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:35.537587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:35.539353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:35.548233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:35.549423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:35.549992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:35.550785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:35.551418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:35.551864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:35.633923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:35.649739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b02cfc48-735f-4fb8-99af-db3be5db4143 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1109 microversion: 2.1 time: 0.115878 Sep 14 09:57:35.664122 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3496/4872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:35 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1109 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:35.729465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:35.730107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:35.756206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:35.756693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:35.759587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:35.760590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:35.761288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:35.762234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:35.974388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:35.986622 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8de36002-a805-44ee-8657-2f804f806086 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1458 microversion: 2.1 time: 0.263515 Sep 14 09:57:35.988231 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1377/4873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:35 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1458 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:36.012573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:36.013211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:36.020595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:36.021082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:36.021692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:36.023170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:36.024478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:36.025498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:36.365940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:36.381793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb7be08c-a997-423a-8525-7a31a70623ea tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1458 microversion: 2.1 time: 0.373594 Sep 14 09:57:36.382402 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3497/4874] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:36 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1458 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:36.673519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:36.674443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:36.685876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:36.689935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:36.690618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:36.691511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:36.692178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:36.692806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:37.529923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:37.542470 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9253785-19fc-4eb2-b9d2-384dd35cc810 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.872802 Sep 14 09:57:37.543074 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1378/4875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:36 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:38.171210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb2a8d5-c095-4ad7-9f63-27f673b1e427", "tag": "327c629e-c205-4c88-b5a2-e81503b98043"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:38.191303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:38.191805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:38.192628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:38.208285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] Creating event network-changed:327c629e-c205-4c88-b5a2-e81503b98043 for instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 on n-h1-851028-12 Sep 14 09:57:38.223593 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4f604294-b365-4644-aa6e-4ae9c3257d4f req-860149ab-4f6c-425d-8261-14f694c0b892 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055996 Sep 14 09:57:38.224893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3498/4876] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:38.567381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:38.568165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:38.581064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:38.582069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:38.582776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:38.583719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:38.584815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:38.585482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:39.105266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:39.107934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:39.121444 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41859f78-07f6-498c-abf9-714bf4a09953 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.558672 Sep 14 09:57:39.124295 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1379/4877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:38 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:39.847467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:39.893145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:39.893980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:39.894654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:39.912215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] Creating event network-changed:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:57:39.918748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-77b4af19-5bc3-4ab1-b36d-876af346f477 req-9637d89d-ec45-4187-852c-6ef32b3ac5d0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075824 Sep 14 09:57:39.920218 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3499/4878] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:40.155258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:40.155909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:40.189688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:40.190190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:40.190624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:40.191337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:40.201459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:40.203484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:40.571948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:40.584702 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6e77e059-2ff5-49f7-b6f0-88f8ce450b34 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.441802 Sep 14 09:57:40.592357 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1380/4879] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:40 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:41.659181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:41.659921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:41.688331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:41.694284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:41.696212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:41.697600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:41.698512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:41.707143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:41.956922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:41.966924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb110fc3-44b6-490e-8461-53a0ddd8e4b2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.321272 Sep 14 09:57:41.997153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3500/4880] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:41 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:42.622959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:42.655334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:42.655826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:42.669474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:42.707371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] Creating event network-changed:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:57:42.721854 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7a863f74-ee3e-44ab-8ddd-465eccf015a0 req-049f9e5b-0b94-471d-938e-c8dde83a7205 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107655 Sep 14 09:57:42.722833 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1381/4881] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:57:42.991321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:42.994270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:43.013648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:43.014170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:43.014623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:43.016912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:43.016912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:43.025586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:43.031797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:43.272103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:43.307172 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47002653-fa5c-4b7f-a131-3f45cfe5bb4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.317286 Sep 14 09:57:43.308422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3501/4882] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:42 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:44.336146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:44.337118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:44.340308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:44.342129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:44.349008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:44.349710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:44.350380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:44.351261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:44.352177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:44.353082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:44.596620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:44.613872 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-48d60a4f-bd0b-4157-8f79-7b0442e665fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.282276 Sep 14 09:57:44.613989 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1382/4883] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:44 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:44.753129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:44.760088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:44.767145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:44.767951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:44.768591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:44.782120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] Creating event network-changed:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:57:44.788545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-87740ad3-dcc0-451e-85e4-acb16fcda901 req-14a8013b-487a-4687-94e5-601a71de19a0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047032 Sep 14 09:57:44.789309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3502/4884] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:45.642857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:45.644610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:45.652315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:45.653122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:45.653786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:45.654594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:45.655414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:45.656106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:45.914648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:45.924120 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-270ed7be-e5be-46d1-adca-9f43ace371a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.285005 Sep 14 09:57:45.940514 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1383/4885] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:45 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:46.951258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:46.952727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:46.961924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.962717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.963411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:46.964347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:46.965204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:46.965869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:47.132595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:47.149221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94c47830-10fc-4046-84a8-88a90f6e55cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.202964 Sep 14 09:57:47.165255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3503/4886] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:46 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:47.327201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:47.327874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:47.335382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:47.335920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:47.337013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:47.337743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:47.338376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:47.338946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:47.495591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:47.505858 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9dc311dc-e9ca-484a-b1bb-df904e4d87f6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.182423 Sep 14 09:57:47.507296 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1384/4887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:47 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:57:48.173622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:48.174310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:48.182152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.182648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.183070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.183773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.184256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.184683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.325644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:48.333432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f83df8ca-767a-48b3-a7a2-e4a0d5e0ece8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.164013 Sep 14 09:57:48.334022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3504/4888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:48 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:48.530687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:48.531312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:48.538436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.538924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.540267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.541005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.541476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.541909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.672966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:48.680905 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-009c78c1-56aa-403e-a59f-46b7bcbbdf0f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.153981 Sep 14 09:57:48.681492 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1385/4889] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:48 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:48.704042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-458537940"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:48.706461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:48.713325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.713809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.714248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.714949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.715406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.715828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.913109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01d885fe-778b-479e-b34d-91c6632d5885 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.213065 Sep 14 09:57:48.913788 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3505/4890] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:57:48 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 14 09:57:48.922533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:48.923799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:48.929857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.930881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.931484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:48.932252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:48.932698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:48.933300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:49.081874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:49.090810 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7e73562f-082e-4995-929e-bbf3a720aa20 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.172151 Sep 14 09:57:49.091595 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1386/4891] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:48 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:49.358652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:49.359240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:49.365649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:49.366143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:49.366593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:49.367782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:49.368267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:49.368700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:49.513896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:49.521875 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29582787-af78-4253-acf9-c185745ad886 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.168405 Sep 14 09:57:49.522462 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3506/4892] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:49 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:50.114751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:50.115401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:50.124593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.125087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.125623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.126477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.127047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.127527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.282186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:50.291379 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-016d3072-146a-4146-8383-f2769f4ab366 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.180801 Sep 14 09:57:50.292433 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1387/4893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:50 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:50.545691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:50.546384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:50.553627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.554187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.554741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.555740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:50.556282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:50.556782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:50.696349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:50.704379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60cc79fe-cace-4873-86ba-e1c7b8f697b0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.162690 Sep 14 09:57:50.704960 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3507/4894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:50 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:51.316680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:51.317302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:51.319802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:51.326569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.327102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.327663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.328395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.329203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.329633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.467001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:51.475375 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf5feb57-eac3-44de-a0ab-d22f5febcb75 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1689 microversion: 2.1 time: 0.162678 Sep 14 09:57:51.475980 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1388/4895] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:51 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:51.727999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:51.728655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:51.737472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.737472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.737472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.737472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:51.737876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:51.738133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:51.874842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:51.882712 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9fe6da1f-21e2-4b81-bf5b-a13cff07351d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.159412 Sep 14 09:57:51.883865 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3508/4896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:51 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:52.189673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-unplugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:52.201157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.201697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.202133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.219048 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] Creating event network-vif-unplugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:57:52.225434 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-6afe0f7f-6f91-48a0-8cb3-f282c516db8d req-37611e32-5aa0-417e-9bfb-1665302f899d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041027 Sep 14 09:57:52.226679 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1389/4897] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:52.502824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:52.503585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:52.512255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.513017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.513534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.514315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.515174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.515673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.675740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:52.687045 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-792a7b16-698e-4912-819c-b14171892462 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.189593 Sep 14 09:57:52.688484 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3509/4898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:52.910182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:52.912114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:52.927978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.928782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.932369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:52.933374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:52.934013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:52.934605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:53.153934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:53.180758 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-972f41ea-7baa-4f09-b358-098e2be24a58 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1169 microversion: 2.1 time: 0.277399 Sep 14 09:57:53.192461 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1390/4899] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:52 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1169 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:53.713047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:53.714501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:53.724529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:53.725408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:53.726099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:53.727934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:53.728983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:53.729810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:53.894848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:53.906602 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c121ec9-1094-40ed-9202-5aba74eafa4f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.198800 Sep 14 09:57:53.907294 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3510/4900] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:54.205405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:54.206245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:54.215275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:54.216031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:54.216477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:54.217292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:54.218433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:54.218823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:54.435486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:54.445490 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e45be4b-d4e7-46b4-bac8-1e4d4c1cb269 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1215 microversion: 2.1 time: 0.243428 Sep 14 09:57:54.446846 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1391/4901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:54 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:54.457849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-plugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:57:54.469592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:54.470397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:54.471057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:54.485347 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] Creating event network-vif-plugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:57:54.490707 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1498f0be-0f5e-4fa1-b5fa-4780e7901004 req-f0b32b16-5cdd-44fc-a02f-5d97298b5357 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037688 Sep 14 09:57:54.492365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3511/4902] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:57:54.933763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:54.934772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:54.941180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:54.941680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:54.942123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:54.942835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:54.943296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:54.943729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.090747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:55.099382 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cde1a708-e06c-40a3-8f30-2825c1277f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.170336 Sep 14 09:57:55.118280 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1392/4903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:54 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:55.472555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:55.474032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:55.481467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.482375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.483042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.484048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:55.484737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:55.485384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:55.644124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:55.653179 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5fee593-04ba-4e11-9c73-fdaff984fb87 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.186338 Sep 14 09:57:55.654090 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3512/4904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:55 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:56.124289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:56.125500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:56.133302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.134085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.134565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:56.135264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.135727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.136197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:56.301704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:56.311261 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28038809-f2ac-4251-b533-a9f66ebddc2e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.191110 Sep 14 09:57:56.320514 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1393/4905] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:56 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:56.678511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:56.679858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:56.688158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.689060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.689723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:56.690442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:56.691141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:56.691813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:56.856474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:56.865596 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f016841e-f866-42aa-89d5-c820bfac9ba3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.190859 Sep 14 09:57:56.866844 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3513/4906] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:56 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:57.336464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:57.337650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:57.345079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:57.345573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:57.346016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:57.346870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:57.347333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:57.347800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:57.526219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:57.542743 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3bcd3860-d65d-43fb-8fe9-e5243508a3e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.210985 Sep 14 09:57:57.552351 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1394/4907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:57 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:57.890157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:57.890885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:57.894030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=52 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:57:57.900701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:57.901689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:57.902367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:57.903186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:57.903653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:57.904123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.056058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:58.066096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6c027cf4-b476-4eaa-b3b9-1085cfaa50e1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.179749 Sep 14 09:57:58.083374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3514/4908] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:57 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:58.568324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:58.568982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:58.576916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:58.577474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:58.577922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.578650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:58.579114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:58.579544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:58.737121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:58.747205 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc6d2fa6-0e06-4224-9de6-aeb31fd5ac3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.182770 Sep 14 09:57:58.762122 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1395/4909] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:58 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:59.091949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:59.092588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:59.100549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.101049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.101537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.102348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.102869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.103389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.269098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:59.278614 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c827d700-cdea-473c-ac76-80fc010550ed tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.190599 Sep 14 09:57:59.279535 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3515/4910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:59 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:57:59.775671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:57:59.776433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:57:59.790842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.791508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.791977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.792705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:57:59.793172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:57:59.793597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:57:59.965347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:57:59.977862 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b518321-218b-4bbf-8db5-1d0e5e9855e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.206801 Sep 14 09:57:59.979132 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1396/4911] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:57:59 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:00.302512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:00.303315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:00.313629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:00.314355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:00.314822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:00.315560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:00.316536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:00.317009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:00.472593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:00.482310 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e61ec6ad-34c2-4059-81d6-19ef2ead6922 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.183708 Sep 14 09:58:00.483182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3516/4912] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:00 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:01.005612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:01.007103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:01.019368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:01.020053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:01.020519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:01.021259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:01.021723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:01.022241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:01.202704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:01.205477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:01.216841 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a88c9bb0-88ba-43a6-98b7-5928adcf3c27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.215020 Sep 14 09:58:01.234782 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1397/4913] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:01 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:01.508179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:01.510646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:01.520946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:01.521856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:01.522551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:01.523347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:01.525182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:01.525865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:01.692600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:01.695103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:01.706245 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c30911d9-108d-4852-b77a-a95c34d861f5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.201841 Sep 14 09:58:01.707441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3517/4914] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:01 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:02.243651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:02.244274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:02.251031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:02.251515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:02.252008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:02.252700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:02.253155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:02.253582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:02.388512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:02.396313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-beae391b-cf9f-4704-a0f9-60f8235e3342 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1684 microversion: 2.1 time: 0.157477 Sep 14 09:58:02.396890 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1398/4915] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:02 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:02.730645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:02.731172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:02.739530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:02.740487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:02.740487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:02.741159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:02.741610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:02.742033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:02.885873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:02.894197 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3dc582f0-f127-4847-8a67-28d0e41ddc8c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.168038 Sep 14 09:58:02.894776 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3518/4916] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:02 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:03.420875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:03.421487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:03.428561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.428989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.429428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:03.430217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.430867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.431299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:03.570000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:03.579005 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97d4da2b-b78d-4f91-b428-8bbde561e41f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.162048 Sep 14 09:58:03.579572 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1399/4917] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:03 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:03.698201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:03.699024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:03.706500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.706992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.707436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:03.708178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.708643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.709078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:03.856777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:03.866394 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a07a421-be32-4729-a85f-c75bd323e828 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.174178 Sep 14 09:58:03.867950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3519/4918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:03 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:03.918963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:03.919878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:03.927064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.927671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.928204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:03.929158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:03.929889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:03.931249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:04.076274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:04.085720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6c6db4df-d960-45ef-88df-7967db9d420b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.171243 Sep 14 09:58:04.087579 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1400/4919] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:03 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:04.814977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:04.815971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:04.824626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:04.825229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:04.825739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:04.826482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:04.826953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:04.827383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:04.971405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:04.980591 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-914d7c60-51b6-4a0c-b90d-16b11d140ed6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.170066 Sep 14 09:58:04.981134 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3520/4920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:04 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:05.004949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:05.005624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:05.013646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.014124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.014556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.015244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.015694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.016148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.109834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:05.110454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:05.116778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.118072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.118728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.119658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.120085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.120526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.152952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:05.168127 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-69a994ef-2e17-41af-83fe-59420e4bd79d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.167210 Sep 14 09:58:05.169095 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1401/4921] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:04 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:05.191886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:05.192526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:05.199451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.199966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.200403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.201228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.202040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.202655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.259439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:05.269004 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-71f1663b-5755-4ac5-bd48-d46b3dc6944c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.162975 Sep 14 09:58:05.269790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3521/4922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:05 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:05.347230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:05.355147 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b03bc8b3-68c8-4cec-ab17-98407b2d560a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.167093 Sep 14 09:58:05.355729 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1402/4923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:05 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:05.380123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:05.382449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:05.389793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.390371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.390996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.391701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.392189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.392651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.483491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-321ee7fa-c760-4f10-85dd-eee97c1c5126 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.107836 Sep 14 09:58:05.484208 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3522/4924] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:58:05 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:58:05.494517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:05.495272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:05.502120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.502618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.503167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.503836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:05.504333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:05.504818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:05.658200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:05.667084 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-95579cd8-96f3-469b-97b5-46acacee01c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1673 microversion: 2.1 time: 0.178114 Sep 14 09:58:05.667684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1403/4925] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:05 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:06.170622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb2a8d5-c095-4ad7-9f63-27f673b1e427", "name": "network-vif-plugged", "status": "completed", "tag": "327c629e-c205-4c88-b5a2-e81503b98043"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:06.183385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:06.183854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:06.184561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:06.198565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] Creating event network-vif-plugged:327c629e-c205-4c88-b5a2-e81503b98043 for instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 on n-h1-851028-12 Sep 14 09:58:06.204464 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9e846023-2ce7-4445-b4f0-a1974b2b3e74 req-00f71146-c60d-4356-a76b-d8a82c647d30 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038142 Sep 14 09:58:06.205393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3523/4926] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:06.295631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:06.296580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:06.303634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:06.304312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:06.304751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:06.306650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:06.306783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:06.307138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:06.460608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:06.468712 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d137c8ae-ba34-4fb1-a975-058e6c976991 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1203 microversion: 2.1 time: 0.177432 Sep 14 09:58:06.469302 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1404/4927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:06 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1203 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:06.692327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:06.692591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:06.699564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:06.700094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:06.700564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:06.701313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:06.701772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:06.702200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:06.855242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:06.863206 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-270915f8-84a6-4f83-9604-5cec43284a35 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1678 microversion: 2.1 time: 0.176098 Sep 14 09:58:06.863781 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3524/4928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:06 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:07.492080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:07.494035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:07.501089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.501580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.502018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.502712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.503200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.503625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.641975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:07.650092 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-99365337-21ea-4783-813a-4c1502113fa8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1390 microversion: 2.1 time: 0.161943 Sep 14 09:58:07.650668 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1405/4929] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:07 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:07.672525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:07.673148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:07.680777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.681520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.681967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.682683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.683170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.683545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.818908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:07.827677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ede14aab-592b-4fa8-bb78-2a6eb78606e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1390 microversion: 2.1 time: 0.159028 Sep 14 09:58:07.828302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3525/4930] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:07 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:07.850520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:07.851134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:07.857598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.858080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.858515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.859210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.859719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.860264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.887540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:07.888194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:07.894650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.895144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.895588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.896371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:07.896831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:07.897259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:07.998500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.006975 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac266502-be2d-46bd-bc03-2d68f3fc38ac tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1390 microversion: 2.1 time: 0.160240 Sep 14 09:58:08.007572 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1406/4931] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:07 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:08.044941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.053799 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bd6e7948-dcc3-4b85-ae02-72bb1672f2d6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.170843 Sep 14 09:58:08.054413 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3526/4932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:07 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:08.076811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:08.079098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.085037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.085526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.085961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.087173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.087622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.088128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.094380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.094923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.101055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.101555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.102627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.103381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.103846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.104312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.133682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:58:08.146499 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85b5265f-9b3a-4e29-9d8d-57423a723388 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 200 len: 145 microversion: 2.1 time: 0.073325 Sep 14 09:58:08.149758 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1407/4933] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:58:08 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:08.160806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.161521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.169560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.170301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.170748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.171459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.171928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.172538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.237190 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d384db3-3260-4507-bef9-e32cb989c0cd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 204 len: 0 microversion: 2.1 time: 0.147255 Sep 14 09:58:08.237821 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3527/4934] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:58:08 2022] DELETE /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 09:58:08.244016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-unplugged", "status": "completed", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:08.253774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.254256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.254678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.267293 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] Creating event network-vif-unplugged:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 09:58:08.272311 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4447c861-c5dc-4ae8-9112-5195b4133a57 req-2337eb38-6d13-4db6-ae1f-23856cac9e0c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033162 Sep 14 09:58:08.272916 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3528/4935] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:08.279952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.280665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.287410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.287942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.288395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.289114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.289834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.290243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.327205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.338091 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-361be34b-3694-4625-9190-77e5fe380e0e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.181873 Sep 14 09:58:08.339074 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1408/4936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:08 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:08.364340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.364609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.372127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.372591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.373041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.373962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.374473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.374903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.452459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.460773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edfd1ff3-4b39-43c1-9008-284bb98a5b41 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1396 microversion: 2.1 time: 0.185331 Sep 14 09:58:08.461443 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3529/4937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:08 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1396 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:08.523685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.531499 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f98922b-524c-4c38-ae51-b0645fb254bf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.171751 Sep 14 09:58:08.532121 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1409/4938] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:08 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:08.554990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.556191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.562339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.562943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.563446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.564988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.564988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.564988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.700388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.708891 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a424f0d-b0b0-42eb-9ff8-d97118b51ed3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.157822 Sep 14 09:58:08.709703 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3530/4939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:08 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:08.732590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:08.733235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:08.740249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.740832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.741310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.742017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:08.743651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:08.744183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:08.880785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:08.888982 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-27d47ab5-ea75-4af6-a371-c9ec3043ce34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.160308 Sep 14 09:58:08.889560 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1410/4940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:08 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:09.007993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-733097037", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "f52c1506-ea12-48d0-a2b1-2b338e6679a6"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:09.066883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] validate_networks() for [('f52c1506-ea12-48d0-a2b1-2b338e6679a6', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:58:09.484504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:09.485117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:09.491873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.492673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.494315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.495006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.495457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.495882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.635096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:09.643988 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-053ed3fe-3002-4e4c-aca2-c6d61dfe2550 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1396 microversion: 2.1 time: 0.163287 Sep 14 09:58:09.644809 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1411/4941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:09 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:09.758069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:58:09.758544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:58:09.758983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:58:09.759532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:58:09.759987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:58:09.769342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.769838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.770312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.771052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:09.771503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:09.771950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:09.791121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:58:09.797004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:58:09.810785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:58:09.813132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:58:09.864468 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c20f815-a046-4250-9f2a-1ab1204230c6 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860230 Sep 14 09:58:09.865141 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3531/4942] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:58:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:58:09.877015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c8ec6bd2-9170-444f-bc39-7f6b167c6506 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:09.877787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c8ec6bd2-9170-444f-bc39-7f6b167c6506 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:09.941598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c8ec6bd2-9170-444f-bc39-7f6b167c6506 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:09.949477 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c8ec6bd2-9170-444f-bc39-7f6b167c6506 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1214 microversion: 2.1 time: 0.076161 Sep 14 09:58:09.950221 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1412/4943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:09 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:10.270807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb2a8d5-c095-4ad7-9f63-27f673b1e427", "name": "network-vif-deleted", "tag": "327c629e-c205-4c88-b5a2-e81503b98043"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:10.285169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:10.285678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:10.286107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:10.304145 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] Creating event network-vif-deleted:327c629e-c205-4c88-b5a2-e81503b98043 for instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 on n-h1-851028-12 Sep 14 09:58:10.319619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-fd105f94-01d4-4826-a92e-a3925a547d36 req-c9be4b11-8f87-4ade-b869-ea778d0c5551 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052452 Sep 14 09:58:10.320490 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3532/4944] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:10.669822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:10.671107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:10.678913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:10.679407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:10.679820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:10.681312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:10.681778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:10.682182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:10.755003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:10.763421 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ce08983a-81b4-4260-9649-12fd7d737449 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1188 microversion: 2.1 time: 0.099194 Sep 14 09:58:10.764037 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1413/4945] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:10 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:10.974540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:10.975975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:10.983499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:10.984176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:10.984835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:10.985770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:10.986477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:10.987110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:11.096981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:11.108895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5a0ea26-692b-4ea4-9edf-61fa03af3aeb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1274 microversion: 2.1 time: 0.140043 Sep 14 09:58:11.124552 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3533/4946] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:10 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:11.788600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:11.789066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:11.797513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:11.798314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:11.799128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:11.800059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:11.800951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:11.801875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:11.917027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:11.928022 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd27b742-b56e-4a86-990e-ea6574337b7a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1188 microversion: 2.1 time: 0.143404 Sep 14 09:58:11.929443 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1414/4947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:11 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:12.135636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:12.136910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:12.146163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.147086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.147879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.149559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.150199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.150791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.212806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:12.423154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:12.423655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:12.436881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.438006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.438481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.442020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.442476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:12.442618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.442968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.455180 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a792b404-348d-44be-a87a-bac9f851d7ae tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.324409 Sep 14 09:58:12.456350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3534/4948] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:12 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:12.462909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:12.483316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.484408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.485442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.502747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] Creating event network-changed:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:58:12.510614 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-af010f18-ccb5-4da5-a38f-dc8b6e1f4f18 req-b8fed77b-c095-4a71-8e8f-ddc6cd17f286 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052612 Sep 14 09:58:12.512827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:58:12.515503 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3535/4949] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:12.517875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:12.707659 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9c6acdfc-1b5e-40d6-ade1-49e0f1ef6046 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 204 len: 0 microversion: 2.1 time: 0.288134 Sep 14 09:58:12.708488 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1415/4950] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:58:12 2022] DELETE /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:58:12.719509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:12.720525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:12.730226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.732111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.732792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.734357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.735109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.736468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.896931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d5566-3af9-4807-accc-b3549fa5d3df", "tag": "cf318809-dfad-4611-b2be-f4299af9dd7e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:12.919309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.919795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.921056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.943322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] Creating event network-changed:cf318809-dfad-4611-b2be-f4299af9dd7e for instance 734d5566-3af9-4807-accc-b3549fa5d3df on n-h2-851028-12 Sep 14 09:58:12.955551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8f4ae93c-b3de-4f49-b11d-3f448553588b req-431bcf46-875d-47af-9028-267691669296 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062211 Sep 14 09:58:12.958408 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1416/4951] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:58:12.967070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:12.973198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:12.974128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:12.981483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.981971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.982407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.983108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:12.983555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:12.984009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:12.986333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d9a9e4a-1a03-4d8b-8307-e8523765968a tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1581 microversion: 2.1 time: 0.272160 Sep 14 09:58:12.991064 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3536/4952] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:12 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1581 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:13.067924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:13.078197 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f86e0ce-fbb4-40cf-b95a-268fb3cba305 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1188 microversion: 2.1 time: 0.113834 Sep 14 09:58:13.079723 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1417/4953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:12 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1188 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:13.481293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:13.482022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:13.488679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:13.489181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:13.489815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:13.490537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:13.491162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:13.491786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:13.643887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:13.653347 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7672fa88-4a63-46b0-9fab-9d675c18939a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.177114 Sep 14 09:58:13.654496 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3537/4954] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:13 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:14.017346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:14.018583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:14.027330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.028117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.028706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.029579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.030195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.030774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.105659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:14.106413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:14.114823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.115508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.116089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.116990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.118940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.118940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.205590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:14.221172 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4be0e643-453c-40da-9c38-64df138624cf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1188 microversion: 2.1 time: 0.121567 Sep 14 09:58:14.223372 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3538/4955] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:14 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1188 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:14.413659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:14.422125 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bef73a61-2328-484f-92f7-dd3382f100e3 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1581 microversion: 2.1 time: 0.409317 Sep 14 09:58:14.436299 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1418/4956] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:14 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1581 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:14.677993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:14.679684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:14.688400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.689591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.690274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.691233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:14.691920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:14.692561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:14.858102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:14.869451 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a29baf66-9a06-4ff0-aebc-61ac67ace0b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.196252 Sep 14 09:58:14.870152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3539/4957] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:14 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:15.248152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:15.249669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:15.258931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.260476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.261144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.262570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.263949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.264908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.312061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.312939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.313563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.314277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lazy-loading 'fault' on Instance uuid deb2a8d5-c095-4ad7-9f63-27f673b1e427 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:58:15.385138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:15.393534 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-70faa63f-f7d9-41eb-841d-f37e3bbb57f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 200 len: 1193 microversion: 2.1 time: 0.151563 Sep 14 09:58:15.394278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1419/4958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:15 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 1193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:15.447165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:15.447986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:15.455144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.455669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.456237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.456953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.457726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.458169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.545973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:15.562828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b04e75d-ed76-4d75-97a2-680d73ced573", "name": "network-vif-deleted", "tag": "6770f28e-2449-4fbe-9903-8b9b0f4a3de2"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:15.563869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23a2da41-2b23-4660-8db5-257587c5ba34 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1397 microversion: 2.1 time: 0.120932 Sep 14 09:58:15.578314 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3540/4959] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:15 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1397 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:15.600092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.603551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.604066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.621460 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] Creating event network-vif-deleted:6770f28e-2449-4fbe-9903-8b9b0f4a3de2 for instance 0b04e75d-ed76-4d75-97a2-680d73ced573 on n-h2-851028-12 Sep 14 09:58:15.632114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-fb101671-6d69-4af2-891f-69cd93815ce4 req-d7f44dcf-15a2-4359-a8d2-a32e0f402fe1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076709 Sep 14 09:58:15.639349 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1420/4960] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:15.893327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:15.893949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:15.901177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.901820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.902369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:15.903387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:15.904006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:15.904668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.055990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:16.064315 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-52cb7985-5001-474b-ad26-7a5322fec4e5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.174805 Sep 14 09:58:16.064957 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3541/4961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:15 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:16.421235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:16.422164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:16.428947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.429546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.430163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.431321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.431881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.432432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.446843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 HTTP/1.1 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'deb2a8d5-c095-4ad7-9f63-27f673b1e427'} Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:16.448765 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:16.453749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:58:16.454815 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cadebcde-73a8-437e-ab32-7369fc455ebd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 404 len: 111 microversion: 2.1 time: 0.038835 Sep 14 09:58:16.455736 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1421/4962] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:16 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:58:16.588918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:16.589528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:16.596067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.596549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.596979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.597667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:16.598114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:16.598535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:16.666815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:16.676350 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a185e383-9548-478c-9a35-f3b949ecd565 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1229 microversion: 2.1 time: 0.091420 Sep 14 09:58:16.676947 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3542/4963] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:16 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:17.089388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:17.090168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:17.096650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.097249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.097785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:17.098655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.099328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.099847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:17.261457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:17.271398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-19959d44-6126-46bf-bf8d-278796fc8ff0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.186577 Sep 14 09:58:17.272195 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1422/4964] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:17 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:17.701345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:17.702336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:17.710271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.710958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.712377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:17.713271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:17.713904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:17.714342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:17.786826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:17.802916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e81c9de1-6e13-4a60-89c8-fa5605246185 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1229 microversion: 2.1 time: 0.105585 Sep 14 09:58:17.803569 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3543/4965] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:17 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:18.297140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:18.298049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:18.306288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.306755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.307221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.308001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.308462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.308891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.464013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:18.476055 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d81473e1-e5b8-4566-b4bb-79e6f31d11e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.182747 Sep 14 09:58:18.482682 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1423/4966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:18 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:18.610442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:18.610954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:18.627680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.628518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.629130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.630269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.630905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.631539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.648632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 HTTP/1.1 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'deb2a8d5-c095-4ad7-9f63-27f673b1e427'} Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:58:18.650602 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.655305 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.656901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:58:18.657950 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-71100cc0-5bc5-4d95-a9fc-dded6ff966dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 404 len: 111 microversion: 2.1 time: 0.051904 Sep 14 09:58:18.659056 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3544/4967] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:58:18 2022] DELETE /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:58:18.668684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:18.670824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: deb2a8d5-c095-4ad7-9f63-27f673b1e427] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:18.680948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.681502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.681939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.682649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.683102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.683521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.704391 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 HTTP/1.1 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'deb2a8d5-c095-4ad7-9f63-27f673b1e427'} Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:18.706152 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. Sep 14 09:58:18.710872 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:18.712505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance deb2a8d5-c095-4ad7-9f63-27f673b1e427 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:58:18.713355 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12a44e3c-6f84-46d7-aceb-5a64410dc943 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427" status: 404 len: 111 microversion: 2.1 time: 0.049804 Sep 14 09:58:18.713916 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1424/4968] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:18 2022] GET /compute/v2.1/servers/deb2a8d5-c095-4ad7-9f63-27f673b1e427 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:58:18.829534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:18.830412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:18.839448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.840211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.840718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.842257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:18.842734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:18.843173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:18.938414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:18.951412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a97e4d8-ab79-49a5-a207-cdb55d3b5d66 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1229 microversion: 2.1 time: 0.125744 Sep 14 09:58:18.972870 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3545/4969] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:18 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:19.499640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:19.500273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:19.508003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.509100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.509536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:19.510237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.510681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.511098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:19.656970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:19.666405 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-348ef336-9460-4aaa-b326-016ffd33d904 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.170628 Sep 14 09:58:19.667160 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1425/4970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:19 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:19.981112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:19.982013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:19.986035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:19.987450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:19.995022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.995516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.995972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:19.996733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:19.997185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:19.997608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.080763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d10720d0b764d6586dafab1215e0cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad5acaec787a487d810ea5a099370530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:20.092859 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-929869db-8ea8-4160-aca8-d8ec0d352b9c tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 200 len: 1229 microversion: 2.1 time: 0.117507 Sep 14 09:58:20.093504 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3546/4971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:19 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:20.561846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5566-3af9-4807-accc-b3549fa5d3df", "name": "network-vif-plugged", "status": "completed", "tag": "cf318809-dfad-4611-b2be-f4299af9dd7e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:20.567157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:20.574011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:20.574494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:20.575099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.587938 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] Creating event network-vif-plugged:cf318809-dfad-4611-b2be-f4299af9dd7e for instance 734d5566-3af9-4807-accc-b3549fa5d3df on n-h2-851028-12 Sep 14 09:58:20.592959 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ee4d2390-bc7c-445c-aaf6-0d499a6c1def req-e7929f02-32ca-4221-9460-58d7c44d69df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034844 Sep 14 09:58:20.593736 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1426/4972] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:58:20.691815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:20.692464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:20.699777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:20.700298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:20.700740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.701434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:20.701891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:20.702317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:20.932257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:20.940143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2a15d4f7-5a62-4c79-9071-9caa14c39a19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1314 microversion: 2.1 time: 0.252169 Sep 14 09:58:20.940972 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3547/4973] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:20 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:21.120084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:21.120961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] [instance: 0b04e75d-ed76-4d75-97a2-680d73ced573] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:21.127754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.128418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.128957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:21.129790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.130350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.130882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:21.146611 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] HTTP exception thrown: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Request method failure captured: Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 HTTP/1.1 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaSxIOOH235nsZBLMd-f4g0Hp8npdmRsaklhjdQ_MoqS2itSSG1dbGxMMRjhtoo9C8rOIAHMtjaI8bCeV-Wei6EcKDP9kFBkfT3jRgu0u1Su7vMCL0Q0HWXeJLr3wiJgFMQmMZX_4eUh3S9fv_7X5WOSH0mH9HiUGEld8V84hItxiYo Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: ad5acaec787a487d810ea5a099370530 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBackupRestore-1241355492 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_ad5acaec787a487d810ea5a099370530", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ad5acaec787a487d810ea5a099370530"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/ad5acaec787a487d810ea5a099370530"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/ad5acaec787a487d810ea5a099370530"}]}] Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBackupRestore-1241355492 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: ad5acaec787a487d810ea5a099370530 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1241355492 Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBackupRestore-1241355492-project Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 1d10720d0b764d6586dafab1215e0cdc Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBackupRestore-1241355492-project Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '0b04e75d-ed76-4d75-97a2-680d73ced573'} Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:58:21.148554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Returning 404 to user: Instance 0b04e75d-ed76-4d75-97a2-680d73ced573 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c005eda4-db1d-422d-af60-9c4ead161b79 tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573" status: 404 len: 111 microversion: 2.1 time: 0.035584 Sep 14 09:58:21.156009 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1427/4974] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:21 2022] GET /compute/v2.1/servers/0b04e75d-ed76-4d75-97a2-680d73ced573 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:58:21.355223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48b35ff7-cc24-4dcf-9d55-ef9adac1ad4b tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] Calling method '.version_select at 0x7f693fb78a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:21.387518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48b35ff7-cc24-4dcf-9d55-ef9adac1ad4b tempest-TestVolumeBackupRestore-1241355492 tempest-TestVolumeBackupRestore-1241355492-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-559816418" status: 202 len: 0 microversion: 2.1 time: 0.036627 Sep 14 09:58:21.392546 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3548/4975] 10.222.0.90 () {58 vars in 1266 bytes} [Wed Sep 14 09:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-559816418 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:58:21.968334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:21.968956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:21.985722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:21.987558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.988374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.989181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:21.990176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:21.990804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:21.991388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.219238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:22.230449 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e6f7e295-c383-47b4-a43f-966e96c9519e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1502 microversion: 2.1 time: 0.265916 Sep 14 09:58:22.245070 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1428/4976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:21 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1502 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:22.261174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:22.270152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:22.270738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:22.271335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.304060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:58:22.363107 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60ee39f5-5dab-42a9-a498-058de4590b16 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df/action" status: 202 len: 0 microversion: 2.1 time: 0.108782 Sep 14 09:58:22.364086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3549/4977] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:58:22 2022] POST /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 09:58:22.373143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:22.373785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:22.380366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:22.381191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:22.381625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.382512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:22.382982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:22.383426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:22.576382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:22.592822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a07dc8b-6f0b-4f61-8039-f28e1c7d7866 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.223202 Sep 14 09:58:22.600246 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1429/4978] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:22 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:23.620934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:23.621645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:23.650382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:23.666320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:23.668297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:23.672399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:23.674535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:23.675278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:23.932981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:23.945134 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44217dc9-e16e-4daa-acd7-276282198095 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.328554 Sep 14 09:58:23.946414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3550/4979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:23 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:24.974360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:24.975079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:25.003975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:25.005295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:25.007230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:25.009302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:25.022013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:25.022906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:25.317259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:25.327969 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f67c2073-b7ac-492b-a063-47fb351e4e48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.361035 Sep 14 09:58:25.331304 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1430/4980] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:24 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:26.356876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:26.358124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:26.367367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:26.368977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:26.369777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:26.370679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:26.371705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:26.372332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:26.548761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:26.557412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b555b4df-e481-441b-b1bf-e3d22f7b5d6e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.210467 Sep 14 09:58:26.558055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3551/4981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:26 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:27.581896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:27.582568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:27.599530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:27.600072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:27.600707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:27.601429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:27.601945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:27.602500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:27.764435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:27.773324 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e1ba02f8-efea-433a-b344-dd72335e2f3c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.195033 Sep 14 09:58:27.774484 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1431/4982] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:27 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:28.797649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:28.798275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:28.801343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:28.807497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:28.808031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:28.808661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:28.809386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:28.809844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:28.810270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:28.827916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:29.080732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:29.094531 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fcfe2c3-d445-414b-8575-d69240b82c48 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.300576 Sep 14 09:58:29.096405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3552/4983] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:28 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:30.123354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:30.125049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:30.151732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:30.154389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:30.157570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:30.168756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:30.177176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:30.177866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:30.367503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:30.379729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d958522d-86c8-4760-b7fe-3502b51e59c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.264679 Sep 14 09:58:30.380366 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1432/4984] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:30 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:31.403103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:31.403657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:31.410703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:31.411199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:31.411632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:31.412791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:31.414927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:31.415589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:31.667873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:31.676347 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8beeb88-ab57-47f3-bf75-c98e69278929 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.277181 Sep 14 09:58:31.692250 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3553/4985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:31 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:32.701665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:32.702344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:32.720807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.722228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.723196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.724441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:32.725090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:32.726394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:32.897124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:32.911246 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de0dc753-ca8f-437b-b5ed-3d774b60d176 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.213413 Sep 14 09:58:32.923931 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1433/4986] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:32 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:33.936718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:33.937349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:33.944930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:33.945461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:33.946529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:33.947358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:33.947828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:33.949338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:34.198999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:34.208280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e603f91-765e-4561-9ddf-5445a21500ba tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.275358 Sep 14 09:58:34.230307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3554/4987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:33 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:35.235869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:35.236750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:35.245079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:35.245701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:35.246204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:35.247261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:35.247775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:35.248341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:35.264004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:35.397461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:35.410280 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b6dfa6d-5fe2-45cd-b6a7-c891a62b4b00 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.177676 Sep 14 09:58:35.411935 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1434/4988] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:35 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:36.442258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:36.443282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:36.451734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:36.452463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:36.453014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:36.453759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:36.454422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:36.454865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:36.620753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:36.629027 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f25fc9ae-6f84-4869-ac94-b74f7bb2ca07 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.194022 Sep 14 09:58:36.639919 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3555/4989] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:36 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:37.658141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:37.658688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:37.666966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:37.667461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:37.667927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:37.668624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:37.669098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:37.669527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:37.810979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:37.819587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f215a084-4915-40ce-8659-5ce161a071d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.165317 Sep 14 09:58:37.820222 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1435/4990] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:37 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:38.844166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:38.844825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:38.853275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:38.853766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:38.854211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:38.855056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:38.855512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:38.856325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:39.009360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:39.017787 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-090af638-5f8f-437f-8879-c163e3b14e28 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.177386 Sep 14 09:58:39.018285 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3556/4991] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:38 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:40.043223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:40.044444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:40.057389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:40.195606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:40.204170 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a643375-34ff-48b0-8397-c8d96a5bbd9b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.166496 Sep 14 09:58:40.204821 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1436/4992] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:40 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:41.228459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:41.229018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:41.236128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:41.236627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:41.237074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:41.237782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:41.238240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:41.238669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:41.374975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:41.383447 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7f588c84-b953-4b79-bddb-a40caecda942 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.159232 Sep 14 09:58:41.384932 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3557/4993] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:41 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:42.407825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:42.408392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:42.415345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:42.415850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:42.416328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:42.417352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:42.417819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:42.418252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:42.575062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:42.582996 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-45b28f8a-8b40-47ee-92e5-bea98d0bd66d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.179226 Sep 14 09:58:42.583585 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1437/4994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:42 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:43.382393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1435407639", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ca5f2474-ff48-414c-9d52-028b5cefea15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:43.445041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:58:43.607216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:43.607810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:43.614741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:43.615225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:43.615658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:43.616385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:43.616834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:43.617286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:43.754398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:43.763180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-56c890ce-02dc-4297-b667-d9b42dd32b19 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.160501 Sep 14 09:58:43.763876 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1438/4995] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:43 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:43.830348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:58:43.830775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:58:43.831251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:58:43.831660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:58:43.832105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:58:43.842388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:43.842873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:43.843315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:43.844081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:43.844543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:43.844971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:43.862889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:58:43.868219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:58:43.928188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:58:43.930317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca5f2474-ff48-414c-9d52-028b5cefea15',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:58:44.063113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f76e597e-f6da-4a6b-9028-ae9eebe62f65 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684630 Sep 14 09:58:44.063786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3558/4996] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:58:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:58:44.075524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d3c68b7a-f863-4b8a-b181-a99c442a31eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:44.076230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d3c68b7a-f863-4b8a-b181-a99c442a31eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:44.133253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3c68b7a-f863-4b8a-b181-a99c442a31eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:44.140413 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d3c68b7a-f863-4b8a-b181-a99c442a31eb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1071 microversion: 2.1 time: 0.068983 Sep 14 09:58:44.141054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1439/4997] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:44 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1071 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:44.786543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:44.787165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:44.794296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:44.794792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:44.795271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:44.796009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:44.796475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:44.796908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:44.936072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:44.943966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f96c1d0b-f348-4d6b-990e-c510c53eb914 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.161338 Sep 14 09:58:44.944558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3559/4998] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:44 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:45.164987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:45.166317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:45.179287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.180260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.180778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:45.183239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.183714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.184180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:45.253435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:45.264439 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0b50404e-538b-4fa0-aeb3-4327c697275f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1187 microversion: 2.1 time: 0.104334 Sep 14 09:58:45.275925 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1440/4999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:45 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:45.968704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:45.969499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:45.978942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.979599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.980165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:45.980997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:45.981597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:45.982116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:46.195291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:46.204816 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da56183d-c35c-43ca-b253-64cc64c4a10f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.240480 Sep 14 09:58:46.205647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3560/5000] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:45 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:46.289082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:46.290064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:46.297942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:46.298505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:46.298984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:46.299873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:46.300353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:46.300778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:46.457190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:46.466121 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5123afa3-18c5-4850-94fd-3b7887cb3c0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1229 microversion: 2.1 time: 0.181142 Sep 14 09:58:46.466719 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1441/5001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:46 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1229 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:46.612919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7c7211d-e3cc-4cef-974a-520252c1a87d", "tag": "16952cf0-ce19-4e92-a8b3-6aece2b7810b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:46.629274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:46.629907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:46.630906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:46.647432 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] Creating event network-changed:16952cf0-ce19-4e92-a8b3-6aece2b7810b for instance b7c7211d-e3cc-4cef-974a-520252c1a87d on n-h1-851028-12 Sep 14 09:58:46.653150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3ab0532f-e59d-446b-aead-968323f5321a req-b20585fa-83b9-4720-bcf5-d28f6dc6313c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045680 Sep 14 09:58:46.653875 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3561/5002] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:47.232230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:47.232870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:47.240322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:47.240815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:47.241245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:47.241971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:47.242433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:47.242853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:47.394819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:47.405378 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9396d62c-e8d0-40f7-bb9b-58114b212f03 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.178635 Sep 14 09:58:47.405970 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1442/5003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:47 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:47.490891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:47.491620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:47.500077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:47.500575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:47.501012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:47.501729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:47.502218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:47.502646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:47.685152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:47.693291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7dfcdd9a-e9f3-4db9-8322-fef2d4b52015 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1229 microversion: 2.1 time: 0.208254 Sep 14 09:58:47.704151 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3562/5004] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:47 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1229 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:48.428828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:48.429382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:48.437773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.438264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.438707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.439415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.440208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.440642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.583020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:48.591760 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0019fcb-001f-426a-8e58-97c9dec2a493 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.166855 Sep 14 09:58:48.592373 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1443/5005] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:48 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:48.717075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:48.717611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:48.724647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.725142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.725587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.726292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:48.726752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:48.727184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:48.861271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:48.870590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd253853-8363-4757-84ec-8293190476ae tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1229 microversion: 2.1 time: 0.157661 Sep 14 09:58:48.871188 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3563/5006] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:48 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1229 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:49.614986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:49.615588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:49.623994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:49.624495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:49.624990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:49.625755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:49.626210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:49.626646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:49.766978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:49.775029 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c630c5a2-11ae-48ca-a007-93cb28eb48b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.164105 Sep 14 09:58:49.776027 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1444/5007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:49 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:49.894285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:49.894862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:49.902269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:49.902763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:49.903241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:49.903988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:49.904445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:49.904871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:50.046109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:50.055170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54a3af70-bf1d-4e17-b9f5-98b783a2d043 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1229 microversion: 2.1 time: 0.164897 Sep 14 09:58:50.055975 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3564/5008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:49 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:50.798646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:50.799261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:50.807024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:50.807604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:50.808086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:50.808786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:50.809238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:50.809663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:50.946238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:50.954720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0ed7d58e-d892-480a-b99f-c27e15cf9b04 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.160006 Sep 14 09:58:50.955296 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1445/5009] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:50 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:51.082001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:51.082553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:51.090152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:51.090636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:51.091070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:51.091763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:51.092244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:51.092679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:51.226446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:51.234397 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9dc28841-bb58-42d6-9507-a5e3171f8959 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.156389 Sep 14 09:58:51.234970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3565/5010] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:51 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:51.979239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:51.979862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:51.987179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:51.987676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:51.988154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:51.988863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:51.989318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:51.989748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:52.122815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:52.130532 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1fdcb1fb-10dd-4417-96de-eb1785def0e4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1512 microversion: 2.1 time: 0.156091 Sep 14 09:58:52.131105 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1446/5011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:51 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:52.258000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:52.258615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:52.266450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:52.266939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:52.267387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:52.268119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:52.268584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:52.269017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:52.409469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:52.417619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01221945-68cc-4e2d-bb36-0e3b7f0a52e9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.163646 Sep 14 09:58:52.418222 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3566/5012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:52 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:53.155461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.156124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.158500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=40 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:53.163951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.164436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.164868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.165625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.166116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.166561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.296466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:53.304297 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6214ab17-33d1-4cd4-a002-e2c9e0837f8f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1489 microversion: 2.1 time: 0.152858 Sep 14 09:58:53.304878 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1447/5013] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1489 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:53.327599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:53.329916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.336785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.337298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.337733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.338426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.338881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.339308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.389409 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ab3a4f7-d1e1-4199-8115-ec7dfda5a133 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 200 len: 118 microversion: 2.1 time: 0.065465 Sep 14 09:58:53.390065 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3567/5014] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:58:53 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 118 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:58:53.399576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.400344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.406489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.406902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.407341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.408070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.408525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.408958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.441654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.442386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.450044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.450536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.450967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.451662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.452263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.452692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.545473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:53.553536 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c7a84d90-4046-47bc-9a7f-84e69d7e242e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.157831 Sep 14 09:58:53.554128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1448/5015] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:53.582169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.582811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.589759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:53.590093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.590584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.591038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.591725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.592212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.592645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.597629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45496e3c-1d55-40b6-8580-296ad17027ad tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.160297 Sep 14 09:58:53.598238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3568/5016] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:53.726544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:53.734533 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4f9db9f-b220-4f7f-9bc1-740b7904f404 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.156117 Sep 14 09:58:53.735120 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1449/5017] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:53.757810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.758430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.765927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.766412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.766849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.767542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.768028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.768459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.854185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:53.877373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:53.902816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:53.910649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-466e365e-77be-44bc-adc8-96c97cc1437a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.156665 Sep 14 09:58:53.911163 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3569/5018] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:53.933797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:53.934420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:53.940685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.941169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.941606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:53.942296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:53.942752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:53.943176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:54.078106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:54.085850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7836cc71-949c-4585-be52-e939d47a555f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.157068 Sep 14 09:58:54.086434 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1450/5019] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:54.200209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-521741005", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "f52c1506-ea12-48d0-a2b1-2b338e6679a6"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:54.254068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] validate_networks() for [('f52c1506-ea12-48d0-a2b1-2b338e6679a6', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:58:54.621515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:54.622140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:54.624239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:54.632000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:54.632504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:54.632950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:54.633692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:54.634861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:54.635452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:54.640570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:58:54.641072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:58:54.641459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:58:54.641877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:58:54.642291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:58:54.652141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:54.652638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:54.653077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:54.653807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:54.654268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:54.654695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:54.672919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:58:54.678349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:58:54.691478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:58:54.693787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:58:54.743294 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c97f0920-cad4-4607-8974-6b373f5da898 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547965 Sep 14 09:58:54.752070 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3570/5020] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:58:54.761812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-178349ac-692e-4c3f-a81c-20064a04f858 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:54.762572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-178349ac-692e-4c3f-a81c-20064a04f858 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:54.782099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:54.791798 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0ba5cbb1-3a6d-4037-a2eb-bdc6e6004266 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.175111 Sep 14 09:58:54.793031 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1451/5021] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:54 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:54.823708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-178349ac-692e-4c3f-a81c-20064a04f858 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:54.831215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-178349ac-692e-4c3f-a81c-20064a04f858 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1214 microversion: 2.1 time: 0.073970 Sep 14 09:58:54.831826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3571/5022] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:54 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:55.814912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:55.816162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:55.824853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:55.825451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:55.825955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:55.826742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:55.827388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:55.827815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:55.830742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:55.855102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:55.856354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:55.864475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:55.864972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:55.865411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:55.866121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:55.866582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:55.867042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:55.883692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:55.937278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:55.945363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3109f381-6398-4c70-a4c6-193ff05fc89a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1284 microversion: 2.1 time: 0.094542 Sep 14 09:58:55.945958 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3572/5023] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:55 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:58:56.062987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:56.071363 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee523bc8-ce28-4487-a87a-76fe872f1149 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.260487 Sep 14 09:58:56.072579 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1452/5024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:55 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:56.970607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:56.971835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:56.980816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:56.981324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:56.981768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:56.982495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:56.983192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:56.983631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:57.094533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:57.095149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:57.102274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:57.102776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:57.103350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:57.104286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:57.104898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:57.105335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:57.140926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:57.149075 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6437e912-d4c8-4ff4-b546-f609cf78b711 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.184036 Sep 14 09:58:57.149946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3573/5025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:56 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:57.322964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:57.335166 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-be91b851-8bca-4d32-a296-93cc061b36fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.243233 Sep 14 09:58:57.339435 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1453/5026] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:57 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:57.388431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed", "tag": "e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:58:57.401434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:57.401916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:57.402519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:57.416845 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] Creating event network-changed:e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4 for instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed on n-h2-851028-12 Sep 14 09:58:57.422331 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-835dd9dd-4cbb-4dcb-b2f3-1a795996252e req-84ca73e4-4ad4-4677-b5f2-cf6d151278a3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038850 Sep 14 09:58:57.422991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3574/5027] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:58:58.173488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:58.174159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:58.184213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:58.184818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:58.185270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:58.190014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:58.190486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:58.191094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:58.326071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:58.334493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c453aec1-aaf4-4e7d-a207-e0b7399a162c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.165174 Sep 14 09:58:58.335067 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1454/5028] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:58 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:58.365972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:58.366601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:58.374214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:58.374707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:58.375154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:58.375854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:58.376339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:58.376769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:58.515283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:58.523378 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-805d72aa-e334-483b-863c-b816801a75be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.161809 Sep 14 09:58:58.523999 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3575/5029] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:58 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:59.358225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:59.358999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:59.365803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:59.366292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:59.366719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:59.367411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:59.367865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:59.368323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:59.511886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:59.519701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-05e3fd6b-8c22-4e6f-bf85-952b530161a9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.165370 Sep 14 09:58:59.520317 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1455/5030] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:59 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:58:59.546932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:58:59.547567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:58:59.551488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:58:59.555131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:59.555642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:59.556763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:59.557492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:58:59.557944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:58:59.558365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:58:59.694694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:58:59.702886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4af397c4-7fb5-4295-9319-cbeb9edb5044 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.159868 Sep 14 09:58:59.703589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3576/5031] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:58:59 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:00.548024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:00.548784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:00.558136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:00.558995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:00.559634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:00.560408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:00.560940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:00.561657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:00.600544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c7211d-e3cc-4cef-974a-520252c1a87d", "name": "network-vif-plugged", "status": "completed", "tag": "16952cf0-ce19-4e92-a8b3-6aece2b7810b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:00.623935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:00.623935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:00.623935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:00.638091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] Creating event network-vif-plugged:16952cf0-ce19-4e92-a8b3-6aece2b7810b for instance b7c7211d-e3cc-4cef-974a-520252c1a87d on n-h1-851028-12 Sep 14 09:59:00.643125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0f942eec-c1fa-4733-85b1-90576ce9a79a req-9f3605b4-72e8-4dc0-beb9-7957088544cd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050063 Sep 14 09:59:00.643988 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3577/5032] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:00.726795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:00.727503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:00.734522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:00.735085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:00.735530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:00.736288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:00.736753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:00.737187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:00.748720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:00.762045 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-309b352e-ce33-4ab5-9bfd-5470e6fe58c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.220751 Sep 14 09:59:00.762955 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1456/5033] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:00 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:00.899842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:00.907792 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-22a8972a-a81d-4d3b-84a5-c2f3b065a57e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1217 microversion: 2.1 time: 0.185275 Sep 14 09:59:00.908422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3578/5034] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:00 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:01.787872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:01.789018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:01.799459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:01.799986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:01.800455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:01.801172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:01.801622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:01.802053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:01.930718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:01.931401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:01.938196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:01.938699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:01.939128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:01.939867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:01.945787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:01.946224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:01.964970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:01.973644 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ffdbc24-71aa-4607-8da5-1b9230e23ed7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.191591 Sep 14 09:59:01.974607 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1457/5035] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:01 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:02.108888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:02.117109 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0917daea-ca55-46be-82b1-974751413c5c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1404 microversion: 2.1 time: 0.190252 Sep 14 09:59:02.117711 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3579/5036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:01 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:02.142412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:02.143146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:02.149343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:02.149854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:02.150335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:02.151044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:02.151493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:02.151925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:02.295357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:02.303544 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afafe1de-95ed-4c6d-a047-95e911d0f692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1404 microversion: 2.1 time: 0.165001 Sep 14 09:59:02.304182 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1458/5037] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:02 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:02.331025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1987710094"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:02.334854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:02.345001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:02.345866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:02.346649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:02.347926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:02.348766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:02.349527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:02.460646 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Attempting to quiesce instance before volume snapshot. Sep 14 09:59:02.528784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 14 09:59:02.598634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Creating snapshot from volume ca5f2474-ff48-414c-9d52-028b5cefea15. {{(pid=122444) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 14 09:59:02.845090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed", "name": "network-vif-plugged", "status": "completed", "tag": "e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:02.864034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:02.864664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:02.865109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:02.883482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] Creating event network-vif-plugged:e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4 for instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed on n-h2-851028-12 Sep 14 09:59:02.890788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f8240355-1462-4ff3-a4b9-abfad7820d15 req-9adcecc5-faeb-4d6d-afec-c0ab0fc3f657 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049484 Sep 14 09:59:02.891791 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1459/5038] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 09:59:03.006137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:03.006842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:03.014639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:03.015135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:03.015753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:03.016647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:03.017266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:03.017879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:03.174413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:03.184862 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18b1004d-9151-4410-94b4-540b05559be7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1314 microversion: 2.1 time: 0.183578 Sep 14 09:59:03.185752 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1460/5039] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:02 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:03.537000 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6abb4622-db12-4be2-a0a4-73170d6c030c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d/action" status: 202 len: 0 microversion: 2.1 time: 1.213186 Sep 14 09:59:03.537651 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3580/5040] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:02 2022] POST /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d/action => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 09:59:04.209483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:04.213741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:04.223760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.224348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.224789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.225508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.225949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.226373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.388792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:04.399730 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bc4af352-0416-4eaf-a3e1-34d1c2c316f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1502 microversion: 2.1 time: 0.193692 Sep 14 09:59:04.401141 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1461/5041] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:04 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:04.426251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:04.428502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:04.436898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.437404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.437853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.438580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:04.439046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:04.439481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:04.477096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18ab1d51-20dc-4582-909c-53514b5aa5c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.056466 Sep 14 09:59:04.477767 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3581/5042] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:04 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:04.696235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-876877092", "imageRef": "d34d3da1-e8d8-420c-849e-9850f6365cc0", "flavorRef": "452", "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:04.757275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 09:59:05.133544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 09:59:05.133965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 09:59:05.134551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 09:59:05.134964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 09:59:05.135373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 09:59:05.144494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.144978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.145412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.146138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.146598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.147022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.164585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:59:05.171422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:59:05.184528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 09:59:05.187116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b34616b3-d9d3-4eed-ba41-814face9fc04',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 09:59:05.267261 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-11f48933-2e72-4c21-a18b-2598138fedec tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574893 Sep 14 09:59:05.268626 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1462/5043] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 09:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 09:59:05.281484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8b3bd96-f224-4401-a123-995c78847c24 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:05.282417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8b3bd96-f224-4401-a123-995c78847c24 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:05.285150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:05.285944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:05.343510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f8b3bd96-f224-4401-a123-995c78847c24 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:05.350584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8b3bd96-f224-4401-a123-995c78847c24 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1229 microversion: 2.1 time: 0.073361 Sep 14 09:59:05.351170 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3582/5044] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:05 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1229 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:05.490100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:05.492412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:05.499713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.500238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.500679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.501384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:05.501839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:05.502264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:05.540948 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-842c4aea-3a1e-4808-b415-b08c00bd8724 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.054153 Sep 14 09:59:05.541944 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1463/5045] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:05 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:06.375547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:06.376518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:06.385347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.385934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.386589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.387439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.387942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.388422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.472216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:06.481059 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-309efb4d-c7ec-4320-ba08-c7504968473b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1299 microversion: 2.1 time: 0.109763 Sep 14 09:59:06.481650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3583/5046] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:06 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:06.553628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:06.555930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:06.564505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.564964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.565407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.566202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:06.566722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:06.567159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:06.612042 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a316c236-39c7-4166-99ab-9991f7cf22dd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.062397 Sep 14 09:59:06.613126 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1464/5047] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:06 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:59:07.511066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:07.513585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:07.526595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.528820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.529837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.531204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.532111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.533140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.631155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:07.634161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:07.644059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.644757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.645678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.646724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:07.647339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:07.648007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:07.704661 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b729b48b-d620-44e6-87b8-9a79c0f1fafc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.080406 Sep 14 09:59:07.705861 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1465/5048] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:07 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:07.811633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:07.822538 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e989d443-e921-496e-8726-a3b7df5716f9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.319783 Sep 14 09:59:07.836217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3584/5049] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:07 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:08.285866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acff0efa-aa3a-467c-8fbf-c98fb49d524b", "tag": "6ae8139a-b73a-4a6d-b51f-0e36c2487916"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:08.298914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.300058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.300686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.314701 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] Creating event network-changed:6ae8139a-b73a-4a6d-b51f-0e36c2487916 for instance acff0efa-aa3a-467c-8fbf-c98fb49d524b on n-h1-851028-12 Sep 14 09:59:08.323507 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4c39e125-e755-456d-a383-725a181f11ed req-5bdc9b63-f48e-49aa-9ff4-5a757721f102 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041781 Sep 14 09:59:08.324635 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1466/5050] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:08.720727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:08.723984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:08.735292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.736767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.737473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.738440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.739105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.739989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.800321 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4620f68-bbb2-43e5-aabf-381083ad0cf5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.085506 Sep 14 09:59:08.801984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3585/5051] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:08 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:08.855867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:08.857194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:08.864198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.864816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.865328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:08.866142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:08.866676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:08.867182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:09.059670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:09.068033 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4697c9bb-1a9c-4f63-98e9-7b9cca670f8b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.218494 Sep 14 09:59:09.068619 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1467/5052] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:08 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:09.813282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:09.815536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:09.823404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:09.823927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:09.824614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:09.825096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:09.825565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:09.825999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:09.877157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ec08bcb-344a-48c0-b88c-0a5a1e019dac tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.068058 Sep 14 09:59:09.880899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3586/5053] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:09 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:10.091507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:10.092293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:10.099466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.100153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.100731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.101423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.101979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.102316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.297676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:10.312159 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c05e91f2-62f8-46a4-894a-ce0a9e14d6e3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.224511 Sep 14 09:59:10.312896 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1468/5054] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:10 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:10.891229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:10.893558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:10.901737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.902242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.902699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.903456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:10.903920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:10.904376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:10.951827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d0fa6a8-eda0-4ab2-a32c-85e674095c80 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.064929 Sep 14 09:59:10.953175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3587/5055] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:10 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:11.356425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:11.357298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:11.365281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:11.366589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:11.366589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:11.367545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:11.368035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:11.368482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:11.577254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:11.586692 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ddc7570-df03-4632-8a5b-c46ba705ca53 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.235655 Sep 14 09:59:11.587265 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1469/5056] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:11 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:11.978344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:11.982764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:11.997588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:11.998539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:11.999178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.001905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:12.003017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:12.004314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.061963 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a65af4b4-03d3-4c9b-941f-84685a2c8f57 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.097164 Sep 14 09:59:12.063156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3588/5057] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:11 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 09:59:12.610754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:12.611569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:12.620649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:12.621138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:12.621582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.622601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:12.623064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:12.623497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:12.799243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:12.809298 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3a8f53f2-16fa-4fe2-8fa4-b5db35e5f64d tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.202430 Sep 14 09:59:12.809951 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1470/5058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:12 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:13.077262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:13.079807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:13.087133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.088410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.088874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.089850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.090321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.090774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.133484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ee87343-9015-45c3-822e-5edd1da9550e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.060138 Sep 14 09:59:13.134466 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3589/5059] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:13 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:13.833420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:13.834034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:13.841587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.842074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.842513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.843213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:13.843668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:13.844148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:13.985808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:13.988143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:13.996056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c217ed4f-f7b9-4211-bb90-ed699eaff690 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.166502 Sep 14 09:59:14.003038 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1471/5060] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:13 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:14.148020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:14.151361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:14.159522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:14.160345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:14.161079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:14.162018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:14.162678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:14.163371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:14.213540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92ad79c7-f15a-4f86-a725-a1521ae0c419 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.070269 Sep 14 09:59:14.214689 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3590/5061] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:14 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:15.019698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:15.020378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:15.028727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.029210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.029644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:15.030335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.030785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.031207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:15.155584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:15.167753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:15.178635 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ec33b898-b544-4a73-9cf0-abbefb3bd593 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.163003 Sep 14 09:59:15.179241 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1472/5062] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:15 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:15.225617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:15.227920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:15.235530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.236064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.236521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:15.237233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:15.237709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:15.238157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:15.261671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:15.284866 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e71a230-5efc-4d2f-a539-7ae347472551 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.063382 Sep 14 09:59:15.285436 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3591/5063] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:15 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:16.205080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:16.205687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:16.207521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:16.215017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:16.215505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:16.215977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:16.216689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:16.217144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:16.217572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:16.297615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:16.300525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:16.304234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:16.310545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:16.311275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:16.311999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:16.312785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:16.313446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:16.314086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:16.362449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6be07bdc-6d00-48be-b96f-7dd427900c9c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 14 microversion: 2.1 time: 0.069532 Sep 14 09:59:16.363133 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3592/5064] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:16 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 09:59:16.364475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:16.374030 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-070cbb58-85fd-43bb-bdba-e5e1f0167bbe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.173319 Sep 14 09:59:16.374713 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1473/5065] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:16 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:17.375627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:17.378328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:17.386218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.386721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.387181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.388022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.388503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.388952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.397012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:17.397653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:17.405177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.405672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.406317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.407031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.407492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.407968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.444465 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ad22eaa-a14f-42e9-902a-73945f782f30 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action" status: 200 len: 8207 microversion: 2.1 time: 0.072835 Sep 14 09:59:17.445502 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3593/5066] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:17 2022] POST /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed/action => generated 8207 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:17.455467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:17.456225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:17.464304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.464815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.465273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.466005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.466481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.466926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.554130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:17.564286 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3854624f-72e5-4ace-9155-05b7f54dcc31 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.170916 Sep 14 09:59:17.565105 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1474/5067] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:17 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:17.632438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:17.642166 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b48b4967-6574-4ec0-b9f4-a93102b8dffe tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.190743 Sep 14 09:59:17.642786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3594/5068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:17 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:17.669493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:17.670115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:17.676436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.676930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.677372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.678111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.678564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.678989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.818856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:17.828479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1edd16bc-8389-417f-8e16-ab2a00ce983a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.164124 Sep 14 09:59:17.829044 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1475/5069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:17 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:17.851701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:17.853618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:17.860953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.861469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.861931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:17.862661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:17.863140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:17.863590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.003552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:18.011681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-580c8439-d950-4ced-8e7d-6f11624e9453 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.163903 Sep 14 09:59:18.012298 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3595/5070] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:17 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:18.034002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:18.034660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.041834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.042406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.042917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.043687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.044320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.044837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.188618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:18.197788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d222163e-25e1-46ad-bb75-f3a642088dbd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.166914 Sep 14 09:59:18.198377 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1476/5071] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:18 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:18.221816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:18.222494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.230551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.231126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.231640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.232581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.233128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.233656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.281821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Locking {{(pid=122444) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 14 09:59:18.343796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7aa341e-b019-4469-afea-2f3878d652e8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.125627 Sep 14 09:59:18.345029 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3596/5072] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:18 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:18.356236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:18.356877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.363229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.363724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.364738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.366195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.366659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.367088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.532098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:18.544130 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-62e31c2c-8de8-4cca-8178-916c833fd81a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.194891 Sep 14 09:59:18.544826 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1477/5073] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:18 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:18.569200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:18.577250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.577756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.578209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.592957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:18.593845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.600640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.601347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.601789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.602491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.603682 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked Sep 14 09:59:18.603814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.604179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action HTTP/1.1 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 15 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: {"os-stop": {}} Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '03b08d20-f0d1-4620-97c2-dafc937c4382', 'body': {'os-stop': {}}} Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked Sep 14 09:59:18.605954 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:18.611699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 409 to user: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 is locked {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:18.611699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96b29a4d-c37d-414f-a4cb-36858748a083 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 409 len: 107 microversion: 2.1 time: 0.042997 Sep 14 09:59:18.611699 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3597/5074] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:18 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 107 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 14 09:59:18.616674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:18.617238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.625738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.626246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.626696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.627421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.627922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.628362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.673956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Unlocking {{(pid=122444) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 14 09:59:18.735389 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e537d30-d4b9-42cb-85d5-e383d29e9a2c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.122248 Sep 14 09:59:18.739245 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3598/5075] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:18 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:18.746045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:18.752587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.753078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.753532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.757562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:18.766025 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ba1a927-7aa9-4b35-95dd-8bd352d46139 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.177101 Sep 14 09:59:18.776576 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1478/5076] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:18 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:18.776767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 09:59:18.824372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b2ba9f7-914a-4168-871c-1603de22fafb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.082874 Sep 14 09:59:18.824942 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3599/5077] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:18 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:18.834149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:18.835099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:18.842045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.842854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.843401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.845151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:18.845698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:18.846112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:18.986729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:18.995476 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5188f07-0101-4ea7-81b7-caab90901709 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.164993 Sep 14 09:59:18.996079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1479/5078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:18 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:19.792324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:19.793040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:19.799531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:19.800067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:19.800515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:19.801216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:19.801680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:19.802112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:19.941405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:19.951076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ef11d2f-ddeb-42e2-9efe-11477a8aba0b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.164711 Sep 14 09:59:19.951802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3600/5079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:19 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:20.019239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:20.019948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:20.028788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:20.029359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:20.029801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:20.030505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:20.030962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:20.031390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:20.178075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:20.186049 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aa65e6fc-384e-4b2d-9dd3-c0e2d55dbb27 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.171087 Sep 14 09:59:20.186739 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1480/5080] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:20 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:20.975683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:20.976487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:20.984538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:20.985072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:20.985504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:20.986255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:20.986720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:20.987155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:21.129177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:21.137445 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c57fa0b5-93ee-4073-bb3c-7deae2080437 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1341 microversion: 2.1 time: 0.165717 Sep 14 09:59:21.138043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3601/5081] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:20 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:21.218326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:21.218924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:21.221531 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 09:59:21.221684 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 09:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 (ip 10.222.0.90) !!! Sep 14 09:59:21.229666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:21.230054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:21.230563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:21.231304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:21.231864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:21.232317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:21.374023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:21.381909 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ce2d11c9-4f1b-4242-bad9-5883829fdd1f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.167727 Sep 14 09:59:21.382489 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1481/5082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:21 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:22.161153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:22.162489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:22.169833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:22.170333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:22.170779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:22.171767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:22.172268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:22.172712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:22.379060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:22.388040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca32aa3b-0b04-49ac-9b98-b1401f227cbb tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.230667 Sep 14 09:59:22.388555 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3602/5083] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:22 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:22.407064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:22.407681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:22.414709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:22.415189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:22.416274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:22.416978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:22.417436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:22.417864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:22.560428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:22.568870 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fd5949c-c268-4bac-8e19-f9952622c80a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.165693 Sep 14 09:59:22.569461 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1482/5084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:22 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:23.411028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:23.411658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:23.420553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:23.421061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:23.421518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:23.422242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:23.422718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:23.423166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:23.442475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:23.562500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:23.570521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-921d2d16-d1f1-46ab-8ab1-41a6852a39a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.163554 Sep 14 09:59:23.571112 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3603/5085] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:23 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:23.593032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:23.593650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:23.596430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:23.601714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:23.602210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:23.602646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:23.603396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:23.603990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:23.604768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:23.753926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:23.763159 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e5d0640-ec44-4a79-bb2d-b10781f54e4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.174392 Sep 14 09:59:23.763747 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1483/5086] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:23 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:24.595704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:24.596352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:24.603460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:24.604520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:24.605084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:24.605949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:24.606448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:24.606896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:24.755803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:24.764518 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43821f0d-655c-4755-a9a4-0e9835a2f5be tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.172779 Sep 14 09:59:24.765155 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3604/5087] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:24 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:24.786563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:24.787200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:24.794604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:24.795091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:24.795530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:24.796254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:24.796714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:24.797191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:24.939205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:24.948137 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb528d39-0adc-4543-8e41-3cb0a2d36fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.164840 Sep 14 09:59:24.948804 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1484/5088] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:24 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:25.789030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:25.789711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:25.798647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:25.799154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:25.799674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:25.800550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:25.801065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:25.801598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:25.943756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:25.952073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbc3ee62-f31f-4034-b1be-e4986bec72cc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.167105 Sep 14 09:59:25.952668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3605/5089] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:25 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:25.973007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:25.973620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:25.982202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:25.982708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:25.983145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:25.983847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:25.984324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:25.984751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:26.129232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:26.138301 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b535d13b-bd77-4ce2-8193-bb5b6684ede9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.169206 Sep 14 09:59:26.138880 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1485/5090] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:25 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:26.976601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:26.977192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:26.985064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:26.985818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:26.986538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:26.987421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:26.987924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:26.988400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:27.138062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:27.146903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2550940-5919-49a1-90d4-023ca8dce3d6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.174239 Sep 14 09:59:27.147483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3606/5091] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:26 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:27.164165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:27.164810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:27.172800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:27.173404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:27.174115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:27.174698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:27.175238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:27.175804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:27.328414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:27.336771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c4bbb9e-cd19-4a91-8625-62a6d32b3d69 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.176590 Sep 14 09:59:27.337353 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1486/5092] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:27 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:28.171800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:28.172518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:28.179021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:28.179519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:28.179996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:28.180721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:28.181220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:28.181725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:28.320110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:28.328504 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bcca3ecf-bf67-4164-8d8b-9a0867f25488 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.161670 Sep 14 09:59:28.329124 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3607/5093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:28 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:28.361971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:28.362598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:28.369579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:28.370656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:28.371099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:28.371803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:28.372292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:28.372728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:28.509464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:28.517400 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47f799e6-55ae-4ed3-b40d-dcfd0d57bd66 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.159701 Sep 14 09:59:28.517984 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1487/5094] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:28 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:29.351134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:29.351763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:29.359472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.360017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.360476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.361194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.361668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.362113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.501669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:29.509759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4626fcd6-d8ea-4250-b115-033a3a4ea5d5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.162514 Sep 14 09:59:29.510379 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3608/5095] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:29 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:29.540990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:29.541589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:29.550059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.550554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.551023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.551727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.552214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.552672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.567725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=100 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:29.692856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:29.701789 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c82c499-a9cb-4530-983f-c132ecff5e65 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1658 microversion: 2.1 time: 0.164624 Sep 14 09:59:29.702587 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1488/5096] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:29 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1658 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:29.726597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:29.728673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=68 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:29.734736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.735241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.735705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.759565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Going to try to start instance {{(pid=122444) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 09:59:29.809482 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-860f7bbe-5617-4985-8c00-cd6d787b9ae5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.086598 Sep 14 09:59:29.810486 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3609/5097] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:29 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:29.819223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:29.819844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:29.828013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.828511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.829829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:29.831355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:29.831835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:29.832293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:30.000306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:30.011493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5f879eb-6d3b-4beb-9e0f-f6f2718a5833 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1667 microversion: 2.1 time: 0.195637 Sep 14 09:59:30.012760 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1489/5098] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:29 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1667 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:30.534572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:30.535289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:30.543950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:30.544456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:30.544901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:30.545612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:30.546080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:30.546532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:30.708574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:30.717723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5856eb32-1add-46ec-9394-36c611ed96a3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.187539 Sep 14 09:59:30.718316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3610/5099] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:30 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:31.045501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.045501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.047967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.048448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.048921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.049604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.050067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.050502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.215693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:31.224166 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5890dcdf-5dc3-4d2a-a6f7-891a5e8cf0a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.190952 Sep 14 09:59:31.224785 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1490/5100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:31.249416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.250045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.256704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.257200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.257647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.258386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.258851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.259289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.405046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:31.413306 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13540834-ab37-465f-85de-b208f7fc1b8e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.168918 Sep 14 09:59:31.414023 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3611/5101] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:31.438766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:31.439299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.445403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.445892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.446343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.447135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.447667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.448129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.493652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Unlocking {{(pid=122443) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 14 09:59:31.548438 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5a3aa9e2-cf00-4c44-8a99-f544129182a3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.113509 Sep 14 09:59:31.549087 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1491/5102] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:31 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:31.560454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.561146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.568544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.569044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.569488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.570193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.570661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.571099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.710995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:31.719308 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ec95a70-7f4c-4a0f-9e86-6a312f575bcf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.163883 Sep 14 09:59:31.719943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3612/5103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:31.742213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.742839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.743162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.744078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.750075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.750584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.751083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.751337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.751849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.752046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.752437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.752647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.752971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.753182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.753775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.754301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.906695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:31.915608 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cfed3b98-58dd-41e8-8ade-11634496674f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.177023 Sep 14 09:59:31.916159 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3613/5104] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:31.920642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:31.928686 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52d72277-a62a-455e-a474-8d5df433355c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.190567 Sep 14 09:59:31.929234 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1492/5105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:31.940850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:31.941456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:31.947961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.949198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.949648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:31.950377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:31.950860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:31.951423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.113757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:32.123367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-01876f1b-11b1-4441-b30c-a77d8ec37e39 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.186352 Sep 14 09:59:32.124131 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3614/5106] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:32.147386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:32.148001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:32.156501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.157084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.157605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.158460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.164853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.165412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.243828 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2723f1fa-6f72-4406-a7be-e09a861cefde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.101020 Sep 14 09:59:32.244673 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1493/5107] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:32 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:32.255074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:32.256871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:32.264732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.265406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.266175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.267068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.267776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.268332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.446281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:32.455360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-666efe21-e40d-434c-a5a6-344dfcd4a352 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1676 microversion: 2.1 time: 0.205629 Sep 14 09:59:32.456326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3615/5108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:32 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:32.752589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acff0efa-aa3a-467c-8fbf-c98fb49d524b", "name": "network-vif-plugged", "status": "completed", "tag": "6ae8139a-b73a-4a6d-b51f-0e36c2487916"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:32.762984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.763567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.764036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.776003 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] Creating event network-vif-plugged:6ae8139a-b73a-4a6d-b51f-0e36c2487916 for instance acff0efa-aa3a-467c-8fbf-c98fb49d524b on n-h1-851028-12 Sep 14 09:59:32.782215 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-38a9f416-f90d-41ea-ae2a-a784147ea349 req-2dcc2166-9d02-4bd4-93cf-5ffd40b68b45 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Sep 14 09:59:32.782823 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1494/5109] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:32.954731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:32.955392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:32.962831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.963295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.963773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:32.964581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:32.965025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:32.965472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.133535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:33.143170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61446f46-e039-4f0f-b64e-6fbd09204e72 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1375 microversion: 2.1 time: 0.192273 Sep 14 09:59:33.143850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3616/5110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:32 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1375 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:33.484631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:33.486090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:33.492838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.493320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.493788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.494462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.494939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.495717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.639524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:33.647463 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f199314-b357-4881-a8e9-3eb399577731 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1656 microversion: 2.1 time: 0.169516 Sep 14 09:59:33.648084 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1495/5111] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:33 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1656 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:33.671404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:33.671989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:33.678544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.679054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.679505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.680258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.680739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.681184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.751158 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3a5ebc7-a720-4626-a92d-4c10319cf20b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.083771 Sep 14 09:59:33.751907 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3617/5112] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 09:59:33 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 09:59:33.760230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:33.761416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:33.767645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.768168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.768705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.769337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:33.769786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:33.770220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:33.909932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:33.919193 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d095d3e1-ebda-43ed-819f-0ba9de6e4617 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1663 microversion: 2.1 time: 0.162801 Sep 14 09:59:33.932253 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1496/5113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:33 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:34.174224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:34.176380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:34.187651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.188301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.188762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.189681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.190169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.190678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.196362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:34.348455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:34.357307 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-34326f15-d09e-485e-b10f-165aa8e978e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1562 microversion: 2.1 time: 0.192482 Sep 14 09:59:34.357883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3618/5114] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:34 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1562 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:34.382708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:34.383801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:34.390800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.391281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.391710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.392438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.392892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.393313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.528232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:34.537090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10922a32-dc0f-4c74-82fe-0677379705f0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1562 microversion: 2.1 time: 0.159341 Sep 14 09:59:34.537671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1497/5115] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:34 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:34.617854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:34.618377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:34.624912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.625419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.625875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.626660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.627133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.627580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.654308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:59:34.738938 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45d3b17e-6503-4bec-a036-4dae7f0a2346 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 204 len: 0 microversion: 2.1 time: 0.124467 Sep 14 09:59:34.739271 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3619/5116] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:59:34 2022] DELETE /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:59:34.749200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:34.749824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:34.756110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.756618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.757049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.757747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.758197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.758621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.891978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:34.899978 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-05f7d248-0dac-4425-827b-46f4311a0981 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1568 microversion: 2.1 time: 0.156480 Sep 14 09:59:34.900569 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1498/5117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:34 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:34.945940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:34.946661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:34.953565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.954067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.954518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:34.955229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:34.955704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:34.956188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.099391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:35.108471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-32c770cf-a1b7-4ae9-adb3-ebe6f097f45b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.166774 Sep 14 09:59:35.109071 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3620/5118] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:34 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:35.132253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.132866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.139344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.139887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.140353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.141050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.141508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.142001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.286183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:35.294869 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7684747e-80f1-4875-ab07-8d0eb56831ab tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.166382 Sep 14 09:59:35.295412 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1499/5119] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:35.319754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.320503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.327649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.328190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.328646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.329362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.329833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.330276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.474944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:35.483884 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51365add-9438-4d37-b197-2116e58ae9c5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.168036 Sep 14 09:59:35.484498 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3621/5120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:35.506570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.507371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.514523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.515169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.515654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.516403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.516917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.517734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.657326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:35.665214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-692a99da-81a9-4be2-ab7a-8aecf9655f42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.162594 Sep 14 09:59:35.665825 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1500/5121] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:35.687955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.688616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.694674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.695170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.695618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.696353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.696821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.697263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.829954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:35.837889 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8844b963-66e5-4132-958e-de5dcbc63fb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.153810 Sep 14 09:59:35.838509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3622/5122] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:35.860997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.861806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.867776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.868296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.868736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.869424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.869880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.870754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.923031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:35.923659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:35.929724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.930224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.930674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:35.931377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:35.931850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:35.932320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:36.011333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:36.019233 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0c03e5a-cecc-4587-b753-9188803df84d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.162247 Sep 14 09:59:36.019807 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1501/5123] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:36.071688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:36.080003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f5c9f0af-8736-4453-a05f-ef3f670c9b27 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1568 microversion: 2.1 time: 0.160911 Sep 14 09:59:36.080590 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3623/5124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:35 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 09:59:36.772460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acff0efa-aa3a-467c-8fbf-c98fb49d524b", "name": "network-vif-deleted", "tag": "6ae8139a-b73a-4a6d-b51f-0e36c2487916"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:36.788183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:36.788847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:36.789462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:36.797545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:36.825943 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] Creating event network-vif-deleted:6ae8139a-b73a-4a6d-b51f-0e36c2487916 for instance acff0efa-aa3a-467c-8fbf-c98fb49d524b on n-h1-851028-12 Sep 14 09:59:36.834283 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-31b86e13-80b5-415d-a017-e0f5c89a788d req-85aa1f75-b370-4fd0-bddf-f35fea533a58 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065496 Sep 14 09:59:36.839861 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1502/5125] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:37.102661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:37.103477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:37.111527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:37.112074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:37.112524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:37.113243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:37.113861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:37.114302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:37.181201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:37.190048 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0035c996-e005-4f03-a1ae-b1d705c38a4c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1360 microversion: 2.1 time: 0.091291 Sep 14 09:59:37.191089 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3624/5126] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:37 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:38.216979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:38.217685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:38.224276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:38.224761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:38.225203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:38.226253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:38.227055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:38.227825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:38.298537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:38.306991 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac77dfac-c7b5-4c7f-b4bf-01252aa52b79 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1360 microversion: 2.1 time: 0.096114 Sep 14 09:59:38.308354 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1503/5127] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:38 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:39.330753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:39.331385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:39.339193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:39.339967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:39.340579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:39.341305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:39.341783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:39.342238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:39.414896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:39.424076 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c948a2c-4892-4c1f-9d43-6ea8d9652910 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1360 microversion: 2.1 time: 0.097132 Sep 14 09:59:39.424604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3625/5128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:39 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:40.447657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:40.448296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:40.455479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:40.456008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:40.456452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:40.457150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:40.457608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:40.458040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:40.521984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:40.530069 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35ee9962-cd60-486d-9fb3-8d11895190e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1360 microversion: 2.1 time: 0.086472 Sep 14 09:59:40.530656 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1504/5129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:40 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1360 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:41.553699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:41.554330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:41.561650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:41.562157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:41.562613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:41.563336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:41.563813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:41.564281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:41.599290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:41.599815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:41.600279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:41.600748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lazy-loading 'fault' on Instance uuid acff0efa-aa3a-467c-8fbf-c98fb49d524b {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 09:59:41.644064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:41.653267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92c009c8-fc38-404b-a2bf-bb592e3e0a12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 200 len: 1365 microversion: 2.1 time: 0.103446 Sep 14 09:59:41.653864 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3626/5130] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:41 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:42.678779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:42.679390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:42.686582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:42.687068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:42.687563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:42.688240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:42.688686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:42.689105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:42.703532 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b HTTP/1.1 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'acff0efa-aa3a-467c-8fbf-c98fb49d524b'} Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:42.705265 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:42.710918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b50f5b9d-c4d2-4fab-968d-f83aa678f1c8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 404 len: 111 microversion: 2.1 time: 0.031821 Sep 14 09:59:42.712941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1505/5131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:42 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:47.018530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:47.019093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:47.026180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:47.027217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:47.027682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:47.028433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:47.028911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:47.029361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:47.056955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 09:59:47.144138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca4baa7a-c40a-4662-84ba-4544ce385d66 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 204 len: 0 microversion: 2.1 time: 0.128827 Sep 14 09:59:47.144754 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3627/5132] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:59:47 2022] DELETE /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 09:59:47.153983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:47.154643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:47.162241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:47.162739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:47.163182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:47.164141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:47.164732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:47.165790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:47.306899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:47.315406 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a357455-d5ed-40db-9526-497b2128c8a2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1410 microversion: 2.1 time: 0.166517 Sep 14 09:59:47.316003 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1506/5133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:47 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:48.338359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:48.339924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:48.346820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:48.347322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:48.347777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:48.348511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:48.348982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:48.349423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:48.487637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:48.496244 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a8abac84-d8a4-4c0a-a8fe-1725fcb0b9ff tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1410 microversion: 2.1 time: 0.161929 Sep 14 09:59:48.496840 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3628/5134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:48 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:49.117217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7c7211d-e3cc-4cef-974a-520252c1a87d", "name": "network-vif-deleted", "tag": "16952cf0-ce19-4e92-a8b3-6aece2b7810b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:49.129855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:49.130436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:49.130871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:49.143632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] Creating event network-vif-deleted:16952cf0-ce19-4e92-a8b3-6aece2b7810b for instance b7c7211d-e3cc-4cef-974a-520252c1a87d on n-h1-851028-12 Sep 14 09:59:49.148792 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-abecf2f6-cdc3-49ab-9742-0c3fbd816667 req-522166bd-716f-4c64-9fe3-0d7cfb895bb0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035223 Sep 14 09:59:49.149407 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1507/5135] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 09:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 09:59:49.518783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:49.519412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:49.527023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:49.527523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:49.527994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:49.528743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:49.529210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:49.529647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:49.609011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:49.617164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27e4d01f-e7c9-4274-8ed5-343a2703127b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1202 microversion: 2.1 time: 0.102348 Sep 14 09:59:49.617752 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3629/5136] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:49 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:50.643525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:50.644265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:50.650857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.652000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.652644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.653367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:50.653821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:50.654254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:50.723408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:50.732398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8532ea45-f5d4-47c3-86d1-852d508fb66a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1202 microversion: 2.1 time: 0.093987 Sep 14 09:59:50.732995 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1508/5137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:50 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:51.755947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:51.756596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:51.764997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:51.765494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:51.765949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:51.766664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:51.767134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:51.767574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:51.831351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:51.840410 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c80a3d76-72ee-496c-9091-3bb4ca93a147 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1202 microversion: 2.1 time: 0.088382 Sep 14 09:59:51.842203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3630/5138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:51 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:52.864364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:52.865099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:52.872176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:52.872672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:52.873112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:52.874081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:52.874539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:52.874970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:52.939908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 09:59:52.948012 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fbc86d9-002b-45a4-b288-4054f0c71b18 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 200 len: 1202 microversion: 2.1 time: 0.087695 Sep 14 09:59:52.948733 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1509/5139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:52 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 09:59:53.970865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:53.971402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:53.978798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:53.979315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:53.980523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:53.981264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:53.981744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:53.982221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:53.998228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:53.999516 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d HTTP/1.1 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b7c7211d-e3cc-4cef-974a-520252c1a87d'} Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:54.001238 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b15a70e-222c-493b-aaf9-c7f6266643e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 404 len: 111 microversion: 2.1 time: 0.035992 Sep 14 09:59:54.006185 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3631/5140] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:53 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:56.152208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:56.152851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:56.155611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=54 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 09:59:56.160950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.161434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.161860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.162552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.162996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.163412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.178267 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b HTTP/1.1 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'acff0efa-aa3a-467c-8fbf-c98fb49d524b'} Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:56.179991 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7dab9fd0-7502-491f-8b9e-51c78de80d07 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 404 len: 111 microversion: 2.1 time: 0.033932 Sep 14 09:59:56.184616 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1510/5141] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:59:56 2022] DELETE /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:56.190695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:56.191321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: acff0efa-aa3a-467c-8fbf-c98fb49d524b] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:56.199393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.200075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.200524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.201236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.201699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.202135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.218183 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b HTTP/1.1 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'acff0efa-aa3a-467c-8fbf-c98fb49d524b'} Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.219740 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance acff0efa-aa3a-467c-8fbf-c98fb49d524b could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8760992c-c39a-42d1-a92f-99bc68b8cce2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b" status: 404 len: 111 microversion: 2.1 time: 0.034737 Sep 14 09:59:56.224607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3632/5142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:56 2022] GET /compute/v2.1/servers/acff0efa-aa3a-467c-8fbf-c98fb49d524b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 09:59:56.603526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:56.604072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:56.610543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.611407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.611537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.612267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.612725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.613150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.628157 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d HTTP/1.1 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b7c7211d-e3cc-4cef-974a-520252c1a87d'} Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:56.629734 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-13efacb3-ca58-467f-bd0c-5106677492a8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 404 len: 111 microversion: 2.1 time: 0.031806 Sep 14 09:59:56.634437 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1511/5143] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 09:59:56 2022] DELETE /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:56.640585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 09:59:56.641242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: b7c7211d-e3cc-4cef-974a-520252c1a87d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 09:59:56.647450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.647987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.648438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.649143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 09:59:56.649610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 09:59:56.650051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 09:59:56.664464 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d HTTP/1.1 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b7c7211d-e3cc-4cef-974a-520252c1a87d'} Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 09:59:56.666010 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance b7c7211d-e3cc-4cef-974a-520252c1a87d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dbd6d0f5-f3e5-4dd5-8fe6-eda2ea6e06e8 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d" status: 404 len: 111 microversion: 2.1 time: 0.031688 Sep 14 09:59:56.672073 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3633/5144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 09:59:56 2022] GET /compute/v2.1/servers/b7c7211d-e3cc-4cef-974a-520252c1a87d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 09:59:56.747928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2dbe3ff7-5522-4075-ad81-d76a854d70c6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: .version_select at 0x7f6947a23d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-229185920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiuLnHgXLngX+LoZMN5BwzXcqfTbqoywZrduYcghoDcS7MmEwqGhFaP9kS2n9xC9hRt2Zsvq+6+G4DlsGCdISKXO7d/DLJ5B17urv8X9tRhtHcZwmroCL2Vld77XrbQ7Q=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 09:59:56.764458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2dbe3ff7-5522-4075-ad81-d76a854d70c6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 09:59:56.769827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-2dbe3ff7-5522-4075-ad81-d76a854d70c6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 09:59:56.797863 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2dbe3ff7-5522-4075-ad81-d76a854d70c6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.055063 Sep 14 09:59:56.798700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1512/5145] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 09:59:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:07.017296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:07.019842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:07.022961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:07.023707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:07.030532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:07.031071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:07.031517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:07.032287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:07.032787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:07.033645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:07.118150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99876feb-1d0d-4251-9f4a-2f9d363c646e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.104977 Sep 14 10:00:07.118963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3634/5146] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:00:07 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:00:07.125390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=38 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:07.127147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:07.127804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:07.132693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:07.133466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:07.143174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:07.143673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:07.144267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:07.145052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:07.145575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:07.146084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:07.305797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:07.314981 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-201eeda8-6c33-42c5-aa73-01e7df4f45e7 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1673 microversion: 2.1 time: 0.191615 Sep 14 10:00:07.315941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1513/5147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:07 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:08.340690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:08.341509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:08.349245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:08.349777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:08.350239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:08.350952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:08.351422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:08.351861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:08.494696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:08.502966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a79432c0-702d-4947-8881-c831eeb82464 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.167734 Sep 14 10:00:08.503540 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3635/5148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:08 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:13.105749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-528325027", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229185920", "security_groups": [{"name": "tempest-secgroup-smoke-1069660230"}], "block_device_mapping_v2": [{"uuid": "74be5381-2681-4389-b07e-6c64ae244837", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:13.220772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:00:13.610554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:00:13.611012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:00:13.611516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:00:13.611960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:00:13.612380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:00:13.621334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:13.622071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:13.622510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:13.623239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:13.623700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:13.624157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:13.640627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:00:13.646063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:00:13.712538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:00:13.714682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74be5381-2681-4389-b07e-6c64ae244837',volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:00:13.841759 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18a0230f-bf4b-48e9-b45b-36aac354fa0c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739820 Sep 14 10:00:13.842912 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1514/5149] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:00:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:00:13.854622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bd10bac-a882-438a-b566-060aa8fe74fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:13.855326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1bd10bac-a882-438a-b566-060aa8fe74fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:13.922861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1bd10bac-a882-438a-b566-060aa8fe74fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:13.929865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bd10bac-a882-438a-b566-060aa8fe74fd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1093 microversion: 2.1 time: 0.079714 Sep 14 10:00:13.930440 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3636/5150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:13 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:14.954261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:14.955526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:14.961822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:14.962312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:14.962751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:14.963450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:14.963927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:14.965178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:15.033422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:15.041110 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e277d93e-b835-49e4-a6cc-8b69f8d336f3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1199 microversion: 2.1 time: 0.092249 Sep 14 10:00:15.041884 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1515/5151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:14 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1199 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:16.066049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:16.067583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:16.083579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:16.084441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:16.085079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:16.086003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:16.086476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:16.086928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:16.393612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:16.402392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c66d9c0-4562-47c4-b17c-c8deaa4241dc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1277 microversion: 2.1 time: 0.341613 Sep 14 10:00:16.403576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3637/5152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:16 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:16.841300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15590244-d05a-4d79-a4e6-2179503747b1", "tag": "29f07237-a68c-43ee-bfe7-ecdb20f2ece9"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:16.862045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:16.862684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:16.863325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:16.879334 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] Creating event network-changed:29f07237-a68c-43ee-bfe7-ecdb20f2ece9 for instance 15590244-d05a-4d79-a4e6-2179503747b1 on n-h1-851028-12 Sep 14 10:00:16.884871 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3452b838-fd30-4931-a99e-b18075b1afdb req-c1bbbe26-f938-4527-926d-02a6b63c98ed service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047418 Sep 14 10:00:16.886202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1516/5153] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:17.427476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:17.428395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:17.436930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:17.437615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:17.438172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:17.439083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:17.439778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:17.440462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:17.663308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:17.671959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8eadb685-8379-4684-bde7-cc23615cda12 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1277 microversion: 2.1 time: 0.249522 Sep 14 10:00:17.672660 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3638/5154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:17 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:18.696350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:18.696968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:18.703242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:18.703779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:18.704243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:18.704935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:18.705394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:18.705807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:18.845910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:18.853783 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d2ea489-9938-44b0-a778-b72919849228 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1277 microversion: 2.1 time: 0.162714 Sep 14 10:00:18.854366 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1517/5155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:18 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:19.879085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:19.880516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:19.886963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:19.887466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:19.887939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:19.888657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:19.889191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:19.890207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:20.039633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:20.049273 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7645aca5-3d8d-4994-86c9-6ce2c871b14f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1277 microversion: 2.1 time: 0.175637 Sep 14 10:00:20.049868 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3639/5156] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:19 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:21.072966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:21.073572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:21.080791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:21.081279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:21.081716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:21.082410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:21.082864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:21.083292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:21.433044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:21.441587 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-62e01d3d-4d47-431b-b303-add25feb1629 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.372472 Sep 14 10:00:21.442153 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1518/5157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:21 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:22.465233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:22.465822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:22.473664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:22.474174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:22.474632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:22.475355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:22.475837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:22.476313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:22.610515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:22.618597 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f4a9d334-3dbf-454f-afcb-88c714005177 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.157370 Sep 14 10:00:22.619186 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3640/5158] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:22 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:23.642365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:23.642980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:23.645632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:23.651084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:23.651574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:23.652041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:23.652739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:23.653196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:23.653627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:23.654227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:23.788934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:23.797273 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06fbc6a8-cd0e-4de5-ba16-a6c3f3d23b43 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.159371 Sep 14 10:00:23.797855 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1519/5159] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:23 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:24.820557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:24.821175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:24.824051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:24.829670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:24.830186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:24.830645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:24.831407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:24.831851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:24.832422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:24.969481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:24.977373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2da2bb54-b094-4924-8ad3-78ffd5f0294c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.160831 Sep 14 10:00:24.977960 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3641/5160] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:24 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:26.001338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:26.002008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:26.009090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:26.009580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:26.010021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:26.010726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:26.011216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:26.011645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:26.143537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:26.151433 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c0d24101-4650-44c8-beee-9d1589c709e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.154433 Sep 14 10:00:26.152028 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1520/5161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:25 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:27.176316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:27.176955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:27.183123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:27.183631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:27.184116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:27.184834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:27.185321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:27.185764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:27.325109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:27.334132 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4e60425-d350-467f-8c11-f53135bbc7d9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.163352 Sep 14 10:00:27.334754 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3642/5162] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:27 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:28.357346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:28.357956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:28.365826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:28.366311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:28.366746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:28.367435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:28.367887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:28.368341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:28.506850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:28.514850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd91fb59-5eec-4ae8-aab2-55501c465b2c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.161414 Sep 14 10:00:28.516317 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1521/5163] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:28 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:29.539724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:29.540526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:29.549446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:29.549956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:29.550405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:29.551179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:29.551644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:29.552143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:29.701145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:29.711253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1243eb6-81c4-43c3-9f9e-32b92e254603 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.175563 Sep 14 10:00:29.711850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3643/5164] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:29 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:30.736259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:30.736867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:30.743763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.744293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.744735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.745441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:30.745898 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:30.746323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:30.997917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:31.006946 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f98f0f1-4f53-4462-8082-f369ba5c2bb1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.274733 Sep 14 10:00:31.007526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1522/5165] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:30 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:31.092403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15590244-d05a-4d79-a4e6-2179503747b1", "name": "network-vif-plugged", "status": "completed", "tag": "29f07237-a68c-43ee-bfe7-ecdb20f2ece9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:31.105309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:31.105887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:31.107084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:31.131105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] Creating event network-vif-plugged:29f07237-a68c-43ee-bfe7-ecdb20f2ece9 for instance 15590244-d05a-4d79-a4e6-2179503747b1 on n-h1-851028-12 Sep 14 10:00:31.139540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c47bf32e-8b2b-49e2-b32e-287658f1c9e5 req-d90ebff0-08da-4364-81af-540fc89052c5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050658 Sep 14 10:00:31.140717 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3644/5166] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:32.029927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:32.030540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:32.037985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:32.038480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:32.038949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:32.039654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:32.040136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:32.040557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:32.178746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:32.186614 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dfba272e-10ca-49c4-af77-8333c433b9c4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1265 microversion: 2.1 time: 0.160549 Sep 14 10:00:32.199918 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1523/5167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:32 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:33.212680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:33.213415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:33.220134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:33.220647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:33.221110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:33.221842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:33.222313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:33.222758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:33.363795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:33.371662 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88b2ca24-34c1-4285-9ad2-8ab0b5bf2835 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1453 microversion: 2.1 time: 0.164766 Sep 14 10:00:33.372261 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3645/5168] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:33 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:33.393867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:33.394519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:33.401349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:33.401841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:33.402281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:33.402988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:33.403449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:33.403885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:33.541244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:33.550013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-98c5b398-10ba-4a0a-be89-966057279fcf tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1453 microversion: 2.1 time: 0.160003 Sep 14 10:00:33.550608 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1524/5169] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:33 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:35.474546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15590244-d05a-4d79-a4e6-2179503747b1", "tag": "29f07237-a68c-43ee-bfe7-ecdb20f2ece9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:35.485994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:35.486792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:35.487352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:35.499199 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] Creating event network-changed:29f07237-a68c-43ee-bfe7-ecdb20f2ece9 for instance 15590244-d05a-4d79-a4e6-2179503747b1 on n-h1-851028-12 Sep 14 10:00:35.504321 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a7068507-bb12-427c-bd7d-3e37a53161fa req-b02bb0bf-7a2c-446b-9745-2a109c06e0e8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033410 Sep 14 10:00:35.504924 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3646/5170] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:40.841271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:40.841885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:40.845551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:40.851092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:40.851585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:40.852049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:40.852778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:40.853233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:40.853663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:40.857272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=65 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:40.991401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:40.999514 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ce7dbf1-7049-4362-be10-a3679738ebfa tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.162212 Sep 14 10:00:41.000120 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1525/5171] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:40 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:41.025543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:41.026266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:41.028272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=29 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:41.034001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.034513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.034971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.035689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.036199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.036650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.039458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:41.183387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:41.192681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08aafb37-29c0-4404-a70a-469a1a555cdd tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.172297 Sep 14 10:00:41.193283 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3647/5172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:41 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:41.215384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:41.216037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:41.222369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.222860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.223341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.224081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.224540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.224972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.357483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:41.366073 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-71944c97-f94c-4312-897d-85d4fa6385c0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.154627 Sep 14 10:00:41.366641 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1526/5173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:41 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:41.388898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:41.389468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:41.395857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.396392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.396850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.397560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:41.398038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:41.398484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:41.529039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:41.537722 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79bf0983-0a2e-4991-89e0-5abc4533ddb0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.152782 Sep 14 10:00:41.538305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3648/5174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:41 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:41.629883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-593156773", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "f52c1506-ea12-48d0-a2b1-2b338e6679a6"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:41.684294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] validate_networks() for [('f52c1506-ea12-48d0-a2b1-2b338e6679a6', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:00:42.073902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:00:42.074490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:00:42.074820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:00:42.075228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:00:42.075637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:00:42.085867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:42.086344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:42.086803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:42.087525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:42.088017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:42.088439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:42.105172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:00:42.110602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:00:42.123364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:00:42.126245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:00:42.177119 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-19991b3c-31fa-4e91-983e-ed0695088041 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551759 Sep 14 10:00:42.177778 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1527/5175] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:00:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:00:42.189857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e1d687c-4586-424d-8df2-1e9479696dd0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:42.190656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1e1d687c-4586-424d-8df2-1e9479696dd0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:42.248324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1e1d687c-4586-424d-8df2-1e9479696dd0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:42.256065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e1d687c-4586-424d-8df2-1e9479696dd0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1214 microversion: 2.1 time: 0.070878 Sep 14 10:00:42.256658 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3649/5176] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:42 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:43.282230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:43.284582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:43.294239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:43.295401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:43.296112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:43.297881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:43.298744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:43.299336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:43.399674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:43.408423 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f6c33cff-2e83-43a1-be57-685384c41199 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1274 microversion: 2.1 time: 0.131795 Sep 14 10:00:43.409933 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1528/5177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:43 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:44.434825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:44.435461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:44.443877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:44.444425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:44.444881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:44.445603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:44.446079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:44.446524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:44.584601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:44.592573 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bc624d6-dfa7-4ab0-9542-54d8d3cfa6b8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.161699 Sep 14 10:00:44.593088 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3650/5178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:44 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:44.659194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0", "tag": "1adb953a-c4cc-4072-bd03-aa5cbafb6ffb"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:44.678693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:44.679201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:44.680030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:44.693592 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] Creating event network-changed:1adb953a-c4cc-4072-bd03-aa5cbafb6ffb for instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 on n-h2-851028-12 Sep 14 10:00:44.698921 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-38fd3d51-eaac-4255-88fe-65c641bd90e5 req-4e730ddb-e130-4cbd-b495-2b6c5779c254 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044422 Sep 14 10:00:44.700107 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1529/5179] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:45.622667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:45.623544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:45.631414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:45.631935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:45.632392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:45.633100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:45.633565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:45.634004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:45.768132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:45.776066 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c3098b2-60e2-46ec-abfd-17c9447601e3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.157351 Sep 14 10:00:45.776656 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3651/5180] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:45 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:46.799819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:46.800553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:46.807574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:46.808096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:46.808532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:46.809216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:46.809667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:46.810091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:46.943021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:46.950645 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6b880608-28dd-431e-982a-a112b210ff87 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.155323 Sep 14 10:00:46.951218 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1530/5181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:46 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:47.974715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:47.975353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:47.982346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:47.982827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:47.983290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:47.984035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:47.984510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:47.984954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:48.120499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:48.129169 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c059a11-f151-484d-8f22-3b65b0f69ffb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.159442 Sep 14 10:00:48.129756 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3652/5182] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:47 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:49.152968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:49.153576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:49.164192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:49.164692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:49.165138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:49.165855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:49.166320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:49.166753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:49.298926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:49.307842 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e23a3148-64d2-46ea-a091-cbd5987e8b1b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.158601 Sep 14 10:00:49.308790 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1531/5183] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:49 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:49.433983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0", "name": "network-vif-plugged", "status": "completed", "tag": "1adb953a-c4cc-4072-bd03-aa5cbafb6ffb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:49.447102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:49.448049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:49.448715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:49.462238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] Creating event network-vif-plugged:1adb953a-c4cc-4072-bd03-aa5cbafb6ffb for instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 on n-h2-851028-12 Sep 14 10:00:49.467607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6bab10a4-7e9f-410a-9002-f93d63d704e4 req-9139e5e9-40b0-42ea-bdeb-0d8de4d29af6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037531 Sep 14 10:00:49.468606 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3653/5184] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:50.333035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:50.333654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:50.340552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:50.341049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:50.341487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:50.342180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:50.342642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:50.343073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:50.475046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:50.482802 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ed78bb84-01c0-47f4-9777-ebea7e4e19a8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1314 microversion: 2.1 time: 0.154381 Sep 14 10:00:50.483384 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1532/5185] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:50 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:51.507625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:51.508389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:51.516317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:51.516828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:51.517842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:51.518650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:51.519116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:51.519554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:51.651925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:51.661011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16e3b0ac-be9c-491a-81d6-7c2d3ccb257d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1501 microversion: 2.1 time: 0.157922 Sep 14 10:00:51.661615 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3654/5186] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:51 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:51.684989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:51.685536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:51.692848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:51.693340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:51.693779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:51.694476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:51.694933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:51.695363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:51.825194 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Removing security group d9b1264d-8413-4e30-bb2f-9540edf41e03 from port 1adb953a-c4cc-4072-bd03-aa5cbafb6ffb Sep 14 10:00:52.096357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:52.117163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:52.129093 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-01851fcd-91d3-4e90-a860-aef1e51659ed tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0/action" status: 202 len: 0 microversion: 2.1 time: 0.445800 Sep 14 10:00:52.129886 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1533/5187] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:00:51 2022] POST /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:00:52.138349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0", "tag": "1adb953a-c4cc-4072-bd03-aa5cbafb6ffb"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:52.138895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:52.139807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:52.147017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.147920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.148433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.149218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.149961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.150610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.154296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.154878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.155531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.185889 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] Creating event network-changed:1adb953a-c4cc-4072-bd03-aa5cbafb6ffb for instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 on n-h2-851028-12 Sep 14 10:00:52.193793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c5be0f37-563e-499e-bb46-e3f0457fddfc req-1b092bdd-9306-4d12-b8c2-92cc22d30d43 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059648 Sep 14 10:00:52.195479 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3655/5188] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:52.297532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:52.308617 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0460ee61-b931-4a8e-9df3-b2dca388db3b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1459 microversion: 2.1 time: 0.173904 Sep 14 10:00:52.310372 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1534/5189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:52 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:52.337762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:52.338837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:52.345014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:00:52.350949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.351497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.352126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.353180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.353705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.354160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.521765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:52.529865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4f383826-5932-41d0-abd2-95353f125b34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.199266 Sep 14 10:00:52.530456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3656/5190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:52.555997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:52.556628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:52.562876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.563367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.563808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.565346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.565920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.566644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.779970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:52.788553 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e0240545-455f-44ae-8643-2ba0ef8ab835 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.236761 Sep 14 10:00:52.789145 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1535/5191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:52.812260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:52.812893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:52.820328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.820843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.821299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.822054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:52.822528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:52.822972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:52.966063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:52.974754 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ad25755d-c584-4abd-a570-a84b6097f073 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.166380 Sep 14 10:00:52.975349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3657/5192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:52.997739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:52.998613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:53.006115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:53.006605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:53.007044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:53.007742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:53.008307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:53.008742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:53.144720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:53.152521 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da96e1aa-ea9a-484b-a1b9-fb5d7d7bf50b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.158606 Sep 14 10:00:53.153104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1536/5193] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:53.217423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1713927170", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "f52c1506-ea12-48d0-a2b1-2b338e6679a6"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:53.272302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] validate_networks() for [('f52c1506-ea12-48d0-a2b1-2b338e6679a6', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:00:53.694403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:00:53.694965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:00:53.695339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:00:53.695765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:00:53.696278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:00:53.706132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:53.706634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:53.707093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:53.707841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:53.708341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:53.708789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:53.730693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:00:53.736233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Getting quotas for user 52707aba3d784d0ebe45fdee819c3521 and project e29d098ebd614b829cd35ebc8c272518. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:00:53.749584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:00:53.751973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:00:53.797071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79daed1c-6be8-4a12-9204-aaa424211289 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583548 Sep 14 10:00:53.797741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3658/5194] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:00:53.809028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ddfd60f-f55a-4eef-b733-fa4471d4bd83 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:53.810223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ddfd60f-f55a-4eef-b733-fa4471d4bd83 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:53.867831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3ddfd60f-f55a-4eef-b733-fa4471d4bd83 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:53.875637 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ddfd60f-f55a-4eef-b733-fa4471d4bd83 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1215 microversion: 2.1 time: 0.070408 Sep 14 10:00:53.876252 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1537/5195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:53 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:54.900559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:54.901848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:54.910030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:54.910887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:54.911549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:54.912562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:54.913044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:54.913486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:55.001526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:55.012203 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5158b318-cd53-4821-8f44-45f14a8d47cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1275 microversion: 2.1 time: 0.116946 Sep 14 10:00:55.013472 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3659/5196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:54 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1275 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:56.039137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:56.039876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:56.047876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:56.048388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:56.048829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:56.050300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:56.051014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:56.051353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:56.446599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:56.448482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44609601-1def-4252-ba08-ccff8a97ce12", "tag": "2e2e5d3d-c8fd-4292-9c55-1889908821b8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:00:56.456737 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-def6d6df-7942-4f84-8705-dd72960432cf tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.420927 Sep 14 10:00:56.457903 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1538/5197] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:56 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:56.468052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:56.468565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:56.469019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:56.484641 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] Creating event network-changed:2e2e5d3d-c8fd-4292-9c55-1889908821b8 for instance 44609601-1def-4252-ba08-ccff8a97ce12 on n-h1-851028-12 Sep 14 10:00:56.490523 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-da27882b-a829-405e-995c-904a62517272 req-17073054-a69a-44f2-91ea-bf24b5c8b809 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053560 Sep 14 10:00:56.491727 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3660/5198] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:00:57.481468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:57.481997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:57.489423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:57.489910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:57.490348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:57.491040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:57.491499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:57.491942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:57.628591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:57.636480 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ed2f7a7-9ed4-47fe-97dc-6d0a9a5f6eee tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.158965 Sep 14 10:00:57.637063 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1539/5199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:57 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:00:58.662073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:58.662815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:58.669148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:58.669668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:58.670116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:58.670911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:58.671396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:58.671841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:58.814465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:00:58.822941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-942629a7-e829-44b6-8772-bdd3793b4516 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.166383 Sep 14 10:00:58.823527 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3661/5200] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:58 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:00:59.850337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:00:59.850902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:00:59.858827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:59.859395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:59.859889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:00:59.860785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:00:59.861364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:00:59.861832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:00.004472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:00.012654 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf6d8196-842d-45cb-bef6-bd4986f23528 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.167697 Sep 14 10:01:00.013236 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1540/5201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:00:59 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:01.037167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:01.037820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:01.040943 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:01:01.041132 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:01:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 (ip 10.222.0.90) !!! Sep 14 10:01:01.048935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:01.049531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:01.050120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:01.051051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:01.051548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:01.052025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:01.198016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:01.206779 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a07833b6-db8a-48cc-810d-1af56354778b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.174222 Sep 14 10:01:01.207507 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3662/5202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:01 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:02.231470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:02.232114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:02.241453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:02.241941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:02.242379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:02.243083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:02.243539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:02.244000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:02.392246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:02.400336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46b20616-2ba8-4beb-acb8-fd5de3daaf34 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.173602 Sep 14 10:01:02.400927 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1541/5203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:02 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:03.219731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44609601-1def-4252-ba08-ccff8a97ce12", "name": "network-vif-plugged", "status": "completed", "tag": "2e2e5d3d-c8fd-4292-9c55-1889908821b8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:03.231380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:03.231878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:03.232418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:03.245456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] Creating event network-vif-plugged:2e2e5d3d-c8fd-4292-9c55-1889908821b8 for instance 44609601-1def-4252-ba08-ccff8a97ce12 on n-h1-851028-12 Sep 14 10:01:03.250728 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-95e8b710-df28-493a-814f-5d0b00d06db8 req-aa7848d4-c729-4852-8208-1ba906e9307d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Sep 14 10:01:03.251725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3663/5204] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:03.424258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:03.424913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:03.432332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:03.432823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:03.433265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:03.433959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:03.434415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:03.434850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:03.570392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:03.578500 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3b405674-f9ba-4299-9370-c85ab804224d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1315 microversion: 2.1 time: 0.158471 Sep 14 10:01:03.579069 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1542/5205] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:03 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:04.599118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:04.599943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:04.605231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:04.605952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:04.613277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.613785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.614241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:04.615075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.615550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.616028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:04.818078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:04.826392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26742a73-2c84-4b3e-9c6e-c89c308c094a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1502 microversion: 2.1 time: 0.228256 Sep 14 10:01:04.826958 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3664/5206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:04 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:04.849865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:04.850714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:04.852370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:04.858623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.859111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.859547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:04.860270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.860724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.861146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:04.908017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:04.929967 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c6f0b4f-4f9d-4a8f-84e6-3f103f89cfb2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12/action" status: 202 len: 0 microversion: 2.1 time: 0.084637 Sep 14 10:01:04.930625 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1543/5207] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:04 2022] POST /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:04.938982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:04.939657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:04.947485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.948044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.948655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:04.949506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:04.949975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:04.950577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:05.093882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:05.102812 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62de6f16-cc92-44ae-b49e-b6bd9f1af807 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1507 microversion: 2.1 time: 0.167844 Sep 14 10:01:05.103584 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3665/5208] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:04 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:06.128198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:06.129554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:06.137028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.137534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.137978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.138687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.139148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.139579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.282474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:06.291479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-30ad003a-2e6a-48f7-a4b7-250c97507927 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1487 microversion: 2.1 time: 0.169063 Sep 14 10:01:06.292096 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1544/5209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:06 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1487 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:06.314915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:06.315469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:06.322603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.323109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.323558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.324301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.324773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.325250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.349968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lazy-loading 'flavor' on Instance uuid 44609601-1def-4252-ba08-ccff8a97ce12 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:01:06.400491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:06.550546 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49840d25-3988-48c0-aa8c-3716ae151b3d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12/action" status: 202 len: 0 microversion: 2.1 time: 0.239376 Sep 14 10:01:06.551220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3666/5210] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:06 2022] POST /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:06.560292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:06.560921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:06.567560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.568924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.569657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.570514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:06.570974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:06.571435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:06.710194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:06.718284 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79e64833-6900-4ff5-a4c4-b77ccc9ae3a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1493 microversion: 2.1 time: 0.161803 Sep 14 10:01:06.718867 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1545/5211] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:06 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1493 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:07.743396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:07.744176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:07.751752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:07.752287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:07.752751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:07.753462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:07.753937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:07.754384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:07.891598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:07.900364 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-12ccfebf-d928-42f6-8b63-4c0af163d629 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1514 microversion: 2.1 time: 0.162818 Sep 14 10:01:07.900953 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3667/5212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:07 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:08.925282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:08.925953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:08.935589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:08.936125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:08.936700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:08.937573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:08.937795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:08.938232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:09.098775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:09.107819 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d204cc6-35ee-4e16-8d46-636a80a7d3f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.186629 Sep 14 10:01:09.108791 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1546/5213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:08 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:10.227419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:10.228177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:10.235841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:10.236688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:10.237844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:10.238585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:10.239058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:10.239501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:10.412095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:10.424959 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc0b18ce-26e7-4c10-88d1-5f91b4e506b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.295622 Sep 14 10:01:10.440391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3668/5214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:10 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:11.422949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44609601-1def-4252-ba08-ccff8a97ce12", "name": "network-vif-plugged", "status": "completed", "tag": "2e2e5d3d-c8fd-4292-9c55-1889908821b8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:11.440172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:11.447658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:11.448159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:11.448600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:11.452557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:11.456181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:11.463332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:11.466206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:11.466919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:11.467550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:11.468770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:11.470032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:11.471856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:11.473168 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] Creating event network-vif-plugged:2e2e5d3d-c8fd-4292-9c55-1889908821b8 for instance 44609601-1def-4252-ba08-ccff8a97ce12 on n-h1-851028-12 Sep 14 10:01:11.479568 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9c0ad369-cd7d-4440-99bf-049e1976d24e req-a19ad16c-8bdb-479a-809a-18d4a6c1a2a1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148860 Sep 14 10:01:11.482626 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1547/5215] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:11.635656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:11.650052 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f9217f0-ddbd-46b4-a964-be1a01f5ba2f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.202402 Sep 14 10:01:11.650826 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3669/5216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:11 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:12.678369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:12.680883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:12.687309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:12.687797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:12.688253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:12.689125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:12.690116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:12.690862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:12.871304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:12.882923 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3f92f25-655e-433a-8bb8-c84329f72e42 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.210035 Sep 14 10:01:12.883665 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1548/5217] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:12 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:13.914610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:13.915956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:13.925733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:13.926336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:13.927024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:13.927818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:13.929134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:13.930107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:14.092166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:14.102540 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c08a152-952d-4067-9622-5c4e2c4afb56 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.195009 Sep 14 10:01:14.117009 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3670/5218] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:13 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:15.129795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:15.131429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:15.141180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:15.141674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:15.142115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:15.143108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:15.143840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:15.144304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:15.336995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:15.349747 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac455b4c-9599-46d0-96dd-7abb148fcfa5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.223888 Sep 14 10:01:15.351209 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1549/5219] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:15 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:16.374428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:16.375095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:16.382302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:16.382713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:16.383211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:16.383887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:16.384393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:16.384835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:16.551422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:16.564725 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-39dafcbd-7574-4e78-8efa-74b25c2f7cfc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.194346 Sep 14 10:01:16.565568 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3671/5220] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:16 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:17.589615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:17.590781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:17.602612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:17.603510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:17.604056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:17.604869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:17.605415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:17.606141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:17.776921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:17.786309 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a06af866-8996-45bd-810d-8dd812069717 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1509 microversion: 2.1 time: 0.200216 Sep 14 10:01:17.799924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1550/5221] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:17 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:18.810510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:18.811060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:18.817873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:18.818372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:18.818821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:18.819829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:18.820374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:18.820815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:19.024914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:19.033418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99c39214-e979-424e-8e2b-5b1938829fde tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1506 microversion: 2.1 time: 0.227014 Sep 14 10:01:19.034321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3672/5222] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:18 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:20.059228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:20.059960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:20.066994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:20.067518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:20.067982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:20.068676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:20.069180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:20.069636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:20.211979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:20.220535 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a050fbcd-0d50-404e-8799-4d1a2c34167d tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1506 microversion: 2.1 time: 0.165186 Sep 14 10:01:20.221129 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1551/5223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:20 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:21.245963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:21.246631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:21.254217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.254727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.255192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.256016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.256538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.257099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.405997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:21.415053 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-845292ed-e99d-4270-871a-e66828ddc0f0 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 200 len: 1449 microversion: 2.1 time: 0.174505 Sep 14 10:01:21.415642 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3673/5224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:21 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:21.438048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:21.438672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:21.446075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.446566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.447009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.447707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.448189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.448620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.581625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:21.589708 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3aadedb-6500-46b8-8969-7df89114c327 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.155713 Sep 14 10:01:21.590524 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1552/5225] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:21 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:21.625165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:21.625808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:21.632997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.633509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.633968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.634699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.635177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.635624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.777188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:21.785158 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6799181d-90c8-4c20-b027-40d8697e2e76 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.164285 Sep 14 10:01:21.785926 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3674/5226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:21 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:21.808998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:21.809704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:21.815765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.816313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.816745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.817449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:21.817920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:21.818354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:21.958100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:21.966507 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-720ebeb8-bfb3-4926-acda-0c94cd84014e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.161322 Sep 14 10:01:21.967024 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1553/5227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:21 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:21.994549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:21.995448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:22.002178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:22.002756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:22.003164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:22.004013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:22.004617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:22.005060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:22.211789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:22.219963 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afe80159-9d7f-485c-bf7d-408956a10efc tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.230195 Sep 14 10:01:22.220490 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3675/5228] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:21 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:22.243923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:22.250531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:22.251023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:22.251457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:22.314148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Going to try to stop instance {{(pid=122443) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:01:22.361934 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34406743-8fbe-4d6f-9f6e-303b4164aa45 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.122286 Sep 14 10:01:22.363177 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1554/5229] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:22 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:22.372445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:22.373191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:22.380956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:22.382139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:22.383286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:22.384398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:22.384882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:22.385323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:22.544856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:22.552813 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-93cc6e07-e195-4770-a287-a65965aef986 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.185243 Sep 14 10:01:22.554664 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3676/5230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:22 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:23.298806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44609601-1def-4252-ba08-ccff8a97ce12", "name": "network-vif-unplugged", "status": "completed", "tag": "2e2e5d3d-c8fd-4292-9c55-1889908821b8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:23.311575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:23.312108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:23.312546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:23.324719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.compute.server_external_events [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] Unable to find a host for instance 44609601-1def-4252-ba08-ccff8a97ce12. Dropping event network-vif-unplugged {{(pid=122443) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 10:01:23.325626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a88546cc-b306-45a6-8384-4febd27142ba req-ed8a8f48-eba5-4e8d-abd0-07a29e716b50 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031118 Sep 14 10:01:23.326249 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1555/5231] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 10:01:23.578143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:23.578806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:23.586047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:23.586635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:23.587377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:23.588864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:23.589515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:23.590025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:23.731236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:23.739095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-796b0092-4081-4de6-b733-1d52482ddbe3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.164912 Sep 14 10:01:23.739677 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3677/5232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:23 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:24.763588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:24.764378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:24.771241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:24.771756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:24.772231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:24.773008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:24.773514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:24.773942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:24.906070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:24.915049 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f488bb82-4f55-44bd-bcdd-9c041aa75719 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.155312 Sep 14 10:01:24.915632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1556/5233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:24 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:25.939535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:25.940202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:25.948143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:25.948655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:25.949113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:25.949830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:25.950304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:25.950748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:26.084350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:26.092352 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d7bcd81-f199-4bc8-a4bc-c3cb27e184e9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.156758 Sep 14 10:01:26.092939 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3678/5234] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:25 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:27.115675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:27.116328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:27.123720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:27.124251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:27.124953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:27.125649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:27.126105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:27.126533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:27.259613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:27.267494 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5baf72a-b07c-4cbd-96d0-c08f4a64ee01 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.155689 Sep 14 10:01:27.268110 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1557/5235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:27 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:28.291672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:28.292362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:28.299456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:28.299992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:28.300470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:28.301180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:28.301648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:28.302083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:28.436452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:28.444213 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1644537a-9d67-40f2-a784-ef6a048b0f68 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.157414 Sep 14 10:01:28.444792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3679/5236] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:28 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:29.467797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:29.468397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:29.475237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:29.475728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:29.476201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:29.476895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:29.477935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:29.478822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:29.627120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:29.636879 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c9542824-9a85-43e2-9f42-84024e666b53 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.172854 Sep 14 10:01:29.637893 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1558/5237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:29 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:30.663933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:30.665717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:30.672742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:30.673254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:30.673711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:30.674433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:30.674906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:30.675353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:30.812722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:30.820627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da178c20-b7da-44d2-9f4d-a1347be64109 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.162396 Sep 14 10:01:30.821801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3680/5238] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:30 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:31.845646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:31.846465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:31.853762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:31.854243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:31.854678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:31.855368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:31.855820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:31.856267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:31.993823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:32.002126 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4f61df55-78c2-4e0f-ba74-6392f371094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1681 microversion: 2.1 time: 0.160379 Sep 14 10:01:32.003298 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1559/5239] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:31 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:33.026351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:33.027070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:33.034437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:33.034941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:33.035391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:33.036135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:33.036596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:33.037035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:33.170746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:33.179167 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-93619b80-811f-4940-bf67-7020cafe7533 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1658 microversion: 2.1 time: 0.157314 Sep 14 10:01:33.179757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3681/5240] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:33 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:33.202461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:33.209437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:33.209913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:33.210345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:33.226280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:33.238229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Going to try to start instance {{(pid=122443) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:01:33.287285 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de6d545b-8c19-4a78-a8fa-81fd2ba605b5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.088475 Sep 14 10:01:33.287953 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1560/5241] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:33 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:33.297193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:33.297831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:33.304460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:33.306233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:33.306233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:33.312118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:33.312658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:33.313122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:33.549559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:33.551742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:33.559459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5fcee7ba-3650-413b-9636-377fe0d81c3a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1667 microversion: 2.1 time: 0.266238 Sep 14 10:01:33.560109 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3682/5242] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:33 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1667 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:34.584179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:34.584883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:34.592734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.593218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.593654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:34.594340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.594791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.595213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:34.729381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:34.737183 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bba86231-653e-4ea1-8c25-d1cf0ff7beb1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.157320 Sep 14 10:01:34.737755 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1561/5243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:34 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:34.764487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:34.765283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:34.772866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.773372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.773826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:34.775392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.775867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.776365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:34.909809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:34.917974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95490f01-3301-4696-98f2-9e816d56b3f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.159052 Sep 14 10:01:34.918570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3683/5244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:34 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:34.942689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:34.943302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:34.949979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.950476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.950899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:34.951584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:34.952095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:34.952521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.081907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:35.090219 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-767b6de6-b2da-4df4-8864-924203b039b9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.151388 Sep 14 10:01:35.090787 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1562/5245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:34 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:35.115558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:35.116129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.122330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.122841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.123283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.124021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.124489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.125178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.265298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:35.273165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-37139e2d-2c18-4744-83dd-b7ec2ab3659e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.161592 Sep 14 10:01:35.273755 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3684/5246] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:35.296071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:35.296702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.302714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.303204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.303647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.304426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.304890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.305321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.438202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:35.446557 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0c01dfdc-9b6d-47ca-8de0-da6ca3ec8bd4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.153842 Sep 14 10:01:35.447195 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1563/5247] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:35.473253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:35.473800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.480080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.480752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.481217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.484075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.484559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.485004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.508227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lazy-loading 'flavor' on Instance uuid 03b08d20-f0d1-4620-97c2-dafc937c4382 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:01:35.576117 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7a2fc395-9ee2-46bd-b56e-6e9cf395f5c3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.107791 Sep 14 10:01:35.576805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3685/5248] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:35 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:01:35.585233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:35.585860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:35.593913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.594445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.594926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.595684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:35.596243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:35.596627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:35.727877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:35.736020 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de55c076-5b4d-450f-bc14-db80b10f8b7f tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1679 microversion: 2.1 time: 0.154912 Sep 14 10:01:35.736600 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1564/5249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:35 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:36.763165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:36.764255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:36.780330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.780848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.781304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:36.782335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.783208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.784090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:36.918680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:36.926975 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0891f01b-24e1-4dda-931d-49bc895d527e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1662 microversion: 2.1 time: 0.170865 Sep 14 10:01:36.927558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3686/5250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:36 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:36.950494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:36.951036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:36.957957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.958439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.958869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:36.959554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:36.960105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:36.960529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:37.029871 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3cc47161-2230-411e-a72b-c43d49e31380 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action" status: 202 len: 0 microversion: 2.1 time: 0.083670 Sep 14 10:01:37.030446 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1565/5251] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:01:36 2022] POST /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:01:37.038707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:37.039358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:37.045425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:37.045934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:37.046381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:37.047102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:37.047592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:37.048101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:37.267562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:37.275730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-25f349e3-c206-468c-b7a9-840bd95764f4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1668 microversion: 2.1 time: 0.240892 Sep 14 10:01:37.276367 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3687/5252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:37 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:38.300570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:38.301421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:38.309995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.310696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.311137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.311843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:38.312372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:38.312797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:38.450569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:38.458432 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c1b8a3d2-f675-42e8-978e-8702a1044a4e tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1668 microversion: 2.1 time: 0.162358 Sep 14 10:01:38.459005 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1566/5253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:38 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:39.482780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:39.483369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:39.490591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.491093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.491541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.492288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.493540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.494050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.628425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:39.637566 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-74e46648-9da6-41ca-9f8c-682eaf3713ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.158785 Sep 14 10:01:39.638153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3688/5254] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:39 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:39.660092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:39.660716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:39.668105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.668595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.669039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.669739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.670197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.670628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.803787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:39.812595 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1d5564c5-4708-4a07-844e-2df2c146350a tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1671 microversion: 2.1 time: 0.156434 Sep 14 10:01:39.813184 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1567/5255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:39 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:39.836418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:39.837023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:39.843456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.843986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.844447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.845151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:39.845620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:39.846059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:39.873261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:39.879498 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Working on deleting snapshot 9a5658bd-2883-4fdb-bc21-cd611653b045 from shelved instance... Sep 14 10:01:40.311673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Doing local delete in cell 9dda0999-63fa-48b3-a8b7-dc8019427d51(cell1) {{(pid=122444) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 14 10:01:40.312436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.312956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.313399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.313830 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 14 10:01:40.320965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] deallocate_for_instance() {{(pid=122444) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 14 10:01:40.797215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Updating instance_info_cache with network_info: [] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 10:01:40.905211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44609601-1def-4252-ba08-ccff8a97ce12", "name": "network-vif-deleted", "tag": "2e2e5d3d-c8fd-4292-9c55-1889908821b8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:40.917272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:40.917908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:40.918476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:40.933017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.compute.server_external_events [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] Unable to find a host for instance 44609601-1def-4252-ba08-ccff8a97ce12. Dropping event network-vif-deleted {{(pid=122443) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 10:01:40.934112 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-56fb1f56-fd17-44c7-aadb-b2a5e14ecf06 req-ab0118eb-721c-47bc-a44c-03e0167550c4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.139786 Sep 14 10:01:40.939633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1568/5256] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 146 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 10:01:41.066498 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-638b2d37-e126-4ff5-86eb-48316e4c094c tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 204 len: 0 microversion: 2.1 time: 1.233804 Sep 14 10:01:41.067040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3689/5257] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:39 2022] DELETE /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:41.075397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:41.076051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 44609601-1def-4252-ba08-ccff8a97ce12] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:41.081988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.082475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.082925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.083611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.084107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.084531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.098332 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 HTTP/1.1 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '44609601-1def-4252-ba08-ccff8a97ce12'} Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:41.100012 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 404 to user: Instance 44609601-1def-4252-ba08-ccff8a97ce12 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9dd5e146-1e2c-469c-bce7-798049e3c0c9 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12" status: 404 len: 111 microversion: 2.1 time: 0.030015 Sep 14 10:01:41.106614 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1569/5258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:41 2022] GET /compute/v2.1/servers/44609601-1def-4252-ba08-ccff8a97ce12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:41.112434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:41.112962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:41.119406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.119936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.120403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.121126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.121604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.122046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.148870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:41.175141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:41.234248 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4e180bb3-5b50-4539-8648-f8db8bde7ac4 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 204 len: 0 microversion: 2.1 time: 0.125466 Sep 14 10:01:41.235021 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3690/5259] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:41 2022] DELETE /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:41.243695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:41.244506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:41.250937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.251427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.251868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.252688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:41.253147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:41.253580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:41.340027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:41.347995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f1d542a0-9716-4a6b-a459-9397fc4557ff tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1465 microversion: 2.1 time: 0.108699 Sep 14 10:01:41.348551 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1570/5260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:41 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1465 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:42.372957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:42.373671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:42.376703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:42.382255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:42.382767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:42.383258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:42.384047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:42.384528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:42.384975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:42.475297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:42.484036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0d4d3858-d758-4f77-bf2e-f52c248c2060 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1465 microversion: 2.1 time: 0.116011 Sep 14 10:01:42.484627 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3691/5261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:42 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1465 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:43.004953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0", "name": "network-vif-deleted", "tag": "1adb953a-c4cc-4072-bd03-aa5cbafb6ffb"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:43.018617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=48 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:43.022973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.023542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.024690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.038120 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] Creating event network-vif-deleted:1adb953a-c4cc-4072-bd03-aa5cbafb6ffb for instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 on n-h2-851028-12 Sep 14 10:01:43.047108 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2d8556fc-14ac-48eb-bed1-6d56433f97a6 req-15479597-8967-455d-816d-33042a4e6bd5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045069 Sep 14 10:01:43.048540 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1571/5262] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:43.508413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:43.509798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:43.516571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.517072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.517530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.518245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.518714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.519156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.553523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:43.554217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:43.554806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:43.555309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lazy-loading 'fault' on Instance uuid d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:01:43.603064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:43.610272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e172ca02-ce90-4469-bc19-49df6cddb1f8 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 200 len: 1304 microversion: 2.1 time: 0.107316 Sep 14 10:01:43.610852 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3692/5263] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:43 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:44.634673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:44.635384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:44.642674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.643171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.643616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.644938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.645642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.646228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.660805 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 HTTP/1.1 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'd34b0cc0-af5e-48b7-a9cb-62e6f873fdd0'} Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:44.662447 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 404 to user: Instance d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-76c43986-7c6c-464f-81de-348b28a0d2e1 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0" status: 404 len: 111 microversion: 2.1 time: 0.033727 Sep 14 10:01:44.668140 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1572/5264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:44 2022] GET /compute/v2.1/servers/d34b0cc0-af5e-48b7-a9cb-62e6f873fdd0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:44.673847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:44.674383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:44.681359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.681847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.682291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.682985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.683447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.683879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.708788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:44.788929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-450f3027-2603-4802-ae7d-7fc38d954205 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 204 len: 0 microversion: 2.1 time: 0.118448 Sep 14 10:01:44.789545 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3693/5265] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:44 2022] DELETE /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:44.798117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:44.798765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:44.804895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.805387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.805838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.806526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:44.806981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:44.807411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:44.945968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:44.954015 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ff96f95-08bd-40ee-9deb-2931d37b7ea2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1508 microversion: 2.1 time: 0.159825 Sep 14 10:01:44.954597 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1573/5266] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:44 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:45.978186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:45.978900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:45.985961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:45.986554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:45.986921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:45.987632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:45.988135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:45.988576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:46.121354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:46.129629 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4143a186-e655-47c1-b04a-99867e9dd94b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1508 microversion: 2.1 time: 0.155838 Sep 14 10:01:46.130211 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3694/5267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:45 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:46.671674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed", "name": "network-vif-deleted", "tag": "e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:46.682772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:46.683180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:46.683617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:46.697809 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] Creating event network-vif-deleted:e0bfa256-56bf-45f3-ba3c-c1229a0b6bd4 for instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed on n-h2-851028-12 Sep 14 10:01:46.703221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1a90a8e0-3112-4886-b587-06b282564d6d req-e1beef2d-1ebd-4814-bc43-cb48f98e0085 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035139 Sep 14 10:01:46.703836 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1574/5268] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:47.154616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:47.155403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:47.164353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:47.164745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:47.165381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:47.166414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:47.166970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:47.167459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:47.204415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:47.204807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:47.205262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:47.205800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lazy-loading 'fault' on Instance uuid 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:01:47.253489 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:47.261354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c0447e0-92d3-413f-9d8a-9b5b37aef3d3 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 200 len: 1304 microversion: 2.1 time: 0.111333 Sep 14 10:01:47.261942 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3695/5269] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:47 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:48.286222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:48.286917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:48.293786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.294269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.294703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.295395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.295843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.296308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.311199 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed HTTP/1.1 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed'} Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:48.312905 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 404 to user: Instance 19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b1af0118-c4fd-485f-b66b-d51317abe7fb tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed" status: 404 len: 111 microversion: 2.1 time: 0.033302 Sep 14 10:01:48.318266 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1575/5270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:48 2022] GET /compute/v2.1/servers/19c37e38-0f2a-40d2-b2bc-26a8c06ab0ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:48.323923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:48.324450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:48.331415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.331946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.332408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.333127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.333602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.334051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.360246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:48.438015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae94dc04-f5c6-4cd2-838c-e418e31846ea tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 204 len: 0 microversion: 2.1 time: 0.118453 Sep 14 10:01:48.438643 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3696/5271] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:48 2022] DELETE /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:48.448311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:48.448932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:48.454929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.455413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.455846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.456597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:48.457049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:48.457475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:48.594764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:48.602973 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52558b9d-d5fa-44df-872c-bbf7a671b1a5 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1495 microversion: 2.1 time: 0.159853 Sep 14 10:01:48.603763 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1576/5272] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:48 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1495 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:49.627529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:49.630769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:49.636314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:49.636878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:49.637336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:49.638058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:49.638529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:49.638968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:49.779093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:49.786922 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db5ce8fa-c078-4935-9884-b8261c5c93c2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 200 len: 1495 microversion: 2.1 time: 0.163966 Sep 14 10:01:49.787716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3697/5273] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:49 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 1495 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:50.113904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d5566-3af9-4807-accc-b3549fa5d3df", "name": "network-vif-deleted", "tag": "cf318809-dfad-4611-b2be-f4299af9dd7e"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:50.128247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.128740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.129203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.141990 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] Creating event network-vif-deleted:cf318809-dfad-4611-b2be-f4299af9dd7e for instance 734d5566-3af9-4807-accc-b3549fa5d3df on n-h2-851028-12 Sep 14 10:01:50.150456 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-745f60e4-555c-449a-bb34-d96f05a7a601 req-14ca3352-ca70-4632-aa5a-5426ae84c148 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038577 Sep 14 10:01:50.151089 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1577/5274] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:01:50.809913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:50.810491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 734d5566-3af9-4807-accc-b3549fa5d3df] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:50.817608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.818113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.818569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.819281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.819753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.820224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.834169 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df HTTP/1.1 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '734d5566-3af9-4807-accc-b3549fa5d3df'} Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:50.835842 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 404 to user: Instance 734d5566-3af9-4807-accc-b3549fa5d3df could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62104f07-c7cd-4353-af72-ea3d903bc534 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df" status: 404 len: 111 microversion: 2.1 time: 0.032095 Sep 14 10:01:50.841861 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3698/5275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:50 2022] GET /compute/v2.1/servers/734d5566-3af9-4807-accc-b3549fa5d3df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:50.848212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:50.848803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:50.856154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.856642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.857079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.857768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.858223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.858648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.884022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:01:50.918279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:01:50.971638 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab4fd505-8ea8-4c1b-ac59-cead52436369 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 204 len: 0 microversion: 2.1 time: 0.127349 Sep 14 10:01:50.972573 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1578/5276] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:01:50 2022] DELETE /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:01:50.981632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:50.982258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:50.988337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.988819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.989268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:50.989964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:50.990428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:50.990872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:51.125771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:51.134906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bb5c77f-912d-4558-8981-e2baa33085b2 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1677 microversion: 2.1 time: 0.157064 Sep 14 10:01:51.135414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3699/5277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:50 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:01:52.159390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:52.160068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:52.168534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:52.169024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:52.169465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:52.170167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:52.170625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:52.171050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:52.304955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:52.313275 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-176c0cd6-d6a3-496b-b8f6-659b812b4480 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1677 microversion: 2.1 time: 0.158282 Sep 14 10:01:52.313851 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1579/5278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:52 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:53.337654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:53.338665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:53.345500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:53.346047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:53.346506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:53.347225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:53.347699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:53.348176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:53.597474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:53.605698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16725bfb-afd7-460e-9872-1f1df0ace922 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1677 microversion: 2.1 time: 0.272790 Sep 14 10:01:53.606267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3700/5279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:53 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:54.601140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b08d20-f0d1-4620-97c2-dafc937c4382", "name": "network-vif-deleted", "tag": "52b57a67-fb88-40d8-976b-1704ee78840c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:01:54.611699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:54.612211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:54.613051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:54.624989 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] Creating event network-vif-deleted:52b57a67-fb88-40d8-976b-1704ee78840c for instance 03b08d20-f0d1-4620-97c2-dafc937c4382 on n-h1-851028-12 Sep 14 10:01:54.630699 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-922c3f91-ba9a-4b4c-9b9e-d6b19dccbe9d req-b61195fa-e3e9-4c8e-867c-60c1bc33bfdf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033013 Sep 14 10:01:54.631340 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1580/5280] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:01:54.635571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:54.638084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:54.651628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:54.652176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:54.652645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:54.653381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:54.653857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:54.654301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:54.722966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52707aba3d784d0ebe45fdee819c3521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d098ebd614b829cd35ebc8c272518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:01:54.731832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c334640a-70f6-4246-9d93-68c9bb4fd70b tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 200 len: 1324 microversion: 2.1 time: 0.105122 Sep 14 10:01:54.733040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3701/5281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:54 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 1324 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:01:55.767154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:55.767857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] [instance: 03b08d20-f0d1-4620-97c2-dafc937c4382] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:01:55.774072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:55.774720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:55.775347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:55.776085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:01:55.776549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:01:55.776975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:01:55.793558 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] HTTP exception thrown: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Request method failure captured: Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 HTTP/1.1 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaU5pVp6D9Zrfh_tLAQ0J9IrlsKX3cGPONgDW99YXQ5YO-e6PDociNxwEVTLX0szG-zcB2Hd2-eaqWNK1nJCrPSAZa1lgNZ3Z3FNqw9sUSZy-6izfxOBdCmji_DBPLIj1_Y5qJfoBqAY52tye7dNRcuhCyJDIZ-IpBvGZLVpRwyA5XQ Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e29d098ebd614b829cd35ebc8c272518", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e29d098ebd614b829cd35ebc8c272518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e29d098ebd614b829cd35ebc8c272518"}]}] Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e29d098ebd614b829cd35ebc8c272518 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-475881699 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 52707aba3d784d0ebe45fdee819c3521 Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-475881699-project Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '03b08d20-f0d1-4620-97c2-dafc937c4382'} Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:01:55.795192 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Returning 404 to user: Instance 03b08d20-f0d1-4620-97c2-dafc937c4382 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7aeda106-624c-4b65-ae23-f3b68169c611 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382" status: 404 len: 111 microversion: 2.1 time: 0.034682 Sep 14 10:01:55.800554 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1581/5282] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:01:55 2022] GET /compute/v2.1/servers/03b08d20-f0d1-4620-97c2-dafc937c4382 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:01:55.806328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-abba9e01-bc52-46c7-8f7b-4fac2975b693 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] Calling method '.version_select at 0x7f693e1179d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:01:55.826936 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-abba9e01-bc52-46c7-8f7b-4fac2975b693 tempest-ServerActionsTestJSON-475881699 tempest-ServerActionsTestJSON-475881699-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439653605" status: 202 len: 0 microversion: 2.1 time: 0.025010 Sep 14 10:01:55.827529 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3702/5283] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 10:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439653605 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:02:05.307764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1506310350", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:05.364552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] validate_networks() for [('39dbc1a5-a2b7-4ecc-9eaa-b8536e8b96a4', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:02:05.767251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:02:05.767699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:02:05.768192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:02:05.768601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:02:05.769008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:02:05.778611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:05.779095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:05.779531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:05.780329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:05.780814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:05.781382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:05.784006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:05.800721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Getting quotas for project 002762e1092647c0a88392502c214375. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:02:05.806176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Getting quotas for user ef04e48fcac04da999a39a08c2c48d68 and project 002762e1092647c0a88392502c214375. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:02:05.819996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:02:05.823213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:02:05.871264 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5fedadd-027f-4107-ae25-2d1d9040dbdd tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.688017 Sep 14 10:02:05.872129 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1582/5284] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:02:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 10:02:05.881673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:05.882920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:05.888006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-144172db-9de1-48b3-a311-9c683e338125 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:05.888850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-144172db-9de1-48b3-a311-9c683e338125 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:05.965329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-144172db-9de1-48b3-a311-9c683e338125 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:05.972599 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-144172db-9de1-48b3-a311-9c683e338125 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1214 microversion: 2.1 time: 0.093149 Sep 14 10:02:05.980026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3703/5285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:05 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:06.997869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:06.999037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:07.006375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:07.006863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:07.007462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:07.008470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:07.008929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:07.009355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:07.126883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:07.138036 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c8abe2ac-2e16-4be7-bd67-e58d63ca9de9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1266 microversion: 2.1 time: 0.145381 Sep 14 10:02:07.155244 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1583/5286] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:06 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:08.161916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:08.162553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:08.179168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:08.180021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:08.180596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:08.182100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:08.183973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:08.184451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:08.371278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:08.383449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-225d59e9-de51-4433-b488-ac08b29202c8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.225394 Sep 14 10:02:08.403098 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3704/5287] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:08 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:08.760892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71", "tag": "af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:08.770575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:08.771064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:08.771609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:08.784138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] Creating event network-changed:af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f for instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 on n-h2-851028-12 Sep 14 10:02:08.789043 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4666f9a5-8c00-4483-b32a-faaf5be67d27 req-f4c27211-bd48-480e-b736-efdc27c9634a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102855 Sep 14 10:02:08.789657 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1584/5288] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:09.412897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:09.413535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:09.421278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:09.421783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:09.422298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:09.423378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:09.424029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:09.424587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:09.571404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:09.579509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-23a00ff2-0f87-42c2-a856-bc6891e4980f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.170550 Sep 14 10:02:09.580123 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3705/5289] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:09 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:10.604507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:10.605350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:10.611813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:10.612339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:10.612779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:10.613477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:10.613934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:10.614363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:10.763422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:10.771687 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b33a92b-df69-4d05-b2c7-57ea5b180326 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.172752 Sep 14 10:02:10.772322 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1585/5290] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:10 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:11.797163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:11.797799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:11.805122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:11.805626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:11.806099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:11.806918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:11.807622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:11.808122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:11.963724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:11.972390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8d028a2b-667d-46b7-90ae-9cd9fb063e51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.179013 Sep 14 10:02:11.972896 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3706/5291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:11 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:12.997139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:12.997775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:13.005847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:13.006567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:13.007029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:13.007793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:13.008304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:13.008746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:13.155643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:13.164905 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-45f1a1cd-7a5d-4de8-925b-c8e159fcb86a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.172265 Sep 14 10:02:13.165689 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1586/5292] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:12 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:13.880441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71", "name": "network-vif-plugged", "status": "completed", "tag": "af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:13.891621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:13.892165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:13.892673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:13.910468 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] Creating event network-vif-plugged:af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f for instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 on n-h2-851028-12 Sep 14 10:02:13.915605 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9ca5d94f-4c7a-4ebb-9573-5d8af6e79177 req-ff294cb3-40af-4c7f-8aa0-4ecd7e97de4a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 Sep 14 10:02:13.916912 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3707/5293] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:14.189350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:14.189973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:14.192865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:14.198117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:14.198602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:14.199039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:14.199767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:14.200257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:14.200688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:14.335878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:14.344406 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c4f52cb-99b3-4a71-952d-ed661f69da91 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1314 microversion: 2.1 time: 0.158951 Sep 14 10:02:14.344984 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1587/5294] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:14 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:15.369705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:15.371079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:15.377800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.378342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.378869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.379587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.380100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.380554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.519829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:15.527798 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-42b542e6-56b8-4984-8dd0-8c604abb9559 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1500 microversion: 2.1 time: 0.163871 Sep 14 10:02:15.528405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3708/5295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:15 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1500 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:15.550696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:15.554612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:15.562722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.563206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.563642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.564374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.564836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.566137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.593463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lazy-loading 'flavor' on Instance uuid bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:02:15.666478 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-413cc194-ab16-452c-a227-0ee3da9199b4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "POST /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71/action" status: 200 len: 32 microversion: 2.1 time: 0.119785 Sep 14 10:02:15.667832 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1588/5296] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:02:15 2022] POST /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:02:15.677415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:15.678055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:15.685409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.685925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.687023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.687758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:15.688262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:15.688710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:15.833236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:15.841292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9215084e-2ddd-4f65-ae76-a5ad8bb936ce tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.167927 Sep 14 10:02:15.841956 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3709/5297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:15 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:16.865439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:16.866144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:16.868240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:16.869035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:16.877244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:16.877730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:16.878166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:16.878859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:16.879310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:16.879735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:17.021724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:17.030248 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f0a80914-cb75-4369-bbe1-4ff3b3c165f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.169020 Sep 14 10:02:17.031145 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1589/5298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:16 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:18.054192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:18.054900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:18.056993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:18.063859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:18.064404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:18.064859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:18.065574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:18.066044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:18.066485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:18.202186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:18.210221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca230a85-4953-4a66-bf49-9f438bbe8a00 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.160031 Sep 14 10:02:18.210813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3710/5299] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:18 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:19.234137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:19.234790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:19.241858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:19.242348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:19.242790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:19.243489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:19.243976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:19.244406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:19.385919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:19.393832 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8112f483-c499-444d-831a-255308b6a6b5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.163619 Sep 14 10:02:19.394411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1590/5300] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:19 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:20.420168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:20.420801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:20.427667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:20.428203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:20.428665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:20.429374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:20.429842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:20.430281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:20.566511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:20.575043 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-77e24048-34d1-46e1-9915-0c05a03f7a92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.160410 Sep 14 10:02:20.575636 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3711/5301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:20 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:21.599018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:21.599659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:21.606902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:21.607397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:21.607869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:21.608627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:21.609085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:21.609517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:21.743542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:21.752229 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c8370e25-ed42-4d18-b83b-861e61544276 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.157205 Sep 14 10:02:21.752801 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1591/5302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:21 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:22.774609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:22.775254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:22.783625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:22.784228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:22.784676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:22.785387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:22.785885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:22.786319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:23.001709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:23.009591 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac19eff8-1c20-4d19-bcc9-abd133460a39 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.238842 Sep 14 10:02:23.010365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3712/5303] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:22 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:24.034268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:24.034871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:24.041641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:24.042127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:24.042573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:24.043272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:24.043726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:24.044200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:24.179879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:24.187657 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9c92d010-324b-47b3-9d70-a49511ace8b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.157269 Sep 14 10:02:24.188278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1592/5304] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:24 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:25.211542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:25.212200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:25.225882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:25.225882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:25.225882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:25.226339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:25.226573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:25.227413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:25.364081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:25.372521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-196da442-602d-43ca-98d2-fc1c25788943 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.164890 Sep 14 10:02:25.373110 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3713/5305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:25 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:26.396639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:26.397284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:26.405040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:26.405534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:26.405974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:26.406676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:26.407133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:26.407596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:26.541036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:26.549313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78a96b81-70f4-4f38-b844-484b4a2ce3bb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.156583 Sep 14 10:02:26.549888 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1593/5306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:26 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:27.572097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:27.572729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:27.581164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:27.581164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:27.581458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:27.582161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:27.582635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:27.583110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:27.718610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:27.726823 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcd671fb-39db-4dec-9c1e-fcf86fb1d81f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.158699 Sep 14 10:02:27.727531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3714/5307] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:27 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:28.750880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:28.751562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:28.758504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:28.758982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:28.759410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:28.760121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:28.760570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:28.761535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:28.895745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:28.903766 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9b0d0c6-1e30-4cc0-b30d-41f207889735 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.157017 Sep 14 10:02:28.904380 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1594/5308] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:28 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:29.927136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:29.927761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:29.935245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:29.935749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:29.936244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:29.936955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:29.937427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:29.937869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:30.073496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:30.081318 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d6a19a32-cc96-4c80-9375-db76cce8019d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.158230 Sep 14 10:02:30.081886 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3715/5309] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:29 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:31.103708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:31.104384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:31.117161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:31.117645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:31.118177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:31.118874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:31.119327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:31.119845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:31.285197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:31.297977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d9d03ab1-40f2-4cb5-9a73-499cbc190e7b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.197156 Sep 14 10:02:31.299502 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1595/5310] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:31 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:32.323189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:32.323822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:32.331105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:32.331612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:32.332115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:32.332838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:32.333312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:32.333814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:32.475355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:32.484472 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c421a9b-2e16-4ec4-82d8-1147794e97d8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.165223 Sep 14 10:02:32.485074 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3716/5311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:32 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:33.320939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:33.321433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:33.328270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.328697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.329140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.329841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.330335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.330770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.357919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:02:33.391584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:33.437071 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0af8a331-c2c6-419e-92ec-c51a34c5a42f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 204 len: 0 microversion: 2.1 time: 0.221971 Sep 14 10:02:33.437736 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1596/5312] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:02:33 2022] DELETE /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:02:33.446670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:33.447237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:33.455465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.463096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.463096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.463096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.463096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.463096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.508070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:33.508877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:33.515303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.515912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.516418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.517201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:33.517722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:33.518244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:33.599666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:33.608674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-742c2871-16ce-49d4-8dd7-10c24f04e38a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1578 microversion: 2.1 time: 0.166196 Sep 14 10:02:33.609290 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3717/5313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:33 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:33.656712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:33.664484 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aadc300f-43f3-4ebf-8588-594c1312afdf tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.160746 Sep 14 10:02:33.665064 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1597/5314] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:33 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:34.633178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:34.633817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:34.641057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:34.641569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:34.642020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:34.642743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:34.643218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:34.643663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:34.688675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:34.689398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:34.698111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:34.698610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:34.699050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:34.699766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:34.700299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:34.700728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:34.783914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:34.792921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19ec1c4a-eac5-410f-b7b4-6649ac798548 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1578 microversion: 2.1 time: 0.163643 Sep 14 10:02:34.793728 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3718/5315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:34 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:34.836415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:34.844830 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b12b892e-d4a6-42fc-88e0-6512c371575a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.160127 Sep 14 10:02:34.845403 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1598/5316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:34 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:35.786366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15590244-d05a-4d79-a4e6-2179503747b1", "name": "network-vif-deleted", "tag": "29f07237-a68c-43ee-bfe7-ecdb20f2ece9"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:35.811654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.812581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.817832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:35.818452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:35.822861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.827422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.827927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.830515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.831475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.832159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.832791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.843131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] Creating event network-vif-deleted:29f07237-a68c-43ee-bfe7-ecdb20f2ece9 for instance 15590244-d05a-4d79-a4e6-2179503747b1 on n-h1-851028-12 Sep 14 10:02:35.850982 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-9c9f53a0-5d66-493d-b4e1-ba16f3f08ad5 req-bb3e686f-36a4-4d2d-81a0-0a834a467817 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069438 Sep 14 10:02:35.856509 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3719/5317] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:35.871290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:35.872212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:35.880135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.881151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.881683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.882762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:35.883339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:35.883988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:35.919013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=89 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:35.958929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:35.968348 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3cf6f7d4-79e0-425e-87b4-92652b42d7bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1224 microversion: 2.1 time: 0.154329 Sep 14 10:02:35.968944 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1599/5318] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:35 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:36.073863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:36.087373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c24a4572-bcfd-44f7-8fca-a07d0f11029e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.220837 Sep 14 10:02:36.088583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3720/5319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:35 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:36.997005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:36.997619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:37.004758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.005243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.005675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.006362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.007018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.007441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.077236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:37.085369 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7d24d30-c2bb-42e6-853d-6a897fed7186 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1224 microversion: 2.1 time: 0.093066 Sep 14 10:02:37.085962 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1600/5320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:36 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:37.112088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:37.112729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:37.115426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:37.121043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.121549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.122013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.122737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:37.123208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:37.123651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:37.269077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:37.278121 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8e86681-594f-467c-9c1e-7e8885c058f9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.170009 Sep 14 10:02:37.278715 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3721/5321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:37 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:38.110031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:38.111200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:38.118232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.118723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.119675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.120402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.120856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.121289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.189185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:38.197058 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-409c7a74-718f-4ea5-8e5b-beb2d296f0e2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1224 microversion: 2.1 time: 0.091434 Sep 14 10:02:38.198847 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1601/5322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:38 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:38.301853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:38.302521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:38.309946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.310455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.310914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.311646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:38.312154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:38.312658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:38.454613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:38.462561 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62892d59-9abd-4284-a52e-12a18eac7998 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.164656 Sep 14 10:02:38.464213 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3722/5323] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:38 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:39.222510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:39.223127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:39.231856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.232382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.232824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.233545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.234060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.234511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.304976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:39.314175 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5cb32c0-e685-4948-a8ce-ce45287b5d9f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1224 microversion: 2.1 time: 0.095571 Sep 14 10:02:39.314918 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1602/5324] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:39 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:39.487233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:39.487864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:39.495556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.496116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.496572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.497280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:39.497755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:39.498198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:39.646140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:39.654957 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04dedcd0-5704-4c07-9abc-cd6fb099d13c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.171703 Sep 14 10:02:39.655645 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3723/5325] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:39 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:40.337461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:40.338018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:40.345047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.345530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.345965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.346659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.347104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.347524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.378403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.378875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.379303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.379746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lazy-loading 'fault' on Instance uuid 15590244-d05a-4d79-a4e6-2179503747b1 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:02:40.420674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:40.428552 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1525a018-5e98-4813-a645-819901f2a234 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 200 len: 1229 microversion: 2.1 time: 0.095085 Sep 14 10:02:40.429128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1603/5326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:40 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:40.678811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:40.679393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:40.687108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.687605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.688097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.688803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:40.689270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:40.689709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:40.825084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:40.833930 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-473b11e5-b692-4148-b6c6-89df32d0999f tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.159126 Sep 14 10:02:40.835040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3724/5327] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:40 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:41.452557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:41.453131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:41.459976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.460466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.460904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:41.461591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.462047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.462475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:41.475763 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 HTTP/1.1 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '15590244-d05a-4d79-a4e6-2179503747b1'} Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:02:41.477476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3f504273-ac69-4977-a315-086247014b82 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 404 len: 111 microversion: 2.1 time: 0.031307 Sep 14 10:02:41.483364 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1604/5328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:41 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:02:41.528252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-181418595", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229185920", "security_groups": [{"name": "tempest-secgroup-smoke-1069660230"}], "block_device_mapping_v2": [{"uuid": "74be5381-2681-4389-b07e-6c64ae244837", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:41.652903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:02:41.859543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:41.860224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:41.866389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.866771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.867496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:41.868234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:41.868817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:41.869431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:42.015374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:42.023594 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9d5e3258-1f59-4c92-9045-4eb63aa66ce4 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.167836 Sep 14 10:02:42.024224 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1605/5329] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:41 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:42.089245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:02:42.089733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:02:42.090205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:02:42.090625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:02:42.091048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:02:42.100056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:42.100556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:42.101006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:42.101741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:42.102209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:42.102646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:42.121096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:02:42.126543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:02:42.186293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:02:42.188517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74be5381-2681-4389-b07e-6c64ae244837',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:02:42.316732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e8a8358-b897-40d5-a649-6f02e7c357bd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792752 Sep 14 10:02:42.317396 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3725/5330] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:02:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:02:42.329327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fd819120-710a-45aa-88c0-0a0966838651 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:42.329897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd819120-710a-45aa-88c0-0a0966838651 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:42.332375 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:02:42.332557 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:02:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 (ip 10.222.0.90) !!! Sep 14 10:02:42.388496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fd819120-710a-45aa-88c0-0a0966838651 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:42.395457 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fd819120-710a-45aa-88c0-0a0966838651 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1093 microversion: 2.1 time: 0.070139 Sep 14 10:02:42.396059 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1606/5331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:42 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:43.047477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:43.048173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:43.055004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:43.055505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:43.056544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:43.057267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:43.057744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:43.058188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:43.192338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:43.201454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc7ef392-3280-4603-9f16-304d106f41b1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.158779 Sep 14 10:02:43.202184 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3726/5332] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:43 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:43.417656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:43.418485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:43.429644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:43.430382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:43.430831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:43.432353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:43.432816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:43.433252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:43.497920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:43.507116 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6626dd67-26d8-4604-94e1-352b06f27f21 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1209 microversion: 2.1 time: 0.094043 Sep 14 10:02:43.516548 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1607/5333] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:43 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:44.224498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:44.225525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:44.234433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.235597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.236197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.237184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.238028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.238820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.465429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:44.473673 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31e6b3f3-fc31-436b-9cb0-e35c2f0bfb04 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.253366 Sep 14 10:02:44.474508 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3727/5334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:44 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:44.531705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:44.532618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:44.537282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:44.541438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.541936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.542524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.543243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.543719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.544173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.692459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:44.701547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-db9c2e38-3865-4125-881c-463df0f9dc90 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1277 microversion: 2.1 time: 0.174037 Sep 14 10:02:44.702137 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1608/5335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:44 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:44.841344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2ce349-2555-45ac-b933-f207451ccf50", "tag": "c343988c-fb73-4f35-91da-1ddbe1cc39cc"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:44.865632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:44.866447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:44.868513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:44.889042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] Creating event network-changed:c343988c-fb73-4f35-91da-1ddbe1cc39cc for instance 1b2ce349-2555-45ac-b933-f207451ccf50 on n-h1-851028-12 Sep 14 10:02:44.894729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ba2e684e-a17b-432b-901c-82b3985c77ab req-2f8b1ade-a574-42d7-8217-a0599f46109f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058923 Sep 14 10:02:44.895969 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3728/5336] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:45.497847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:45.498862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:45.505144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.505640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.506079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.506785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.507243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.507674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.659208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:45.667971 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e67b9ed-e89c-4d24-982c-283f304fe264 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.174617 Sep 14 10:02:45.668555 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1609/5337] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:45 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:45.726903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:45.728990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:45.736397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.737069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.737812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.738717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:45.739351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:45.739857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:45.981396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:45.989768 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-814970b7-59f4-4a8f-b03e-e978a243e4fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1277 microversion: 2.1 time: 0.268173 Sep 14 10:02:45.990582 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3729/5338] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:45 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1277 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:46.692279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:46.692896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:46.700490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:46.701015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:46.701681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:46.702213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:46.702670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:46.703099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:46.842081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:46.849875 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad979a2d-04a9-4dbe-8dea-eda8c98eedd8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.161562 Sep 14 10:02:46.850454 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1610/5339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:46 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:47.015059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:47.015744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:47.022690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.023190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.023643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:47.024424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.024898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.025534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:47.174992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:47.183805 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a191aac-c17e-49bd-892e-42cd75ba92a1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1277 microversion: 2.1 time: 0.172633 Sep 14 10:02:47.184439 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3730/5340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:47 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:02:47.875094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:47.875823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:47.882915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.884360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.884822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:47.885525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:47.885983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:47.886410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:48.019861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:48.028362 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-99292857-64f3-4def-9d80-9351feab44f8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1506 microversion: 2.1 time: 0.157383 Sep 14 10:02:48.029052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1611/5341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:47 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:48.206845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:48.207471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:48.215226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:48.215731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:48.216203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:48.216989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:48.217606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:48.218540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:48.395437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:48.404189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7e91567-42aa-47d1-97df-e40d2762e7b6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1277 microversion: 2.1 time: 0.201176 Sep 14 10:02:48.404876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3731/5342] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:48 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:49.051742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:49.052412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:49.059882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.060410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.060847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.061537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.061983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.062404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.197659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:49.205643 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-77fd07e5-0507-4ef4-8b26-ba2e12995573 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1486 microversion: 2.1 time: 0.157826 Sep 14 10:02:49.206229 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1612/5343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:49 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1486 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:49.269373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-139974165", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:49.324679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] validate_networks() for [('39dbc1a5-a2b7-4ecc-9eaa-b8536e8b96a4', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:02:49.428919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:49.429696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:49.436489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.437103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.437657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.438568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.439108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.439612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.586065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:49.594150 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e918a86-96f1-4325-a762-71843c6ca6f7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.169761 Sep 14 10:02:49.594728 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1613/5344] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:49 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:49.724918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:02:49.725357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:02:49.725849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:02:49.726275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:02:49.726704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:02:49.736865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.737365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.737816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.738560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:49.739057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:49.739506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:49.757706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Getting quotas for project 002762e1092647c0a88392502c214375. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:02:49.763426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Getting quotas for user ef04e48fcac04da999a39a08c2c48d68 and project 002762e1092647c0a88392502c214375. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:02:49.776921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:02:49.779273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:02:49.827373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bbd8ea5-ce39-411b-8a4d-45deaba946b8 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.562050 Sep 14 10:02:49.829064 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3732/5345] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:02:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:02:49.841972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f26b51a7-8fed-4fd8-a6e7-59235e73c0b0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:49.843167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f26b51a7-8fed-4fd8-a6e7-59235e73c0b0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:49.903834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f26b51a7-8fed-4fd8-a6e7-59235e73c0b0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:49.913970 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f26b51a7-8fed-4fd8-a6e7-59235e73c0b0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1213 microversion: 2.1 time: 0.077344 Sep 14 10:02:49.915616 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1614/5346] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:49 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:50.619936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:50.620490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:50.627553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:50.628102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:50.628557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:50.629264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:50.629737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:50.630179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:50.767202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:50.775537 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36ff43b2-f643-4c11-ae78-8a3507fb47fa tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.161283 Sep 14 10:02:50.776178 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3733/5347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:50 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:50.938630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:50.939346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:50.947008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:50.947590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:50.948135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:50.948921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:50.949450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:50.949952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:50.954321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:51.043330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:51.052109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7363a847-5a78-4ebd-925c-c9df1d9bc0d5 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1283 microversion: 2.1 time: 0.117383 Sep 14 10:02:51.052959 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1615/5348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:50 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:51.799450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:51.800076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:51.807385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:51.807909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:51.808373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:51.809092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:51.809560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:51.810003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:51.958823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:51.968188 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97604ad2-aa8a-4844-80f4-80068ac33620 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.172903 Sep 14 10:02:51.968806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3734/5349] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:51 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:52.076374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:52.076960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:52.083776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:52.084304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:52.084744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:52.085443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:52.085895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:52.087230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:52.290857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:52.298576 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2a13cd02-d5c2-40b7-bacb-e2e0b827b211 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.226329 Sep 14 10:02:52.299159 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1616/5350] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:52 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:52.620396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f", "tag": "689ede0b-d446-433c-adc6-5801e55eb4ca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:52.630804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:52.631305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:52.631755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:52.643923 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] Creating event network-changed:689ede0b-d446-433c-adc6-5801e55eb4ca for instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f on n-h2-851028-12 Sep 14 10:02:52.649056 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c4eeb7f5-2a7e-4618-a44d-83f0c32b1c11 req-09fd3f38-8f29-4da5-a193-814c85dbae68 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033294 Sep 14 10:02:52.649680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3735/5351] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:02:52.992164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:52.993101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:52.999575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:53.000105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:53.000545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:53.001578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:53.001807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:53.002237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:53.139569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:53.147315 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-979df823-e694-4280-a578-3a5527dbcbf3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.159172 Sep 14 10:02:53.147912 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1617/5352] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:52 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:53.325832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:53.326559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:53.333025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:53.333532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:53.334020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:53.334739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:53.335217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:53.335662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:53.470396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:53.478506 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca413267-f0f4-4c78-b856-9031c3dd84a0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.159777 Sep 14 10:02:53.479098 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3736/5353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:53 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:54.170360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:54.171611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:54.178832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:54.179331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:54.180405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:54.181105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:54.181562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:54.181990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:54.394465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:54.403187 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfc42e8c-7701-4497-ab70-594c0fb322e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.236838 Sep 14 10:02:54.404072 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1618/5354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:54 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:54.501656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:54.502417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:54.509768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:54.510189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:54.510647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:54.511352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:54.511821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:54.512313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:54.654037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:54.661886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-397ac8e5-e701-467f-8a61-1b9d30151a72 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.164520 Sep 14 10:02:54.662491 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3737/5355] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:54 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:55.427110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:55.427657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:55.435095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:55.435579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:55.436041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:55.436735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:55.437186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:55.437611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:55.573689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:55.581632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3797f3d8-2273-4e47-b437-93466cb67902 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.158479 Sep 14 10:02:55.582219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1619/5356] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:55 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:55.686110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:55.686667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:55.693670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:55.694175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:55.694640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:55.695703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:55.696597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:55.697155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:55.840717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:55.848497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ccae25e-a3fc-48ee-9e2f-fa41ec9d4b6e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.166393 Sep 14 10:02:55.849082 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3738/5357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:55 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:56.604481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:56.605036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:56.611888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:56.612399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:56.612835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:56.613529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:56.613978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:56.614401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:56.744908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:56.752844 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-00102e66-0064-436c-86f7-a1a4ada64f84 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.152545 Sep 14 10:02:56.753424 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1620/5358] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:56 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:56.873879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:56.874414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:56.881381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:56.881888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:56.883086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:56.883838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:56.884348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:56.884795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:56.899917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:02:57.015770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:57.023827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca077538-4266-40c3-b811-8cf9f4a3658b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.155118 Sep 14 10:02:57.024425 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3739/5359] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:56 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:57.778799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:57.779602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:57.787731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:57.788265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:57.788711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:57.789429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:57.789891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:57.790327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:57.937480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:57.946288 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-639795e7-ec35-4c49-b1fe-fbcc2eeb8e8a tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.173976 Sep 14 10:02:57.946901 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1621/5360] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:57 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:58.046773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:58.047499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:58.055269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:58.055765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:58.056234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:58.056950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:58.057413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:58.057851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:58.206041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:58.214838 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-095bf550-ef56-4d46-a8ee-fd72a5e07a95 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.171983 Sep 14 10:02:58.215463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3740/5361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:58 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:58.275537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f", "name": "network-vif-plugged", "status": "completed", "tag": "689ede0b-d446-433c-adc6-5801e55eb4ca"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:02:58.285530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:58.286022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:58.286451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:58.297922 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] Creating event network-vif-plugged:689ede0b-d446-433c-adc6-5801e55eb4ca for instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f on n-h2-851028-12 Sep 14 10:02:58.302833 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-bd0969b3-c313-4c93-abca-3e8f7389dfea req-bf227ca0-6c22-41ab-8107-7f1e99535746 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032825 Sep 14 10:02:58.303505 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1622/5362] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:02:58.969987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:58.970620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:58.977334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:58.977836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:58.978295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:58.979006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:58.979481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:58.979951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:59.110749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:59.118572 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c046bf84-4449-43cf-ad09-39eb91ab54c1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.152530 Sep 14 10:02:59.119161 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3741/5363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:58 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:02:59.240062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:02:59.240767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:02:59.247714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:59.248232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:59.248673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:59.249365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:02:59.249820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:02:59.250244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:02:59.388404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:02:59.396468 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-24d5b0ac-4ce4-48e4-931d-4e96b92d9680 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1313 microversion: 2.1 time: 0.161567 Sep 14 10:02:59.397136 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1623/5364] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:02:59 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:00.141579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:00.142197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:00.144099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:00.144814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:00.151793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.152313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.152826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.153476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.153936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.154369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.297516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:00.306238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49408457-078f-4bb3-b2c9-4b728281c00c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.168572 Sep 14 10:03:00.306836 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3742/5365] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:00 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:00.321746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce349-2555-45ac-b933-f207451ccf50", "name": "network-vif-plugged", "status": "completed", "tag": "c343988c-fb73-4f35-91da-1ddbe1cc39cc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:00.326763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:00.333263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.333738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.334170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.345808 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] Creating event network-vif-plugged:c343988c-fb73-4f35-91da-1ddbe1cc39cc for instance 1b2ce349-2555-45ac-b933-f207451ccf50 on n-h1-851028-12 Sep 14 10:03:00.351508 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-b1340415-9577-407b-9cf5-a4998402ff26 req-7a1c0715-6961-43e0-b442-0c2970cde1d0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032706 Sep 14 10:03:00.352139 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1624/5366] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:00.421588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:00.422220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:00.428406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.428919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.429411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.430114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.430590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.431033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.596203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:00.604259 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd66ffc2-915e-4991-8b27-6205a27ae7ea tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1500 microversion: 2.1 time: 0.186656 Sep 14 10:03:00.604850 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3743/5367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:00 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:00.628690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:00.630987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:00.638495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.638993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.639438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.640205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.640667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.641101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.664496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lazy-loading 'flavor' on Instance uuid fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:03:00.737068 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-01c3e1a6-71d6-4925-9684-8d2fa7740d92 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "POST /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f/action" status: 200 len: 32 microversion: 2.1 time: 0.112496 Sep 14 10:03:00.737680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1625/5368] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:03:00 2022] POST /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:03:00.748570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:00.749208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:00.756092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.756633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.757209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.757939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:00.758418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:00.758888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:00.893528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:00.902363 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f12dda9c-5d20-4147-a1cf-02e8ef75fce0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.158092 Sep 14 10:03:00.902970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3744/5369] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:00 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:01.330629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:01.331324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:01.338614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:01.339289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:01.339750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:01.340616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:01.341072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:01.341495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:01.487019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:01.496180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-601abfa5-5da8-4c93-9828-087903ff994f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1265 microversion: 2.1 time: 0.169546 Sep 14 10:03:01.497653 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1626/5370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:01 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:01.925398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:01.926692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:01.934717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:01.935219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:01.935672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:01.936422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:01.936893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:01.937361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:02.069035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:02.078302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fc144334-b14c-4b69-b56b-c59b73e5613a tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.156788 Sep 14 10:03:02.078893 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3745/5371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:01 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:02.520970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:02.521571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:02.529257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:02.529752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:02.530192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:02.530889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:02.531352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:02.531782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:02.662969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:02.672729 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f7f30ed-5428-43f7-99e1-ea4b48760394 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1452 microversion: 2.1 time: 0.155522 Sep 14 10:03:02.673416 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1627/5372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:02 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:02.694993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:02.695677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:02.701775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:02.702266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:02.702711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:02.703410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:02.703870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:02.704328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:02.842072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:02.849916 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4ff924dc-c7aa-4fe7-a1ee-97c8e0fa373c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1452 microversion: 2.1 time: 0.158850 Sep 14 10:03:02.850500 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3746/5373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:02 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:03.103075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:03.103701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:03.109754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:03.110243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:03.110687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:03.111390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:03.111849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:03.112304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:03.250803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:03.259925 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a13d0ad9-f9f3-46b2-aae0-6bed4482dd15 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.161410 Sep 14 10:03:03.261075 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1628/5374] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:03 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:04.283490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:04.284182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:04.291454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:04.291985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:04.292460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:04.293188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:04.293840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:04.294068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:04.514623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:04.523070 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f284779f-0f5e-4bba-9088-490fee7c3b32 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.243418 Sep 14 10:03:04.524679 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3747/5375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:04 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:04.692936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2ce349-2555-45ac-b933-f207451ccf50", "tag": "c343988c-fb73-4f35-91da-1ddbe1cc39cc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:04.704941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:04.705426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:04.705856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:04.718544 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] Creating event network-changed:c343988c-fb73-4f35-91da-1ddbe1cc39cc for instance 1b2ce349-2555-45ac-b933-f207451ccf50 on n-h1-851028-12 Sep 14 10:03:04.723510 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c65d941e-47dd-4a58-b55b-7a5954b2ac46 req-41d283fc-2d09-4138-8352-ee66480cdd22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034204 Sep 14 10:03:04.724342 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1629/5376] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:05.548289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:05.549007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:05.557166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:05.557689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:05.558144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:05.558878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:05.559551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:05.560008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:05.719535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:05.728357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e30efcec-7a0f-48de-a8b6-06d841c042ff tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.183965 Sep 14 10:03:05.728961 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3748/5377] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:05 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:06.753702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:06.754436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:06.762448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:06.762940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:06.763386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:06.764125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:06.764581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:06.765010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:06.908453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:06.916735 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-65d2a3db-e681-42a0-9f74-07cc522d798c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.167251 Sep 14 10:03:06.917316 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1630/5378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:06 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:07.940135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:07.940759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:07.943513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:07.949074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:07.949577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:07.950028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:07.950739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:07.951208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:07.951647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:08.084223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:08.092615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66328f40-8b32-4c83-97df-943a4dd5135d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.156471 Sep 14 10:03:08.093196 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3749/5379] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:07 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:09.117234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:09.117772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:09.124923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:09.125414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:09.125855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:09.126552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:09.127007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:09.127439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:09.261576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:09.265419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:09.272000 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f3bf11cb-4bf0-4f5c-811a-d1e8de0d37c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.159250 Sep 14 10:03:09.272614 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1631/5380] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:09 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:10.297775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:10.298416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:10.306357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:10.306871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:10.307376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:10.308100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:10.308608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:10.309086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:10.463592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:10.473405 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56dbd080-cc40-4566-92f8-d9867a954575 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.179559 Sep 14 10:03:10.474203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3750/5381] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:10 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:11.497721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:11.498366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:11.507649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:11.508279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:11.508724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:11.509431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:11.509888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:11.510320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:11.657636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:11.665546 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b114377-5a3e-45b2-ae8a-07bf66929db0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.172446 Sep 14 10:03:11.666159 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1632/5382] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:11 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:12.700044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:12.700764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:12.708307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:12.708803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:12.709293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:12.710090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:12.710556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:12.711789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:12.848958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:12.857091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7fbf61b-255c-4a14-a809-43a733d71296 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.161885 Sep 14 10:03:12.857665 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3751/5383] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:12 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:13.880711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:13.881352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:13.888618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:13.889119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:13.889558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:13.890262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:13.890747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:13.891179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:14.032512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:14.041015 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a2e5b1b5-0e57-46c6-a2ce-27ec14076d2b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.164150 Sep 14 10:03:14.041608 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1633/5384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:13 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:15.065052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:15.065598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:15.073322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:15.073853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:15.074309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:15.075030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:15.075507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:15.075989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:15.214964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:15.223169 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-071c460e-1d02-444f-a127-005264fd89f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.162005 Sep 14 10:03:15.223764 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3752/5385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:15 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:16.247839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:16.248480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:16.251117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=54 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:16.256397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:16.256879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:16.257334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:16.258014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:16.258651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:16.259075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:16.395071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:16.403030 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-96379aa6-a255-40bf-af01-d3113b320fc0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.159305 Sep 14 10:03:16.403608 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1634/5386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:16 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:17.426892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:17.427472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:17.435023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:17.435519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:17.435997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:17.436703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:17.437165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:17.437602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:17.882200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:17.890668 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c56d088-3842-46f7-bdcb-a27ecb9a160d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.467770 Sep 14 10:03:17.891253 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3753/5387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:17 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:18.915168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:18.915786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:18.922725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:18.923215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:18.923661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:18.924400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:18.924860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:18.925290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:19.060827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:19.069634 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3bc3a309-0d8a-427c-a381-9ed6d1b8e8eb tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.159153 Sep 14 10:03:19.070259 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1635/5388] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:18 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:20.094509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:20.095165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:20.102604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:20.103159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:20.103608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:20.104350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:20.104816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:20.105258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:20.238774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:20.247493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca5deb09-b979-461e-a972-c98f802a2976 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.157042 Sep 14 10:03:20.248095 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3754/5389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:20 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:21.270661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:21.271280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:21.278570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:21.279111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:21.279572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:21.280311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:21.280777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:21.281209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:21.410626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:21.419155 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4defe98c-ec79-4681-8850-8a5ebcfeedb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.152480 Sep 14 10:03:21.419732 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1636/5390] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:21 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:22.442126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:22.442784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:22.450725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:22.451215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:22.451619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:22.452362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:22.452865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:22.453305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:22.587218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:22.595157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3c2a9adf-549d-4068-8b07-a78e8576e72d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.157371 Sep 14 10:03:22.595753 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3755/5391] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:22 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:23.618915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:23.620064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:23.626878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:23.627368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:23.627812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:23.628530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:23.629063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:23.629496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:23.768241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:23.777080 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-557cff0e-5223-496d-91bb-afb458858c2e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.162716 Sep 14 10:03:23.777662 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1637/5392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:23 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:24.807094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:24.807759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:24.814738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:24.815313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:24.815763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:24.816542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:24.817013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:24.817454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:24.820306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:25.049009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:25.058739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27ef84c4-fc5f-408f-ac95-15ac86be2f4e tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.256345 Sep 14 10:03:25.059539 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3756/5393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:24 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:26.084360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:26.085163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:26.095043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:26.095625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:26.096119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:26.096851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:26.097493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:26.097942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:26.247770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:26.255651 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ced2f6e-6749-4ac8-9ecf-b275873161e9 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.176134 Sep 14 10:03:26.256270 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1638/5394] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:26 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:27.282693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:27.283331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:27.291409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:27.291948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:27.292405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:27.293122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:27.293597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:27.294043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:27.425792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:27.433571 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca2bf10f-ddea-48e0-a49c-8b2e1359a156 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.154871 Sep 14 10:03:27.434156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3757/5395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:27 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:28.456829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:28.457441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:28.464903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:28.465390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:28.465828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:28.466522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:28.466976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:28.467402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:28.599774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:28.608488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af657968-a9c4-428c-8694-402a34460a73 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.155535 Sep 14 10:03:28.609068 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1639/5396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:28 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:29.633087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:29.633737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:29.640859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:29.641356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:29.641803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:29.642508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:29.642974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:29.643411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:29.776092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:29.784157 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bc4be5e-35a3-49e1-b1df-56242c14bd18 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.155186 Sep 14 10:03:29.784746 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3758/5397] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:29 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:30.808586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:30.809205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:30.816236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:30.816729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:30.817175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:30.817869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:30.818328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:30.818758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:30.952098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:30.959845 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b6cd348-a4e8-4834-9c2b-13bde37eb72c tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.155857 Sep 14 10:03:30.960995 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1640/5398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:30 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:31.984841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:31.985472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:31.992423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:31.992931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:31.993383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:31.994364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:31.994833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:31.995276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:32.138719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:32.147186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-226cdfc0-a6b1-46b1-897e-ed501c46ff52 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.166183 Sep 14 10:03:32.148476 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3759/5399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:31 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:33.173728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:33.174441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:33.183702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:33.184654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:33.185393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:33.186723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:33.187476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:33.188223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:33.497972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:33.505827 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4cb5ea3b-6b1d-4f9b-864d-3f5b19af46d6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.336533 Sep 14 10:03:33.506715 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1641/5400] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:33 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:34.529532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:34.530171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:34.537541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.538629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.539085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.539799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.540374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.540748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.672091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:34.680638 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fafc848-cb33-44ca-972d-fd709baf0d51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1486 microversion: 2.1 time: 0.155050 Sep 14 10:03:34.681216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3760/5401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:34 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1486 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:34.703484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:34.704053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:34.711460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.711963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.712403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.713128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.713581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.714003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.780668 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d81ae9d4-2baf-4644-bb4f-c0abb8cb2c51 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "POST /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f/action" status: 202 len: 0 microversion: 2.1 time: 0.080826 Sep 14 10:03:34.784229 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1642/5402] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:03:34 2022] POST /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:03:34.791836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:34.792609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:34.799073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.799683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.800216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.800943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:34.802178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:34.803697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:34.948223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:34.956554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5bf7c305-6802-4142-80fc-77a142fa235d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1494 microversion: 2.1 time: 0.170186 Sep 14 10:03:34.957142 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3761/5403] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:34 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1494 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:35.982645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:35.983369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:35.989525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:35.990002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:35.990432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:35.991114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:35.992498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:35.992923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:36.128579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:36.137064 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5faaddbc-0d3b-481a-8020-ce87536b8098 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1494 microversion: 2.1 time: 0.159536 Sep 14 10:03:36.137647 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1643/5404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:35 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1494 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:37.161376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:37.162011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:37.170348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.170857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.171314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.172392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.172877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.173323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.315451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:37.324291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-114ab169-a36f-4767-8cb5-d43edfb1f1f2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1500 microversion: 2.1 time: 0.166835 Sep 14 10:03:37.324856 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3762/5405] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:37 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:37.353691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:37.354243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:37.361203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.361692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.362135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.362840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.363299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.363727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.390194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:03:37.470156 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a490569-267e-497a-8357-d769cc4281f1 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "DELETE /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 204 len: 0 microversion: 2.1 time: 0.120925 Sep 14 10:03:37.470773 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1644/5406] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:03:37 2022] DELETE /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:03:37.479953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:37.480672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:37.487074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.487573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.488051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.488758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:37.489223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:37.489652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:37.625796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:37.633678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8874859-cf86-4f0e-aec4-26bc8196e714 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.158200 Sep 14 10:03:37.634262 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3763/5407] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:37 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:03:38.657189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:38.657888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:38.665315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:38.665786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:38.666217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:38.666901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:38.667350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:38.667769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:38.797859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:38.801502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:38.807401 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c7520b28-1838-4a98-8634-351bff97704d tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.154382 Sep 14 10:03:38.808221 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1645/5408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:38 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:39.832210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:39.832835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:39.836236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=30 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:39.841706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:39.842204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:39.842656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:39.843360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:39.843820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:39.844280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:39.981257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:39.989179 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2dfeb575-6565-4fa3-abf3-cffc7cfee186 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1506 microversion: 2.1 time: 0.160922 Sep 14 10:03:39.989759 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3764/5409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:39 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:40.826589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f", "name": "network-vif-deleted", "tag": "689ede0b-d446-433c-adc6-5801e55eb4ca"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:40.841891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:40.842679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:40.842868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:40.858711 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] Creating event network-vif-deleted:689ede0b-d446-433c-adc6-5801e55eb4ca for instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f on n-h2-851028-12 Sep 14 10:03:40.865447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-744703a7-4987-4e5a-8f1f-ae517a813e34 req-3e878ad7-1ad4-453b-9b39-f2f5c71da5d1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047477 Sep 14 10:03:40.866176 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1646/5410] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:41.012961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:41.013594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:41.020483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:41.020988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:41.021440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:41.022852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:41.023575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:41.024153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:41.056943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:41.057448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:41.057901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:41.058362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lazy-loading 'fault' on Instance uuid fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:03:41.100590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:41.108645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66bfb275-c480-44ef-b212-263535fcfae2 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 200 len: 1303 microversion: 2.1 time: 0.100149 Sep 14 10:03:41.109227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3765/5411] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:41 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:42.133748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:42.134488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:42.141524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.142015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.142458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.143156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.143617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.144080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.161771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] HTTP exception thrown: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Request method failure captured: Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f HTTP/1.1 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaadYJx4dYCdbaQwr8YFGPvfRa3v37DLzIO4KKH1VXccEcPxHoPrMtAWyWbpjx8YKUSuekdmOjZYZ6Z9RYYxCMh4yTTzQD1CXlLdQHK--B89zc_hJnoG3aK8HqN4oclte5Or6BwDIunYyEdAoIh9W5XuOTf6BME5lz50hsmRHX0Wrdo Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 002762e1092647c0a88392502c214375 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_002762e1092647c0a88392502c214375", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/002762e1092647c0a88392502c214375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/002762e1092647c0a88392502c214375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/002762e1092647c0a88392502c214375"}]}] Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 002762e1092647c0a88392502c214375 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerRescueTestJSON-136263128-project Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ef04e48fcac04da999a39a08c2c48d68 Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerRescueTestJSON-136263128-project Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f'} Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:42.163952 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Returning 404 to user: Instance fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3430c58a-9763-406c-a95c-e02dd18df426 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f" status: 404 len: 111 microversion: 2.1 time: 0.036831 Sep 14 10:03:42.168916 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1647/5412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:42 2022] GET /compute/v2.1/servers/fa4f7e92-cb99-4a04-8b84-1103a4e3ff8f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:03:42.174919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:42.175440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:42.183238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.183753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.184286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.185006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.185480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.185928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.215693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:03:42.299637 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b934abe4-fca5-4e02-881b-9bc3633d60b6 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "DELETE /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 204 len: 0 microversion: 2.1 time: 0.128426 Sep 14 10:03:42.300268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3766/5413] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:03:42 2022] DELETE /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:03:42.309432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:42.310049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:42.316134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.316654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.317103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.317932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:42.318270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:42.318766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:42.448485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:42.456260 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c8b308e-f4ea-4412-87c6-7dfd8ab0feb0 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1492 microversion: 2.1 time: 0.150891 Sep 14 10:03:42.456844 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1648/5414] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:42 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1492 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:43.480207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:43.480835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:43.487502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.488063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.488514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.489212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:43.489678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:43.490144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:43.628215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:43.636940 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a375036d-d026-46e8-b4d4-48f3574f96c3 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1492 microversion: 2.1 time: 0.161260 Sep 14 10:03:43.637515 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3767/5415] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:43 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1492 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:44.659987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:44.660571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:44.668183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:44.668684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:44.669118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:44.669816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:44.670269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:44.670692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:44.871577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71", "name": "network-vif-deleted", "tag": "af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:44.889237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:44.889747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:44.890634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:44.898509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef04e48fcac04da999a39a08c2c48d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002762e1092647c0a88392502c214375', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:44.908385 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-35d83498-fb0b-4575-ab77-6fa5ec9fee66 tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 200 len: 1492 microversion: 2.1 time: 0.252214 Sep 14 10:03:44.909507 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] Creating event network-vif-deleted:af6bb7a4-5f2a-41ff-a3b1-e34d79e2773f for instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 on n-h2-851028-12 Sep 14 10:03:44.916804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0360f9f2-ad40-4a68-a63d-8985720cef79 req-d3034126-50e9-4a95-a3fc-3e3e756d20df service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051176 Sep 14 10:03:44.917543 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3768/5416] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:44.920509 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1649/5417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:44 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 1492 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:45.937826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:45.938552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] [instance: bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:45.946428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:45.946931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:45.947385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:45.948138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:45.948610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:45.949055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:45.962657 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] HTTP exception thrown: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Request method failure captured: Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 HTTP/1.1 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaadYJx4dYCdbaQwr8YFGPvfRa3v37DLzIO4KKH1VXccEcPxHoPrMtAWyWbpjx8YKUSuekdmOjZYZ6Z9RYYxCMh4yTTzQD1CXlLdQHK--B89zc_hJnoG3aK8HqN4oclte5Or6BwDIunYyEdAoIh9W5XuOTf6BME5lz50hsmRHX0Wrdo Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 002762e1092647c0a88392502c214375 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_002762e1092647c0a88392502c214375", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/002762e1092647c0a88392502c214375"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/002762e1092647c0a88392502c214375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/002762e1092647c0a88392502c214375"}]}] Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 002762e1092647c0a88392502c214375 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueTestJSON-136263128 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueTestJSON-136263128-project Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ef04e48fcac04da999a39a08c2c48d68 Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueTestJSON-136263128-project Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71'} Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:03:45.964339 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] Returning 404 to user: Instance bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33d5e686-5d41-44cd-ba02-d29905e1d91b tempest-ServerRescueTestJSON-136263128 tempest-ServerRescueTestJSON-136263128-project] 10.222.0.90 "GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71" status: 404 len: 111 microversion: 2.1 time: 0.032255 Sep 14 10:03:45.969297 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3769/5418] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:45 2022] GET /compute/v2.1/servers/bf1a0c3e-cbe9-4441-9ffa-040f8f4b1c71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:03:54.550378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-356778695", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:54.559129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:54.605304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] validate_networks() for [('45cf8517-86e7-4bb1-97a4-239910e93015', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:03:54.904434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=16 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:55.044150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:03:55.044718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:03:55.045487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:03:55.045916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:03:55.046523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:03:55.059210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:55.059417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:55.059873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:55.060870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:55.061328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:55.061759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:55.082094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Getting quotas for project 300831127f6d42bc8a0e3c9234586a66. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:03:55.090636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Getting quotas for user 823c46df57dd4fb0840252596f9c4bc6 and project 300831127f6d42bc8a0e3c9234586a66. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:03:55.106521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:03:55.109113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:03:55.164796 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1ac1a8c2-f000-4db5-ad86-cbffad25f091 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.742618 Sep 14 10:03:55.165789 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1650/5419] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:03:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:03:55.176830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f84b4ce-53f2-403c-bfc6-93c238b89988 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:55.178081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f84b4ce-53f2-403c-bfc6-93c238b89988 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:55.236476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f84b4ce-53f2-403c-bfc6-93c238b89988 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:55.245148 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f84b4ce-53f2-403c-bfc6-93c238b89988 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1222 microversion: 2.1 time: 0.071980 Sep 14 10:03:55.248480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3770/5420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:55 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1222 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:56.268486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:56.269751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:56.280903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:56.281684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:56.285105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:56.286296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:56.287186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:56.287754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:56.390209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:56.402925 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b90837e-6b7c-4b37-bf73-1dbdd351e2d4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1292 microversion: 2.1 time: 0.137808 Sep 14 10:03:56.404422 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1651/5421] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:56 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1292 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:57.430187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:57.431710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:57.434149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:03:57.445358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:57.445925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:57.446383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:57.447197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:57.447929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:57.448422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:57.609650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:57.619534 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd42a428-6d8c-421d-8a52-96338a9c1aa3 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.194189 Sep 14 10:03:57.632168 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3771/5422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:57 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:58.214042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:03:58.233609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:58.234411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:58.235572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:58.250747 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] Creating event network-changed:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:03:58.257212 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e0783a0d-1873-4c78-8c79-01422c5d2e53 req-7f1a5d3f-f6c0-4140-97a3-f9670c3d51cf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047589 Sep 14 10:03:58.258678 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1652/5423] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:03:58.642598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:58.643263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:58.650468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:58.650970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:58.651415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:58.652152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:58.652619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:58.653050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:58.789269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:03:58.797094 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7701dd89-cd3c-4f11-85d5-eaa7f74adcd8 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.158405 Sep 14 10:03:58.797668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3772/5424] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:58 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:03:59.822281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:03:59.822997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:03:59.829339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:59.829834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:59.830274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:59.830969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:03:59.831426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:03:59.831853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:03:59.996429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:00.005702 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-82d0a04d-943d-443c-a54c-0075def84a9d tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.189304 Sep 14 10:04:00.006431 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1653/5425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:03:59 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:01.029039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:01.029666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:01.037787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:01.038227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:01.038674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:01.039375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:01.039837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:01.040297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:01.174119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:01.182829 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21f9a638-5784-4cbf-ab50-b08fc6bc6d1b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.157599 Sep 14 10:04:01.183422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3773/5426] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:01 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:02.206067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:02.206686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:02.213807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:02.214321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:02.214758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:02.215853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:02.216360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:02.216789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:02.356939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:02.365451 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-89076bca-a49e-45f0-995e-3f3b81e318ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.163187 Sep 14 10:04:02.366039 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1654/5427] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:02 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:03.389891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:03.390541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:03.398283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:03.398783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:03.399230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:03.399962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:03.400428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:03.400866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:03.538772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:03.546703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b895edbf-1e34-4d39-87a5-af18256adee4 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.160729 Sep 14 10:04:03.547298 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3774/5428] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:03 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:04.373404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "name": "network-vif-plugged", "status": "completed", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:04.384192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:04.384684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:04.385164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:04.399557 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] Creating event network-vif-plugged:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:04.404619 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2b82cd8d-2bf8-4632-96a8-e9d0527a7af3 req-6b29033d-3620-4081-83ec-efc4a45d03cb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034985 Sep 14 10:04:04.405245 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1655/5429] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:04:04.570001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:04.570627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:04.577737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:04.578235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:04.578680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:04.579380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:04.579842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:04.580307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:04.714974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:04.723493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4e9e8d6-215d-4452-b044-d592b09b8995 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1322 microversion: 2.1 time: 0.157623 Sep 14 10:04:04.724106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3775/5430] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:04 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:05.744188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:05.744985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:05.749959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:05.750689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:05.758186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:05.758672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:05.759117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:05.759812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:05.760320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:05.760755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:05.895477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:05.903613 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-901022f3-88a8-4b30-8163-6eaa376d4110 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1518 microversion: 2.1 time: 0.160268 Sep 14 10:04:05.904327 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1656/5431] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:05 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:05.928328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:05.930610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:05.932651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:05.939378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:05.939944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:05.940399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:05.941737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:05.942208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:05.942648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:05.966497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lazy-loading 'flavor' on Instance uuid f8a28350-26df-4f76-8780-99a7bfee01bb {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:04:06.039624 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-787ea00c-e05a-46c2-bc92-38430e29130f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action" status: 200 len: 32 microversion: 2.1 time: 0.116286 Sep 14 10:04:06.040281 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3776/5432] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:05 2022] POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action => generated 32 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:04:06.049928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:06.051331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:06.057990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:06.058545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:06.059121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:06.059904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:06.060468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:06.060975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:06.283256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:06.292046 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9a04556e-4151-45c8-8209-2bca6889c638 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.246005 Sep 14 10:04:06.292637 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1657/5433] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:06 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:07.318655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:07.319544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:07.326654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:07.327160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:07.327614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:07.328366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:07.328838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:07.329282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:07.470340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:07.478583 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-051cd738-75ea-4342-98be-04acd0a19414 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.165931 Sep 14 10:04:07.479382 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3777/5434] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:07 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:08.504331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:08.505073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:08.512180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:08.512668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:08.513106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:08.513802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:08.514258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:08.514687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:08.648857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:08.656541 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-99dc9e58-1bde-4784-8cff-9f05ffcbcf91 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.156700 Sep 14 10:04:08.657152 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1658/5435] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:08 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:09.678908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:09.679555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:09.686620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:09.687061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:09.687515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:09.688255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:09.688730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:09.689175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:09.821420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:09.829522 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b5cbf80-a60e-4d7f-a67d-93934cb22007 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.154780 Sep 14 10:04:09.830107 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3778/5436] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:09 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:10.852244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:10.852893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:10.859836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:10.861270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:10.861270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:10.861504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:10.862225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:10.862433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:11.000237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:11.008646 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2e39ce1-46ee-4d22-ace7-8007bf5845fb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.160548 Sep 14 10:04:11.009230 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1659/5437] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:10 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:12.032427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:12.033060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:12.036725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:12.042164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:12.042666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:12.043115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:12.043850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:12.044362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:12.044806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:12.193591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:12.201564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-86466afc-01de-4883-9761-399d44af1fa0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.173168 Sep 14 10:04:12.202146 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3779/5438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:12 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:13.225760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:13.226385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:13.233722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:13.234213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:13.234652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:13.235352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:13.236002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:13.236440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:13.371581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:13.379719 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85c3f6e0-e028-4367-b19a-c27ed5eebae6 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.158500 Sep 14 10:04:13.380342 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1660/5439] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:13 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:14.403610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:14.404228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:14.411007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:14.411506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:14.411978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:14.412681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:14.413144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:14.413581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:14.547111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:14.555603 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd71047c-e8a0-49ee-b835-a0d354a0e350 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.156118 Sep 14 10:04:14.556221 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3780/5440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:14 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:15.582221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:15.582854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:15.589905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:15.590398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:15.590839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:15.591540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:15.592098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:15.592528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:15.725162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:15.733020 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d2462dba-f0ba-4b33-a141-03277a9ef9c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.155452 Sep 14 10:04:15.733603 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1661/5441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:15 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:16.757373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:16.757995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:16.765075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:16.765567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:16.766010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:16.766707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:16.767171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:16.767605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:16.897627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:16.905500 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-def14eb2-774e-4b0e-b504-5d58019ccd7c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.152355 Sep 14 10:04:16.906078 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3781/5442] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:16 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:04:17.929367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:17.929978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:17.936972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:17.937454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:17.937890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:17.938611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:17.939090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:17.939513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:18.075340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:18.083730 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ae976b8-07a9-47c8-aab3-73523caa2a6a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.158280 Sep 14 10:04:18.084532 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1662/5443] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:17 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:19.107733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:19.108403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:19.116162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:19.116656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:19.117102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:19.117798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:19.118260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:19.118694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:19.252971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:19.261315 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-655564db-1204-4f03-9000-86fecf47faff tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.157650 Sep 14 10:04:19.261902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3782/5444] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:19 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:20.284643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:20.285213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:20.293020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:20.293506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:20.293941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:20.294630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:20.295081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:20.295506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:20.434986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:20.442821 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d6e5463d-1d78-4553-8ea4-7b2cb0ef7974 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.162101 Sep 14 10:04:20.443400 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1663/5445] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:20 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:21.466323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:21.466876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:21.474520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:21.475025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:21.475483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:21.476244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:21.476722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:21.477177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:21.544226 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:04:21.544415 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb (ip 10.222.0.90) !!! Sep 14 10:04:21.609205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:21.617702 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4efbb437-ac33-4eee-9393-08f224d49209 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.155404 Sep 14 10:04:21.618290 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3783/5446] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:21 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:22.640840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:22.641444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:22.649046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:22.649594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:22.650042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:22.650739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:22.651195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:22.651624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:22.794834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:22.803515 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-329de6b7-9e24-4ac8-9764-ace8642449ce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.166711 Sep 14 10:04:22.804128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1664/5447] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:22 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:23.826594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:23.827228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:23.834300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:23.834808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:23.835264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:23.836018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:23.836495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:23.836937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:23.966978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:23.975032 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19aeff64-4cc2-48a0-87e5-66dd0141a0ab tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.152507 Sep 14 10:04:23.975611 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3784/5448] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:23 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:25.002207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:25.002813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:25.005616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:25.011122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:25.011604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:25.012071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:25.012763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:25.013214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:25.013640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:25.018453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=79 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:25.147286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:25.155261 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c1af0be1-51d7-46a7-b00f-66bc03ce1def tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.156889 Sep 14 10:04:25.155851 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1665/5449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:24 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:26.179512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:26.180192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:26.187137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:26.187635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:26.188118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:26.188825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:26.189292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:26.189733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:26.213086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:26.334558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:26.342509 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26bb627b-07fa-4ea6-9280-ba861d5622fe tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.167711 Sep 14 10:04:26.343094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3785/5450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:26 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:27.366495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:27.367226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:27.374074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:27.374562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:27.374999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:27.375687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:27.376168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:27.376600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:27.509690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:27.517378 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41f22527-ab1e-48a3-8862-b1245c29271e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.155418 Sep 14 10:04:27.517958 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1666/5451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:27 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:28.542009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:28.542648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:28.549760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:28.550275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:28.550837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:28.551559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:28.552068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:28.552518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:28.687084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:28.695782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3593cafe-7eec-49f7-a2b1-9424e7fec7ee tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.157719 Sep 14 10:04:28.696425 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3786/5452] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:28 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:29.718619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:29.719262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:29.726948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:29.727428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:29.727860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:29.728592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:29.729045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:29.729467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:29.863690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:29.871788 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc0868f2-6f99-415d-8902-0fe224f44c66 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.157112 Sep 14 10:04:29.872403 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1667/5453] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:29 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:30.895265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:30.895909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:30.902961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:30.903470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:30.903948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:30.904672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:30.905143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:30.905586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:31.037131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:31.045054 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ee5d435-3370-4083-b7f4-8351f04db48c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.154262 Sep 14 10:04:31.045638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3787/5454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:30 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:32.068693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:32.069298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:32.076374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:32.076856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:32.077286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:32.077975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:32.078426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:32.078848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:32.217815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:32.226667 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a9f81645-74ad-4ea6-bb66-4979cd1cfeb2 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.162156 Sep 14 10:04:32.227252 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1668/5455] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:32 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:33.250659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:33.252017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:33.259744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:33.260289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:33.260744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:33.261454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:33.261922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:33.262362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:33.396015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:33.403745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-caeb3237-088f-4b03-bb6a-f7ecd6a22a1e tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1524 microversion: 2.1 time: 0.157005 Sep 14 10:04:33.404353 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3788/5456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:33 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:34.428812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:34.429422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:34.436356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:34.436837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:34.437271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:34.437957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:34.438413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:34.438837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:34.574606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:34.583273 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-806f9e79-8c2d-449e-aa04-04fa856e12c0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1504 microversion: 2.1 time: 0.159812 Sep 14 10:04:34.583855 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1669/5457] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:34 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:34.606546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9dbdff4-5bd4-4144-84dd-a51b4a9587a0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'create', calling method: .version_select at 0x7f693c442160>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1044149385", "description": "tempest-description-898788880"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:34.752195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9dbdff4-5bd4-4144-84dd-a51b4a9587a0 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.149401 Sep 14 10:04:34.755123 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3789/5458] 10.222.0.90 () {60 vars in 1180 bytes} [Wed Sep 14 10:04:34 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:04:34.769101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1044149385"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:34.769715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:34.776177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:34.776672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:34.777183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:34.777800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:34.778260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:34.778687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:34.914976 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Adding security group e2613498-9536-4dfe-bef6-0a33ea09ab8c to port 8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 Sep 14 10:04:35.239073 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-74c7f9f3-169a-4b95-a1cc-05367615f321 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action" status: 202 len: 0 microversion: 2.1 time: 0.474386 Sep 14 10:04:35.239685 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1670/5459] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:34 2022] POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:04:35.248648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1044149385"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:35.249647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:35.256136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:35.258355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:35.259041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:35.259914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:35.260938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:35.262000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:35.263424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:35.266955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:35.267613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:35.268971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:35.286012 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] Creating event network-changed:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:35.292734 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7652a143-f919-48d1-9527-666491875e58 req-d8c263d0-4300-42c5-adaa-d3574841448d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042379 Sep 14 10:04:35.293624 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1671/5460] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:04:35.432876 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.network.security_group_api [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Removing security group e2613498-9536-4dfe-bef6-0a33ea09ab8c from port 8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 Sep 14 10:04:35.777869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb878949-a804-4007-80dc-ae27b779471c tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action" status: 202 len: 0 microversion: 2.1 time: 0.533644 Sep 14 10:04:35.786548 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3790/5461] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:35 2022] POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:04:35.791428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:35.793084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb2ad77c-c4a0-4edd-a2af-6c650a49c5b5 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'create', calling method: .version_select at 0x7f693e1d91f0>, body: {"pool": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:35.811163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:35.811678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:35.812797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:35.825626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] Creating event network-changed:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:35.831467 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0fc08350-3edd-4efe-b047-d0f1a81f3a12 req-bb54e8ac-bff8-4874-8e0e-c9e26d248c0e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044172 Sep 14 10:04:35.832754 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1672/5462] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:04:37.235197 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb2ad77c-c4a0-4edd-a2af-6c650a49c5b5 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.447159 Sep 14 10:04:37.236005 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3791/5463] 10.222.0.90 () {60 vars in 1170 bytes} [Wed Sep 14 10:04:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:04:37.250883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.210"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:37.253598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:37.260081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:37.260572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:37.261015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:37.261722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:37.262179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:37.262607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:37.289542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 10:04:37.289947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquired lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 10:04:38.858121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Building network info cache for instance {{(pid=122443) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 10:04:38.867692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:38.879360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:38.880451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:38.881117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:38.895140 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] Creating event network-changed:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:38.907513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-af2a94d2-2b94-4afe-bf96-828428c19917 req-b25e961f-2c7a-4daa-83f5-39ef8bbac896 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045405 Sep 14 10:04:38.909190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3792/5464] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:04:39.844973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Updating instance_info_cache with network_info: [{"id": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3", "address": "fa:16:3e:95:4b:ff", "network": {"id": "45cf8517-86e7-4bb1-97a4-239910e93015", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1707922789-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "300831127f6d42bc8a0e3c9234586a66", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8e8cf4f2-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122443) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 10:04:39.853906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Releasing lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122443) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 10:04:39.854822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-29949e14-d124-4c58-9b58-3f8486c2ef8f tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action" status: 202 len: 0 microversion: 2.1 time: 2.609237 Sep 14 10:04:39.855950 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1673/5465] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:37 2022] POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action => generated 0 bytes in 2611 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 14 10:04:39.866459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.210"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:40.020646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:40.028144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:40.028835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:40.029343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:40.030071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:40.030546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:40.030993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:40.247715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 14 10:04:40.248265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquired lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 14 10:04:40.959430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Building network info cache for instance {{(pid=122444) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 14 10:04:40.982352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:40.997230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:40.997974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:40.998600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:41.012806 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] Creating event network-changed:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:41.022025 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-385c2e20-e789-4e97-8564-50512e63ab13 req-5cbf9089-bcc2-4d6b-ad32-8093e93d4add service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Sep 14 10:04:41.022815 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1674/5466] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:04:41.569628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Updating instance_info_cache with network_info: [{"id": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3", "address": "fa:16:3e:95:4b:ff", "network": {"id": "45cf8517-86e7-4bb1-97a4-239910e93015", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1707922789-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "300831127f6d42bc8a0e3c9234586a66", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8e8cf4f2-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122444) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 14 10:04:41.588220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Releasing lock "refresh_cache-f8a28350-26df-4f76-8780-99a7bfee01bb" {{(pid=122444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 14 10:04:41.589493 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2b58e1f6-9e78-40c1-a2ef-33bbcd5104fa tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action" status: 202 len: 0 microversion: 2.1 time: 1.729418 Sep 14 10:04:41.594001 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3793/5467] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:04:39 2022] POST /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb/action => generated 0 bytes in 1735 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 14 10:04:41.599429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c5f6ab1d-5b03-478d-9df6-993add4c33c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '.version_select at 0x7f693f3fd9d0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:42.638812 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c5f6ab1d-5b03-478d-9df6-993add4c33c1 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "DELETE /compute/v2.1/os-floating-ips/a46bedc5-0f69-4929-a34b-bfbfb6744cb2" status: 202 len: 0 microversion: 2.1 time: 1.043000 Sep 14 10:04:42.639724 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1675/5468] 10.222.0.90 () {58 vars in 1263 bytes} [Wed Sep 14 10:04:41 2022] DELETE /compute/v2.1/os-floating-ips/a46bedc5-0f69-4929-a34b-bfbfb6744cb2 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:04:42.650883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24f9775d-15ad-430e-b304-82e4061838cb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '.version_select at 0x7f693c467af0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:42.886412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24f9775d-15ad-430e-b304-82e4061838cb tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "DELETE /compute/v2.1/os-security-groups/e2613498-9536-4dfe-bef6-0a33ea09ab8c" status: 202 len: 0 microversion: 2.1 time: 0.239430 Sep 14 10:04:42.888567 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3794/5469] 10.222.0.90 () {58 vars in 1272 bytes} [Wed Sep 14 10:04:42 2022] DELETE /compute/v2.1/os-security-groups/e2613498-9536-4dfe-bef6-0a33ea09ab8c => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:04:42.899125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:42.900568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:42.909853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:42.910780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:42.911105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:42.912243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:42.913095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:42.914237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:42.950434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:04:43.069718 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-72e3e597-b59e-4e97-a285-765943398cce tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "DELETE /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 204 len: 0 microversion: 2.1 time: 0.175806 Sep 14 10:04:43.070792 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1676/5470] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:04:42 2022] DELETE /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:04:43.081198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:43.081838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:43.084108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=26 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:43.095953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:43.095953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:43.096634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:43.097157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:43.097659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:43.098177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:43.300210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:43.308361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c4c7b8f-1f30-4577-8567-d701c046a9ea tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1510 microversion: 2.1 time: 0.232657 Sep 14 10:04:43.308957 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3795/5471] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:43 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:44.338831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:44.340056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:44.354247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:44.355539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:44.356430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:44.357694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:44.358388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:44.359135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:44.576104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:44.585813 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d3d033c-dc2d-4b9d-a3c3-722025adc13b tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1510 microversion: 2.1 time: 0.253843 Sep 14 10:04:44.586620 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1677/5472] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:44 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:45.611558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:45.613273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:45.621090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:45.621910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:45.622626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:45.623496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:45.624215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:45.624884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:45.839791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '823c46df57dd4fb0840252596f9c4bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300831127f6d42bc8a0e3c9234586a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:45.844941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a28350-26df-4f76-8780-99a7bfee01bb", "name": "network-vif-deleted", "tag": "8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:45.860134 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31c10fd7-632e-4737-a783-26b2c7b3a998 tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 200 len: 1510 microversion: 2.1 time: 0.252138 Sep 14 10:04:45.861664 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3796/5473] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:45 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:45.867192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:45.868145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:45.869876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:45.890414 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] Creating event network-vif-deleted:8e8cf4f2-4ba2-4a59-b6f7-b726fc2f9cb3 for instance f8a28350-26df-4f76-8780-99a7bfee01bb on n-h2-851028-12 Sep 14 10:04:45.898752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-fccf0a8e-ba45-4e4c-8fc9-6fdba1aa5332 req-75f9a36a-8723-44b3-8724-c4503af0c0a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057276 Sep 14 10:04:45.899654 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1678/5474] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:04:46.885329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:46.885956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] [instance: f8a28350-26df-4f76-8780-99a7bfee01bb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:46.893861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:46.894365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:46.894812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:46.895521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:46.896017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:46.896460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:46.911279 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] HTTP exception thrown: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Request method failure captured: Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb HTTP/1.1 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIacKw_Wa_Tuk4Xoi4_WEj3cYbSzkv71ZIuvgF3QkwIW8-RF7If63-jOXn_IIeLljDnO4nKOOHPIh3D6QqQDtsWT__q8yc12QBTyT1wpD_ePvIB-hmTZIi-5qJzMfjRFOc9e8RekGNIrfGKGLkFwZqWrvaYtojAmxwOV9tPDhMXEO1xY Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 300831127f6d42bc8a0e3c9234586a66 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1687664437 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_300831127f6d42bc8a0e3c9234586a66", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/300831127f6d42bc8a0e3c9234586a66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/300831127f6d42bc8a0e3c9234586a66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/300831127f6d42bc8a0e3c9234586a66"}]}] Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1687664437 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 300831127f6d42bc8a0e3c9234586a66 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1687664437 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerRescueTestJSONUnderV235-1687664437-project Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 823c46df57dd4fb0840252596f9c4bc6 Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1687664437-project Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'f8a28350-26df-4f76-8780-99a7bfee01bb'} Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:04:46.913138 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] Returning 404 to user: Instance f8a28350-26df-4f76-8780-99a7bfee01bb could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-02f0aa38-55a4-4b67-9684-c5f5b62e440a tempest-ServerRescueTestJSONUnderV235-1687664437 tempest-ServerRescueTestJSONUnderV235-1687664437-project] 10.222.0.90 "GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb" status: 404 len: 111 microversion: 2.1 time: 0.033220 Sep 14 10:04:46.921502 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3797/5475] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:46 2022] GET /compute/v2.1/servers/f8a28350-26df-4f76-8780-99a7bfee01bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:04:48.782275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1571352028", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-229185920", "security_groups": [{"name": "tempest-secgroup-smoke-1069660230"}], "block_device_mapping_v2": [{"uuid": "02154755-17f8-48b4-a7ef-b5718096ff06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "778e048d-efec-4c34-9c58-adcec85d9f89"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:48.946806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] validate_networks() for [('778e048d-efec-4c34-9c58-adcec85d9f89', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:04:49.589140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:04:49.589614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:04:49.590365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:04:49.590782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:04:49.591535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:04:49.602717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:49.603314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:49.603762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:49.604929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:49.605063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:49.605382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:49.633329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:04:49.639142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Getting quotas for user 10b27920d66c46b08759ef197dabb0cd and project 2ed45e38a5194b1ab295ef8b087bccc3. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:04:49.703282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:04:49.706544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02154755-17f8-48b4-a7ef-b5718096ff06',volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:04:49.850700 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5aa97278-9b59-4236-b95c-93d0493269ce tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.073600 Sep 14 10:04:49.851407 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1679/5476] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:04:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:04:49.864465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ccb60a4c-0aca-49c2-bea3-397119ba39ba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:49.865111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ccb60a4c-0aca-49c2-bea3-397119ba39ba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:49.940106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ccb60a4c-0aca-49c2-bea3-397119ba39ba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:49.947802 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ccb60a4c-0aca-49c2-bea3-397119ba39ba tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1094 microversion: 2.1 time: 0.089048 Sep 14 10:04:49.948612 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3798/5477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:49 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:50.976050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:50.976746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:50.983327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:50.983813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:50.985275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:50.986594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:50.987229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:50.988134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:51.067205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:51.077276 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-487ad411-c8c3-41e0-ab46-a080330b5572 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1192 microversion: 2.1 time: 0.105853 Sep 14 10:04:51.077930 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1680/5478] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:50 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:52.101909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:52.103247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:52.111685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:52.113040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:52.113708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:52.114660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:52.115299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:52.115977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:52.197127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:52.208630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3aff10d3-2917-4e05-8f20-f98dea4fd801 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1210 microversion: 2.1 time: 0.110441 Sep 14 10:04:52.228960 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3799/5479] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:52 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:53.232578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:53.233465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:53.252449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:53.252957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:53.253394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:53.254110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:53.254565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:53.254998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:53.306471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a35765-966c-4c6b-a4ca-6734e2724355", "tag": "9ba86180-5907-4c8e-9d1a-6c16180acaec"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:53.324775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:53.334436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:53.334895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:53.380681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] Creating event network-changed:9ba86180-5907-4c8e-9d1a-6c16180acaec for instance d9a35765-966c-4c6b-a4ca-6734e2724355 on n-h2-851028-12 Sep 14 10:04:53.386623 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5c7c0a93-d41f-499b-9007-b6c7c81d26c4 req-4ec8e2d5-d5ac-4f27-8e7a-9cef39acc717 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083847 Sep 14 10:04:53.387601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3800/5480] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:04:53.651539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:53.664784 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f417e84b-52b9-42c2-8530-6f662cabcfa2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1278 microversion: 2.1 time: 0.436198 Sep 14 10:04:53.680986 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1681/5481] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:53 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1278 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:54.696709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:54.697515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:54.710036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:54.710867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:54.711712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:54.712706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:54.714842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:54.715652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:54.914969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:54.930194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31541421-30d5-47d5-b3ac-3e68c6ff7050 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1278 microversion: 2.1 time: 0.237797 Sep 14 10:04:54.931317 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3801/5482] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:54 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:55.956102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:55.957446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:55.974826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:55.977122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:55.977867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:55.980652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:55.981731 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:55.982412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:55.991018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:55.996535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:56.279232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:56.296334 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d0dbad2-b044-4120-b2c3-a52598e4e824 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1278 microversion: 2.1 time: 0.345027 Sep 14 10:04:56.297632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1682/5483] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:55 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:57.145934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1491149287", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "75a33a1b-5296-45a5-beef-c83ae2042d18"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:04:57.209850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] validate_networks() for [('75a33a1b-5296-45a5-beef-c83ae2042d18', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:04:57.323526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:57.325944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:57.356612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:57.357642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:57.358306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:57.359109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:57.359593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:57.360861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:57.545352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:57.555408 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dc0db42e-5715-4067-9b89-fc90c17a8347 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1278 microversion: 2.1 time: 0.239323 Sep 14 10:04:57.556808 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1683/5484] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:57 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:57.683122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:04:57.683561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:04:57.684079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:04:57.684502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:04:57.684926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:04:57.695097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:57.696323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:57.697086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:57.697932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:57.698357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:57.698833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:57.705642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=63,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:04:57.722149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Getting quotas for project 0f7e6f22326c49218f2f168d9df346da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:04:57.728339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Getting quotas for user d41093313e8341cdb405a037d1fa7497 and project 0f7e6f22326c49218f2f168d9df346da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:04:57.743377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:04:57.746299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:04:57.796348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f8ad35b0-7b0d-4cd4-80d6-06235d2a5949 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.837841 Sep 14 10:04:57.797664 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3802/5485] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 10:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 10:04:57.809518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:57.810195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:57.879977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:57.891853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:57.893325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:57.894944 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-615075ee-9768-4c01-8c96-0272dfecbd3e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1262 microversion: 2.26 time: 0.089666 Sep 14 10:04:57.895526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1684/5486] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:04:57 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:04:58.581348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:58.582735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:58.593354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.594079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.594508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:58.595494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.595990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.596438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:58.774483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:58.784316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-148dac3e-7906-44e8-a53e-368dbc222ca7 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.208042 Sep 14 10:04:58.784867 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3803/5487] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:58 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:04:58.920739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:58.921375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:58.929835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.930340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.930781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:58.931505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:58.932013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:58.932448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:59.003233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:59.012214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:59.013728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:04:59.014918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ecebae57-dbaa-4a05-9099-03ac0e0ec7d2 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1314 microversion: 2.26 time: 0.098117 Sep 14 10:04:59.015489 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1685/5488] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:04:58 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1314 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:04:59.809500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:04:59.810201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:04:59.819824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:59.820659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:59.821220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:04:59.821931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:04:59.822604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:04:59.823141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:00.043452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:00.044208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:00.046225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:00.054045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:00.054539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:00.054972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:00.055773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:00.056253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:00.056713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:00.071043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:00.083379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7577468c-7d2f-4692-9fde-414e8dd1b7e6 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.277858 Sep 14 10:05:00.102572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3804/5489] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:04:59 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:00.201405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:00.213511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:00.215342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:00.216865 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-30aafff1-353e-48d4-9e70-9d27c54f2668 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1320 microversion: 2.26 time: 0.178704 Sep 14 10:05:00.217842 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1686/5490] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:00 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:01.111552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:01.113140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:01.120946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.121457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.122162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.122921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.123370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.123827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.248962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:01.249679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:01.259335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.259932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.260362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.261542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.262287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.262905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.363710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:01.372678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a7d6545-4f80-4d2b-94c8-c91072770982 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.265930 Sep 14 10:05:01.373313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3805/5491] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:01 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:01.431878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:01.446667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad", "tag": "8c2c656a-10b4-4328-93ad-a7f29382c652"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:01.466560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:01.467117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:01.467636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:01.470833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:01.473231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:01.474528 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2e1ff04-2b1c-4572-8fc7-f37a9247ec63 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.231661 Sep 14 10:05:01.484473 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1687/5492] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:01 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:01.502291 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] Creating event network-changed:8c2c656a-10b4-4328-93ad-a7f29382c652 for instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad on n-h1-851028-12 Sep 14 10:05:01.508295 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-eed79684-58f1-4223-a475-c7ab32ecbf3a req-f1aabe19-13e7-4759-80bf-693f67dda21b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086151 Sep 14 10:05:01.509198 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3806/5493] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:02.398758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:02.399610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:02.408986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.409473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.410133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.410833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.411279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.411706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.506372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:02.507246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:02.514326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.514829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.515289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.516206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:02.517340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:02.517766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:02.562374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:02.571737 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f823b65b-0db9-4c53-ac0b-c2851261f874 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.178182 Sep 14 10:05:02.572568 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1688/5494] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:02 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:02.656939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:02.665187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:02.666672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:02.667844 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c34899c-f6e1-4f62-9009-f784f1b54eab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.167664 Sep 14 10:05:02.668441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3807/5495] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:02 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:03.596744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:03.597361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:03.604227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:03.604712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:03.605149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:03.605842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:03.606299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:03.606724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:03.693877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:03.694518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:03.701241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:03.701743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:03.702404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:03.703123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:03.703596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:03.704775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:03.749774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:03.758056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-93a1ee2d-264f-4aa7-873b-b68a396a5bb5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.165787 Sep 14 10:05:03.758647 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1689/5496] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:03 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:03.838802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:03.847743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:03.849270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:03.850415 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9b93d77-2b54-4a7c-b22a-e1a8e4bc2b3f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.160529 Sep 14 10:05:03.850981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3808/5497] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:03 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:04.782497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:04.783201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:04.789828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.790249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.790690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.791496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.791867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.792290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.876832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:04.877650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:04.890580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.891180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.893901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.894970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:04.895637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:04.896316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:04.940711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:04.952050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-05d23924-7abb-45b3-8625-4ee872bf8fdc tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.173661 Sep 14 10:05:04.953672 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1690/5498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:04 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:05.065219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:05.073494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:05.074970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:05.076160 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-446fd346-5513-4acd-8cd2-64912587f143 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.204155 Sep 14 10:05:05.076747 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3809/5499] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:04 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:05.975824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:05.976476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:05.983285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:05.983772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:05.984248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:05.986352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:05.987072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:05.987504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.103699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:06.104363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:06.112498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.113002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.113454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.114205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.114707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.115154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.127049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:06.139847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-20a47507-e07a-4bd9-8662-7e4bbe7bc890 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.167730 Sep 14 10:05:06.149922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1691/5500] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:05 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:06.256698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:06.265078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:06.266977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:06.268181 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15d8bdf4-c024-4cc9-b0dc-9656c4796c4e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.168545 Sep 14 10:05:06.268757 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3810/5501] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:06 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:06.764346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad", "name": "network-vif-plugged", "status": "completed", "tag": "8c2c656a-10b4-4328-93ad-a7f29382c652"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:06.775224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:06.780715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:06.781127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:06.795338 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] Creating event network-vif-plugged:8c2c656a-10b4-4328-93ad-a7f29382c652 for instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad on n-h1-851028-12 Sep 14 10:05:06.800683 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-de6fe699-33a4-42d5-ae85-fd6f5e27f9b5 req-6ff050cf-1e5a-40c9-9b6c-10a04f2100f2 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040508 Sep 14 10:05:06.801711 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1692/5502] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:07.163713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:07.164334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:07.171323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.171820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.172967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.173676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.174138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.174575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.295466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:07.296199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:07.303346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.303858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.304325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.305027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:07.305480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:07.305910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:07.316405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:07.324701 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-388192bb-0bdd-40a9-af77-b45b8554510f tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.164923 Sep 14 10:05:07.325497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3811/5503] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:07 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:07.442263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:07.450437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:07.453595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:07.454903 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f4d1aaec-54d6-41d5-8f6d-874ea4f5eb0c tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1362 microversion: 2.26 time: 0.164645 Sep 14 10:05:07.455479 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1693/5504] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:07 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:08.348444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.366570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.483566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.484245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.487291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:08.493927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.494418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.494863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.495585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.496074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.496502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.503819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:08.512302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-63dd19d3-aa1d-49bb-a445-ab183b98a27e tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.167998 Sep 14 10:05:08.512899 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3812/5505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:08 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:08.631080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:08.639206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:08.640707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:08.642562 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf6b428d-ff03-42f0-bb4f-fd6394dbf10f tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1546 microversion: 2.26 time: 0.162349 Sep 14 10:05:08.643405 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1694/5506] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:08 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:08.668157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693dcd3c10>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.677821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.678315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.678769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.679250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.684492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.684980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.685428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.686112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.686576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.687012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.714027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.714523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.714976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.728319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.728809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.729256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.755864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:08.773710 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e75faf03-99f9-404c-8ef7-3d7ad04d75ae tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1064380375" status: 201 len: 0 microversion: 2.26 time: 0.109549 Sep 14 10:05:08.774366 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3813/5507] 10.222.0.90 () {62 vars in 1380 bytes} [Wed Sep 14 10:05:08 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1064380375 => generated 0 bytes in 111 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 10:05:08.784081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dbbba2d5-7a12-44a6-8b99-2068e121e2df tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f2fa160>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.791562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbbba2d5-7a12-44a6-8b99-2068e121e2df tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.792079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbbba2d5-7a12-44a6-8b99-2068e121e2df tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.792521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dbbba2d5-7a12-44a6-8b99-2068e121e2df tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.808655 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dbbba2d5-7a12-44a6-8b99-2068e121e2df tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1064380375" status: 204 len: 0 microversion: 2.26 time: 0.028627 Sep 14 10:05:08.809243 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1695/5508] 10.222.0.90 () {60 vars in 1361 bytes} [Wed Sep 14 10:05:08 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1064380375 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:08.818518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693fda85e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.826641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.827281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.827597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.828100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.834709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.835212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.835669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.835808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a35765-966c-4c6b-a4ca-6734e2724355", "name": "network-vif-plugged", "status": "completed", "tag": "9ba86180-5907-4c8e-9d1a-6c16180acaec"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:08.836406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.836876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.837664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.847318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.847802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.848264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.859357 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] Creating event network-vif-plugged:9ba86180-5907-4c8e-9d1a-6c16180acaec for instance d9a35765-966c-4c6b-a4ca-6734e2724355 on n-h2-851028-12 Sep 14 10:05:08.861480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.862153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.862618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.865254 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-63a9b41f-9b00-47d0-bbdb-c6c7d9636f9f req-3ac0ae11-0191-494b-be50-aa82852d61e9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Sep 14 10:05:08.865862 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1696/5509] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:08.878467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:08.900611 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3cf29215-93a6-4999-8633-c0b4224ff681 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 204 len: 0 microversion: 2.26 time: 0.085358 Sep 14 10:05:08.900611 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3814/5510] 10.222.0.90 () {60 vars in 1295 bytes} [Wed Sep 14 10:05:08 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 10:05:08.914307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9852506-f91e-4077-9268-4f87af979fb7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f5cc820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.924012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9852506-f91e-4077-9268-4f87af979fb7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.924503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9852506-f91e-4077-9268-4f87af979fb7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.924944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9852506-f91e-4077-9268-4f87af979fb7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.936937 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9852506-f91e-4077-9268-4f87af979fb7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 12 microversion: 2.26 time: 0.029933 Sep 14 10:05:08.937558 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1697/5511] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 10:05:08 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 12 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:08.948084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693e317940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:08.958646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.959148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.959629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.960199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:08.965919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.966409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.966857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.967552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.968050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.968493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:08.996348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:08.996850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:08.997299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.007112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.007596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.008080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.032239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.037266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:09.053968 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2fd8dcb-4da7-4a0b-ab2f-8297d0ea97ec tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1306656967" status: 201 len: 0 microversion: 2.26 time: 0.109880 Sep 14 10:05:09.054790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3815/5512] 10.222.0.90 () {62 vars in 1380 bytes} [Wed Sep 14 10:05:08 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1306656967 => generated 0 bytes in 111 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 10:05:09.065287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-57318d9a-e50a-4c82-9ce1-e3f91c3d406a tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693fd2aaf0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.072943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57318d9a-e50a-4c82-9ce1-e3f91c3d406a tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.073428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57318d9a-e50a-4c82-9ce1-e3f91c3d406a tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.073866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57318d9a-e50a-4c82-9ce1-e3f91c3d406a tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.083444 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-57318d9a-e50a-4c82-9ce1-e3f91c3d406a tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 36 microversion: 2.26 time: 0.022152 Sep 14 10:05:09.084069 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1698/5513] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 10:05:09 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 36 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:09.094426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693e0eb0d0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.103976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.104469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.104912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.105435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.112498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.112982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.113422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.114105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.114566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.114999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.137485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.137901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.138341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.160290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.176152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a6ea791c-95c5-4134-a0ca-ba8fe24d0118 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1306656967" status: 204 len: 0 microversion: 2.26 time: 0.085688 Sep 14 10:05:09.176808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3816/5514] 10.222.0.90 () {60 vars in 1364 bytes} [Wed Sep 14 10:05:09 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1306656967 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:09.185240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3e26bc3-6835-4106-8fdd-e4b769fc0e68 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f29cca0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.192829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3e26bc3-6835-4106-8fdd-e4b769fc0e68 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.193311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3e26bc3-6835-4106-8fdd-e4b769fc0e68 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.193747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3e26bc3-6835-4106-8fdd-e4b769fc0e68 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.202724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3e26bc3-6835-4106-8fdd-e4b769fc0e68 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 12 microversion: 2.26 time: 0.021566 Sep 14 10:05:09.203305 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1699/5515] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 10:05:09 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 12 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:09.213769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693e8ce700>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.222780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.223642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.224438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.225146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.232163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.232656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.233105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.233801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.234265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.234708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.264517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.264517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.264517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.275729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.291651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-557e290f-50dd-4474-838f-0ec1df6a5457 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 204 len: 0 microversion: 2.26 time: 0.082097 Sep 14 10:05:09.292314 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3817/5516] 10.222.0.90 () {60 vars in 1295 bytes} [Wed Sep 14 10:05:09 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:09.302404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f29c940>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.311531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.312035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.312470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.313047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.319256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.319704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.320167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.320840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.321287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.321705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.351623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.352142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.352577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.361947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.362437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.362871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.387406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.406801 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8618c97e-8cba-42d8-850b-5848f1ecbdd4 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-752465211" status: 201 len: 0 microversion: 2.26 time: 0.109014 Sep 14 10:05:09.407434 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1700/5517] 10.222.0.90 () {62 vars in 1377 bytes} [Wed Sep 14 10:05:09 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-752465211 => generated 0 bytes in 110 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 14 10:05:09.418127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693dffc820>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.427374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.427878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.428367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.428854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.434421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.434740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.435170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.435889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.436385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.436824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.464459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.464982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.465426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.474212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.474710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.475162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.503859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.519221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d23ce03-3549-43c4-aecd-89ed98c7983b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-719947581" status: 201 len: 0 microversion: 2.26 time: 0.106003 Sep 14 10:05:09.519887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3818/5518] 10.222.0.90 () {62 vars in 1377 bytes} [Wed Sep 14 10:05:09 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-719947581 => generated 0 bytes in 107 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 14 10:05:09.530329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f558160>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.535542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.536226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.538620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.539097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.539526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.540020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.542416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.542910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.543368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.544117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.544592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.545039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.545146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.545585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.546021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.546680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.547125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.547540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.552223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:09.573227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.573723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.574159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.589205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.605573 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bfed41a6-9636-465d-ad48-4790c4b59dcd tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 204 len: 0 microversion: 2.26 time: 0.079981 Sep 14 10:05:09.606540 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1701/5519] 10.222.0.90 () {60 vars in 1295 bytes} [Wed Sep 14 10:05:09 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:09.617921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbedbf55-77cc-49eb-b02e-ae827be51a29 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f558dc0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.625612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbedbf55-77cc-49eb-b02e-ae827be51a29 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.626141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbedbf55-77cc-49eb-b02e-ae827be51a29 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.627386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbedbf55-77cc-49eb-b02e-ae827be51a29 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.636594 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbedbf55-77cc-49eb-b02e-ae827be51a29 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 12 microversion: 2.26 time: 0.023297 Sep 14 10:05:09.637232 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1702/5520] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 10:05:09 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:09.647421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f69447f0ee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.654759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.655239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.655672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.656168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.661842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.662256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.662694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.663370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.663823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.664284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.684359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:09.686510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.687001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.687430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.693461 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-68621ccc-3099-470a-b4d8-808b251b1dcd tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1266 microversion: 2.1 time: 0.162710 Sep 14 10:05:09.694069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3819/5521] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:09 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:05:09.699021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.713770 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4c952c80-2145-4207-af0d-8880d144e81b tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 204 len: 0 microversion: 2.26 time: 0.070209 Sep 14 10:05:09.714386 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1703/5522] 10.222.0.90 () {60 vars in 1295 bytes} [Wed Sep 14 10:05:09 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 10:05:09.724210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693dc96e50>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.734335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.734837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.735300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.736749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.742836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.743332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.743822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.744651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.745109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.745990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.773144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.773639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.774088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.782474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.783779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.784244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.806681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.822186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a03adacc-eedf-422a-bde2-742eb9aae6eb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1441338147" status: 201 len: 0 microversion: 2.26 time: 0.102335 Sep 14 10:05:09.822840 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3820/5523] 10.222.0.90 () {62 vars in 1380 bytes} [Wed Sep 14 10:05:09 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-1441338147 => generated 0 bytes in 104 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 14 10:05:09.832853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f6dc310>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:09.842063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.842546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.842986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.843453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.849344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.849823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.850257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.850932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.851387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.851813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.879670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.880193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.880638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.889484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.889959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.890402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.916532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:09.935777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2cc2d61c-8455-42f7-9883-a8eac359fbfb tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-445986093" status: 201 len: 0 microversion: 2.26 time: 0.107000 Sep 14 10:05:09.936545 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1704/5524] 10.222.0.90 () {62 vars in 1377 bytes} [Wed Sep 14 10:05:09 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags/tempest-tag-445986093 => generated 0 bytes in 109 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 14 10:05:09.946695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Action: 'update_all', calling method: .version_select at 0x7f693e3174c0>, body: {"tags": ["tempest-tag-286246436", "tempest-tag-358625007"]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:09.956350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.956841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.957283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.957759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:09.962843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.963326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.963768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.964482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.964944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.965377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:09.989301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:09.989813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:09.990313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.011753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:10.028581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff663401-8a5d-42e6-9e34-b5ba62243ce7 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 60 microversion: 2.26 time: 0.085941 Sep 14 10:05:10.029395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3821/5525] 10.222.0.90 () {62 vars in 1312 bytes} [Wed Sep 14 10:05:09 2022] PUT /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 60 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:10.039656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c06b89e3-0848-445c-8365-78f2d8bbbb0d tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693f20eee0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.047252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c06b89e3-0848-445c-8365-78f2d8bbbb0d tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.047707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c06b89e3-0848-445c-8365-78f2d8bbbb0d tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.048174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c06b89e3-0848-445c-8365-78f2d8bbbb0d tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.058936 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c06b89e3-0848-445c-8365-78f2d8bbbb0d tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 200 len: 60 microversion: 2.26 time: 0.023584 Sep 14 10:05:10.059747 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1705/5526] 10.222.0.90 () {60 vars in 1292 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 60 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:10.071373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '.version_select at 0x7f693c44a790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.080269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.080791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.081280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.081809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.087248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.087743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.088235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.088940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.089411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.089852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.118729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.119854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.120715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.145582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lazy-loading 'flavor' on Instance uuid 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:05:10.166446 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f33315c-181c-469b-9509-c2bc4d56b004 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags" status: 204 len: 0 microversion: 2.26 time: 0.099124 Sep 14 10:05:10.167607 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3822/5527] 10.222.0.90 () {60 vars in 1295 bytes} [Wed Sep 14 10:05:10 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad/tags => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 14 10:05:10.176789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.177335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.186194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.186694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.187167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.188304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.188787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.189214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.219512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:05:10.331826 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44581615-9ba7-4062-8dcd-274bb2bd873e tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 204 len: 0 microversion: 2.26 time: 0.157699 Sep 14 10:05:10.333131 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1706/5528] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 10:05:10 2022] DELETE /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:10.344214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.344932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.352843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.353424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.353889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.354638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.355114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.355608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.495519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.504243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.505715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.506917 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9a68678a-3945-4658-bb86-0634ed4157ab tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1552 microversion: 2.26 time: 0.168336 Sep 14 10:05:10.507483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3823/5529] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:10.717404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.718037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.725060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.725552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.725993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.726696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.727156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.727584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.868392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:10.876582 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-39a9a8c3-b980-443e-8fe0-4bc15ecb1974 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1453 microversion: 2.1 time: 0.163457 Sep 14 10:05:10.877282 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1707/5530] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:10.900190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:10.900810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:10.906885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.908031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.908549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:10.909262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:10.909760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:10.910310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:11.054974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:11.063871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dc2fdf1b-d987-4490-b8a9-829128e9b1b5 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1453 microversion: 2.1 time: 0.167525 Sep 14 10:05:11.064809 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3824/5531] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:05:10 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:05:11.535947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:11.536588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:11.543025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:11.543603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:11.544076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:11.544814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:11.545271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:11.545778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:11.777256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:11.786927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:11.788496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd41093313e8341cdb405a037d1fa7497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7e6f22326c49218f2f168d9df346da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:11.789810 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-26085f47-1152-4a75-9ed4-a900bb1e7906 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 200 len: 1552 microversion: 2.26 time: 0.259125 Sep 14 10:05:11.790458 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1708/5532] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:11 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 1552 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:12.138821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad", "name": "network-vif-deleted", "tag": "8c2c656a-10b4-4328-93ad-a7f29382c652"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:12.153157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:12.153816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:12.154385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:12.168677 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] Creating event network-vif-deleted:8c2c656a-10b4-4328-93ad-a7f29382c652 for instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad on n-h1-851028-12 Sep 14 10:05:12.176271 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-986dbb40-b832-4927-820e-da0f765cf38c req-ff4b2ef2-fd56-4477-8f57-af0de8658cce service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041665 Sep 14 10:05:12.177334 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3825/5533] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:12.817524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:12.818190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] [instance: 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:12.825295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:12.825776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:12.826208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:12.826892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:12.827373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:12.827802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:12.842401 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] HTTP exception thrown: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Request method failure captured: Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad HTTP/1.1 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIadIhcW4xY7joWJXfnt8z1dklWWR1uKgLpSQGv-uC58heaJmxY3uEQTzpUIX6slB5eNZDNvcHnMQZ-awb9YeEwbn3bYZ4ukygxvhofbZNQF8eNonlGlFdmLQfh0odajDx732-Noj1D58K-oy5nIvvvi9iCwXv21XM2elxp1petvr_s0 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.26 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0f7e6f22326c49218f2f168d9df346da Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerTagsTestJSON-1161422477 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0f7e6f22326c49218f2f168d9df346da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0f7e6f22326c49218f2f168d9df346da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0f7e6f22326c49218f2f168d9df346da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0f7e6f22326c49218f2f168d9df346da"}]}] Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerTagsTestJSON-1161422477 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0f7e6f22326c49218f2f168d9df346da Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerTagsTestJSON-1161422477 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerTagsTestJSON-1161422477-project Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d41093313e8341cdb405a037d1fa7497 Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerTagsTestJSON-1161422477-project Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad'} Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:12.844136 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] Returning 404 to user: Instance 78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6268f6d3-32b6-4621-a105-ce1953d79801 tempest-ServerTagsTestJSON-1161422477 tempest-ServerTagsTestJSON-1161422477-project] 10.222.0.90 "GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad" status: 404 len: 111 microversion: 2.26 time: 0.033740 Sep 14 10:05:12.849762 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1709/5534] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:12 2022] GET /compute/v2.1/servers/78f2a737-8fc6-4ad4-ae7a-0d9d6851b2ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 10:05:13.187859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a35765-966c-4c6b-a4ca-6734e2724355", "tag": "9ba86180-5907-4c8e-9d1a-6c16180acaec"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:13.195335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:13.199583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:13.200109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:13.201014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:13.213902 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] Creating event network-changed:9ba86180-5907-4c8e-9d1a-6c16180acaec for instance d9a35765-966c-4c6b-a4ca-6734e2724355 on n-h2-851028-12 Sep 14 10:05:13.220439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-017fa484-8bdc-4293-9501-eab3f2385986 req-404e7ed4-2283-442f-82be-4989ddc28afa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035862 Sep 14 10:05:13.221326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3826/5535] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:17.208592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-999919438", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": "none"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:17.263647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:05:17.264109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:05:17.264617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:05:17.265059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:05:17.265474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:05:17.276531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:17.277014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:17.277457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:17.278189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:17.278647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:17.279466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:17.299082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Getting quotas for project b2e68e8dc2474376b3505dc16eb520f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:05:17.304414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Getting quotas for user e41b8760bf8446d697afad58f0e81718 and project b2e68e8dc2474376b3505dc16eb520f8. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:05:17.317858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:05:17.320423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:05:17.368379 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12470d39-f2ab-4b54-8a9a-c2d2d35f1f90 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.279736 Sep 14 10:05:17.369162 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1710/5536] 10.222.0.90 () {62 vars in 1188 bytes} [Wed Sep 14 10:05:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 281 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 14 10:05:17.383121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:17.383840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:17.443362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:17.451062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:17.452574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:17.454459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-84a0bf76-4987-44fe-acdf-5a6f5a1f64e0 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1277 microversion: 2.54 time: 0.075844 Sep 14 10:05:17.455230 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3827/5537] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:17 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1277 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:18.485502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:18.485502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:18.492216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:18.492707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:18.493144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:18.493851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:18.494301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:18.494891 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:18.566578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:18.575705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:18.577256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:18.579053 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-95c451e1-f83b-4499-b274-94009f9b46e9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1347 microversion: 2.54 time: 0.101317 Sep 14 10:05:18.579676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1711/5538] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:18 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1347 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:19.606789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:19.607457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:19.615564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:19.616174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:19.616631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:19.617342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:19.617814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:19.618262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:19.623240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:19.688176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:19.696580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:19.698042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:19.699189 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3eb52fa2-e7ef-4caf-b483-6036432e76b7 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1335 microversion: 2.54 time: 0.096601 Sep 14 10:05:19.699797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3828/5539] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:19 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:20.726567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:20.727130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:20.735230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:20.736222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:20.736676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:20.737374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:20.737820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:20.738290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:20.807618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:20.817293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:20.818759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:20.819953 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1bd29f3d-af93-415c-9df2-65d8dedb42ed tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1356 microversion: 2.54 time: 0.097774 Sep 14 10:05:20.820780 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1712/5540] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:20 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:20.850384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ee574ad-eaee-4d2f-ad07-3478cbd6d46b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Action: 'create', calling method: .version_select at 0x7f693c42f160>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1167024796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtPUwH/LQKcfcaejTXltQhq8jJqJexHHsaBSWL4RSoM4K9XcLeGu7BKgg00EE7VVEpTmU2tPT+mYqN7V9uKXOo0IiiEpdAwctLwngpFrHJpKetRHc8vVTDQBGQk1bKNKw=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:20.869146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8ee574ad-eaee-4d2f-ad07-3478cbd6d46b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Getting quotas for project b2e68e8dc2474376b3505dc16eb520f8. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:05:20.874713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-8ee574ad-eaee-4d2f-ad07-3478cbd6d46b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Getting quotas for user e41b8760bf8446d697afad58f0e81718 and project b2e68e8dc2474376b3505dc16eb520f8. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:05:20.900973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ee574ad-eaee-4d2f-ad07-3478cbd6d46b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.054883 Sep 14 10:05:20.901596 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3829/5541] 10.222.0.90 () {62 vars in 1200 bytes} [Wed Sep 14 10:05:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 14 10:05:20.914299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1167024796", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:05:20.917447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:20.924722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:20.925242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:20.925825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:20.926531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:20.926985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:20.927582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:21.016213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:05:21.016961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:05:21.017624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:05:21.018039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:05:21.018423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:05:21.100733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:21.108016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:21.108658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:21.109112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:21.111129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:21.111580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:21.112040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:21.116742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:21.147580 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f805865-2ef3-447e-b830-eecc639f5995 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "POST /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4/action" status: 202 len: 1139 microversion: 2.54 time: 0.237533 Sep 14 10:05:21.148379 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1713/5542] 10.222.0.90 () {62 vars in 1320 bytes} [Wed Sep 14 10:05:20 2022] POST /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4/action => generated 1139 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 14 10:05:21.181039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:21.181818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:21.190229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:21.190742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:21.191196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:21.191997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:21.192470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:21.192942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:21.270076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:21.279150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:21.280816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:21.282331 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-117d4f67-aeae-4316-b12c-bb3ff9a2c360 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.108031 Sep 14 10:05:21.283015 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3830/5543] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:21 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:22.310198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:22.310817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:22.314454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:22.321124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:22.321620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:22.322063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:22.322855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:22.323318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:22.323750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:22.393553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:22.401753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:22.403404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:22.404613 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-341d5564-a8dd-4921-bd26-1beb02817fbc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.098484 Sep 14 10:05:22.405193 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1714/5544] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:22 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:23.431709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:23.432330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:23.439437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:23.439957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:23.440412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:23.441121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:23.441664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:23.442128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:23.508757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:23.517232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:23.518705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:23.519906 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8c502071-71cc-4b20-b053-2a5e9aff9bfc tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.092248 Sep 14 10:05:23.520490 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3831/5545] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:23 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:24.547227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:24.548060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:24.558525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:24.559032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:24.559434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:24.560162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:24.560612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:24.561031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:24.626868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:24.635349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:24.636843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:24.638014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-36fec61e-1cf3-4d5f-abf4-b3d7a382a991 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.095337 Sep 14 10:05:24.638591 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1715/5546] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:24 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:25.664162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:25.664827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:25.672469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:25.673082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:25.673540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:25.674254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:25.674727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:25.675175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:25.741608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:25.750454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:25.751985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:25.753221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b273e79-a5df-417f-bfef-6f7c88a94ffe tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.093087 Sep 14 10:05:25.753803 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3832/5547] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:25 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:26.778800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:26.779394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:26.786314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:26.786809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:26.787269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:26.787990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:26.788452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:26.788872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:26.861664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:26.870382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:26.871869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:26.873094 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e003bafc-8254-48ce-8404-47bd7220a75c tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.098178 Sep 14 10:05:26.873675 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1716/5548] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:26 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:27.902494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:27.903237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:27.911991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:27.912497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:27.912986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:27.913702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:27.914270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:27.914765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:28.009148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:28.020697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:28.022294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:28.024274 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53bbea4d-acdd-471e-a757-ac8e10b4084b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.126477 Sep 14 10:05:28.024832 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3833/5549] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:27 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:29.054290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:29.054952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:29.056863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:29.057547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:29.065908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:29.066638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:29.067192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:29.068107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:29.068627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:29.069063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:29.152525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:29.161362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:29.162876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:29.164202 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-328f8a2e-eeda-4909-9d6e-21dd208a45b9 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.113914 Sep 14 10:05:29.164779 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1717/5550] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:29 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:30.191868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:30.192569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:30.200123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:30.200635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:30.201092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:30.202076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:30.202299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:30.202742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:30.269741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:30.277984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:30.279494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:30.280717 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9d0d3e2-5b30-4858-863d-f025382d1f2d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.093930 Sep 14 10:05:30.281335 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3834/5551] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:30 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:31.307761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:31.308529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:31.316844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:31.317341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:31.317782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:31.318491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:31.318947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:31.319376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:31.390179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:31.398985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:31.400462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:31.401627 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4191a002-2b6f-41ce-847d-ae6682a6b71d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.098816 Sep 14 10:05:31.402191 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1718/5552] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:31 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:32.425555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:32.431768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:32.432470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:32.439705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:32.440251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:32.440704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:32.441443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:32.442053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:32.442514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:32.523166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:32.534426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:32.535910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:32.537458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a3973bf-f967-4622-bd0d-a618ac85ebc5 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.112804 Sep 14 10:05:32.538051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3835/5553] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:32 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:33.568155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:33.568716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:33.575764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:33.576279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:33.576719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:33.577406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:33.577907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:33.578701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:33.646629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:33.654751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:33.656426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:33.657673 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a97820ca-80a9-4349-ae04-1e749dcc091b tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.093701 Sep 14 10:05:33.658366 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1719/5554] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:33 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:34.685628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:34.686274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:34.693813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:34.694321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:34.694779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:34.695493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:34.695998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:34.696443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:34.761571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:34.770511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:34.772043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:34.773361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49346fd0-f402-435d-a65b-9c2c7351e149 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.092226 Sep 14 10:05:34.774042 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3836/5555] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:34 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:35.803186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:35.804289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:35.817968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:35.818598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:35.819086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:35.820534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:35.821262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:35.821783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:35.902921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:35.912359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:35.913813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:35.914995 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b3fee5c-b4fc-4f58-8f3a-f142598544cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.117074 Sep 14 10:05:35.915577 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1720/5556] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:35 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:36.942747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:36.944158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:36.951239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:36.951798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:36.952294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:36.953597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:36.954157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:36.954599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:37.024278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:37.034911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:37.036449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:37.037648 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f82c82bc-d97c-401f-ab6c-b399589b40a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.098933 Sep 14 10:05:37.038423 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3837/5557] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:36 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:38.065597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:38.066207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:38.073121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:38.073796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:38.074038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:38.074728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:38.075263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:38.075591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:38.141171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:38.149311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:38.150838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:38.154150 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-76bc7655-194f-4205-a24f-355b4d66fcfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.093039 Sep 14 10:05:38.154744 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1721/5558] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:38 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:39.186011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:39.187219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:39.194364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:39.194866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:39.195320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:39.196067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:39.196540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:39.196984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:39.268964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:39.277510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:39.278984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:39.280221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9cd5053-d1fa-4151-9f28-cbff3ee6a718 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.103000 Sep 14 10:05:39.280866 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3838/5559] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:39 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:40.306477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:40.307071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:40.314990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:40.315463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:40.315925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:40.316629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:40.317084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:40.317515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:40.388605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:40.397493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:40.398932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:40.400137 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3657695-6441-4e99-96ad-7c4b88668720 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.097645 Sep 14 10:05:40.400705 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1722/5560] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:40 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:41.427242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:41.427783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:41.435325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.435824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.436309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.437096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:41.437686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:41.438131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:41.502715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:41.511299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:41.512807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:41.513990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-297442f5-b1cc-4e29-9539-d340da4c553d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.090868 Sep 14 10:05:41.514576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3839/5561] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:41 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:42.541048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:42.541739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:42.549197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:42.549681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:42.550123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:42.550813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:42.551269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:42.551697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:42.619627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:42.629208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:42.630664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:42.631826 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ec2ec01c-540b-4293-b82e-659cb3d9eb6a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.094722 Sep 14 10:05:42.632428 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1723/5562] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:42 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:43.658780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:43.659405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:43.661954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:43.667312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:43.667813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:43.668300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:43.669010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:43.669478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:43.669921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:43.736034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:43.744333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:43.745871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:43.747064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fcb22033-3dc8-43fe-a5df-7392bf10dc6d tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.092443 Sep 14 10:05:43.747633 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3840/5563] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:43 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:44.774067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:44.774741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:44.783061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:44.783549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:44.784023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:44.784728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:44.785180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:44.785611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:44.851065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:44.859877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:44.861364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:44.862530 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb279f4a-5b83-4b95-a37e-fa23e445788e tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.092445 Sep 14 10:05:44.863104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1724/5564] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:44 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 14 10:05:45.890533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:45.891348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:45.898287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:45.898789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:45.899241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:45.899983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:45.900455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:45.900895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:45.969784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:45.978079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:45.979550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:45.980755 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-62b3ecd2-ffaa-4464-8efa-9c6f5397a8cd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.094882 Sep 14 10:05:45.981330 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3841/5565] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:45 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:47.007084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:47.007740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:47.015533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:47.016123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:47.016563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:47.017363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:47.017822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:47.018260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:47.089191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:47.098251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:47.099732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:47.100945 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1df04eab-467a-440e-b421-46370080d684 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1408 microversion: 2.54 time: 0.097798 Sep 14 10:05:47.101537 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1725/5566] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:47 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:48.128707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:48.129366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:48.136338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:48.136833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:48.137311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:48.138020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:48.138486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:48.138924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:48.204695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:48.212805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:48.214258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:48.215420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b3151f7b-ce08-44bc-bc79-e184e7156ba6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1414 microversion: 2.54 time: 0.091651 Sep 14 10:05:48.216039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3842/5567] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:48 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:49.242085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:49.242722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:49.250051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:49.250539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:49.250978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:49.251675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:49.252154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:49.252583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:49.319502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:49.327561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:49.329020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:49.330201 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ecdb631f-ab11-41e5-ba4d-6b62506f184a tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1414 microversion: 2.54 time: 0.092055 Sep 14 10:05:49.330774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1726/5568] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:49 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:50.355933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:50.356534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:50.364025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.364531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.364988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.365699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.366173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.366616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.370774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=83 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:50.430042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.438511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.440009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.441194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d38b5cca-a02c-4da2-bf05-f5426dc3871f tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1399 microversion: 2.54 time: 0.089648 Sep 14 10:05:50.441767 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3843/5569] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:50 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1399 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:50.466348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e122508-49d1-41bd-99de-75ab65197cfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '.version_select at 0x7f6947b28b80>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:50.488137 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e122508-49d1-41bd-99de-75ab65197cfd tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1167024796" status: 204 len: 0 microversion: 2.54 time: 0.025593 Sep 14 10:05:50.488723 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1727/5570] 10.222.0.90 () {60 vars in 1319 bytes} [Wed Sep 14 10:05:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1167024796 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:50.500966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:50.501519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:50.508175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.508682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.509134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.509852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.510329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.510796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.538933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:05:50.618104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b1e1a8b1-398c-41ac-bb89-438bef0ef365 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 204 len: 0 microversion: 2.54 time: 0.120957 Sep 14 10:05:50.618638 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3844/5571] 10.222.0.90 () {60 vars in 1280 bytes} [Wed Sep 14 10:05:50 2022] DELETE /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 14 10:05:50.629030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:50.629647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:50.636431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.636947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.637390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.638081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:50.638534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:50.638960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:50.709100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.717541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.719063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:50.720348 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca54e4e6-7481-4624-8c53-ba115f090460 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1405 microversion: 2.54 time: 0.096511 Sep 14 10:05:50.720919 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1728/5572] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:50 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:51.753135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:51.754456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:51.763383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:51.763878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:51.764360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:51.765058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:51.766168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:51.766606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:51.833536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:51.841758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:51.843724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e41b8760bf8446d697afad58f0e81718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2e68e8dc2474376b3505dc16eb520f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:05:51.845067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d9523e36-db63-4fcc-8e72-c6ff250332a6 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 200 len: 1405 microversion: 2.54 time: 0.100926 Sep 14 10:05:51.845647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3845/5573] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:51 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 1405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 14 10:05:52.871507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:52.872143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] [instance: 1b65b088-759b-452b-b9c6-a84492045ec4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:05:52.875035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:52.881070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:52.881557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:52.882023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:52.882719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:05:52.883171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:05:52.883598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:05:52.889012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=88 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:05:52.900956 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] HTTP exception thrown: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Request method failure captured: Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 HTTP/1.1 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIadcPPhHuk3J-iBVlD-8rMIPekHWlXZ5cHNN_TO1pYigOc5McNSTyEvjqpFyBFV3DdZvhvHMniGEJ6ABHx_M728RvvvbHFbvk-jAJJh-r3k5LjDw-aAcx0My6eaqzS4Yngfyso_dDVFdJtrXhZf3fZsznHLFWcAJmYW2U2eNdBZHttU Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Openstack-Nova-Api-Version: 2.54 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b2e68e8dc2474376b3505dc16eb520f8 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerShowV254Test-446964354 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b2e68e8dc2474376b3505dc16eb520f8", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b2e68e8dc2474376b3505dc16eb520f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b2e68e8dc2474376b3505dc16eb520f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b2e68e8dc2474376b3505dc16eb520f8"}]}] Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerShowV254Test-446964354 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b2e68e8dc2474376b3505dc16eb520f8 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerShowV254Test-446964354 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerShowV254Test-446964354-project Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e41b8760bf8446d697afad58f0e81718 Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerShowV254Test-446964354-project Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '1b65b088-759b-452b-b9c6-a84492045ec4'} Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:05:52.902531 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] Returning 404 to user: Instance 1b65b088-759b-452b-b9c6-a84492045ec4 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f392b98-2f90-4c3f-9e90-2d836acab4f4 tempest-ServerShowV254Test-446964354 tempest-ServerShowV254Test-446964354-project] 10.222.0.90 "GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4" status: 404 len: 111 microversion: 2.54 time: 0.036426 Sep 14 10:05:52.908770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1729/5574] 10.222.0.90 () {60 vars in 1277 bytes} [Wed Sep 14 10:05:52 2022] GET /compute/v2.1/servers/1b65b088-759b-452b-b9c6-a84492045ec4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 14 10:05:54.337977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5a9d467a-015e-42ec-abbc-2b960a96f8d0 tempest-ExtensionsTest-276160062 tempest-ExtensionsTest-276160062-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:54.339594 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5a9d467a-015e-42ec-abbc-2b960a96f8d0 tempest-ExtensionsTest-276160062 tempest-ExtensionsTest-276160062-project] 10.222.0.90 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.149549 Sep 14 10:05:54.340172 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3846/5575] 10.222.0.90 () {58 vars in 1170 bytes} [Wed Sep 14 10:05:54 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:05:54.349583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc5f0533-0ad4-4518-844c-03e495dc7e31 tempest-ExtensionsTest-276160062 tempest-ExtensionsTest-276160062-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:05:54.351598 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc5f0533-0ad4-4518-844c-03e495dc7e31 tempest-ExtensionsTest-276160062 tempest-ExtensionsTest-276160062-project] 10.222.0.90 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005838 Sep 14 10:05:54.352156 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1730/5576] 10.222.0.90 () {58 vars in 1134 bytes} [Wed Sep 14 10:05:54 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:06:00.213049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9cefd415-1a86-4ff0-9089-70c5e0879c5f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: .version_select at 0x7f693c408160>, body: {"keypair": {"name": "tempest-keypair-1848244319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3RiIVUupeG9puEFbS1z4wcsVYHa7G7gInbQMtrqFj6RisMtf4FFbKtg0Fnk0DNqcTf3kN7+1WwxUzZLSyMiG+umNJmhesabSMtgEMaBn5hGOSBPqmvtO50xNVnTN4ogg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:00.232566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9cefd415-1a86-4ff0-9089-70c5e0879c5f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for project d0263098aeeb4022a35bf9549acc980c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:06:00.240310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-9cefd415-1a86-4ff0-9089-70c5e0879c5f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for user 75b4506b5a5245218ce16eb7564d5c31 and project d0263098aeeb4022a35bf9549acc980c. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:06:00.270338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9cefd415-1a86-4ff0-9089-70c5e0879c5f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209243 Sep 14 10:06:00.271587 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3847/5577] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:06:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:01.928743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-947864241", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3bf139b-9ad6-47b7-a61f-ccba687294ba"}], "security_groups": [{"name": "tempest-securitygroup--2094610766"}], "key_name": "tempest-keypair-1848244319", "user_data": "}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:02.239792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] validate_networks() for [('a3bf139b-9ad6-47b7-a61f-ccba687294ba', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:06:02.644915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:06:02.645348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:06:02.645967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:06:02.646382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:06:02.646793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:06:02.657879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:02.658087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:02.658535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:02.659262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:02.659718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:02.660176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:02.678552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for project d0263098aeeb4022a35bf9549acc980c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:06:02.683638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for user 75b4506b5a5245218ce16eb7564d5c31 and project d0263098aeeb4022a35bf9549acc980c. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:06:02.697326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:06:02.699537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:06:02.750547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3a2bf6b6-2946-4d8c-9e46-09483eba5d59 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825816 Sep 14 10:06:02.751791 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1731/5578] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:06:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:06:02.762930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:02.768413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c548a35c-2a7d-4910-bc47-41329e5394da tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:02.769317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c548a35c-2a7d-4910-bc47-41329e5394da tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:02.844921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c548a35c-2a7d-4910-bc47-41329e5394da tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:02.854974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c548a35c-2a7d-4910-bc47-41329e5394da tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1237 microversion: 2.1 time: 0.095207 Sep 14 10:06:02.865132 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3848/5579] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:02 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:03.881595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:03.882219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:03.890101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:03.891152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:03.892032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:03.893141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:03.893785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:03.894264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:03.965156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:03.976121 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fea08e45-4d11-4795-8ba3-cdfe182d782f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1289 microversion: 2.1 time: 0.099397 Sep 14 10:06:03.977354 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1732/5580] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:03 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:05.002159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:05.002795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:05.011679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.012224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.012677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.013399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.013873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.014990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.228458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:05.237958 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-846ec4cf-686b-414d-8bd4-e18dbb0d3414 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.240426 Sep 14 10:06:05.238772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3849/5581] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:04 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:05.550750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed50adea-5eaa-486c-b6bf-c8be95ec0392", "tag": "8b3020d0-de5f-4aef-89e1-179ba20b990b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:05.564778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:05.565324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:05.565761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:05.579524 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] Creating event network-changed:8b3020d0-de5f-4aef-89e1-179ba20b990b for instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 on n-h2-851028-12 Sep 14 10:06:05.585089 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-fb9385ca-10b6-4e54-863b-f3efaa93d8ea req-ebdfd401-e717-409c-a1f0-5eef4abea691 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037932 Sep 14 10:06:05.586016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1733/5582] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:06.261743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:06.262402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:06.270739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:06.271349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:06.271882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:06.272796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:06.273360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:06.273813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:06.418648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:06.427354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ded6a8ae-e6ee-4e0e-aa5f-9dae6132c94f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.169749 Sep 14 10:06:06.427867 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3850/5583] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:06 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:06:07.451070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:07.452531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:07.459846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:07.460411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:07.460847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:07.461552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:07.462074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:07.462503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:07.600784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:07.609431 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-11025be5-aaba-4fdc-9fb6-cec38fd4f943 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.162605 Sep 14 10:06:07.610031 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1734/5584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:07 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:08.631844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:08.632502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:08.639400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:08.639860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:08.640342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:08.641044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:08.641511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:08.641949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:08.775946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:08.786651 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe11c518-9072-43a3-871b-3af86e965450 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.158542 Sep 14 10:06:08.787177 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3851/5585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:08 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:09.809753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:09.811565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:09.818050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:09.818535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:09.818974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:09.819665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:09.820148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:09.820572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:09.960188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:09.968754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41716273-3eed-4922-9927-3ca75c407558 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.162879 Sep 14 10:06:09.969360 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1735/5586] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:09 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:10.992076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:10.992688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:11.000715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:11.001214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:11.001665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:11.002372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:11.002835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:11.003271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:11.053197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed50adea-5eaa-486c-b6bf-c8be95ec0392", "name": "network-vif-plugged", "status": "completed", "tag": "8b3020d0-de5f-4aef-89e1-179ba20b990b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:11.065648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:11.066095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:11.066532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:11.083674 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] Creating event network-vif-plugged:8b3020d0-de5f-4aef-89e1-179ba20b990b for instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 on n-h2-851028-12 Sep 14 10:06:11.089032 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f7bcf743-49d8-4ceb-8482-30dc637e7812 req-64df0cd3-ec2e-4241-8490-ad3e92a49ce3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041828 Sep 14 10:06:11.089922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1736/5587] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:11.148418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:11.156870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85ea0496-4559-4c2b-82f6-e5f9b62a3eb1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.168683 Sep 14 10:06:11.157493 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3852/5588] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:10 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:06:12.183029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:12.183920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:12.190627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:12.191110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:12.191585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:12.192360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:12.192811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:12.193236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:12.333166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:12.341280 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aae794bd-bfb7-4ae1-b657-8f88f5161efa tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1363 microversion: 2.1 time: 0.163373 Sep 14 10:06:12.342513 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1737/5589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:12 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:13.364714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:13.365343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:13.367886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:13.373735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:13.374235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:13.374685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:13.375398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:13.375867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:13.376332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:13.510304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:13.519040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b9b8487e-3c15-4ea1-bc54-2ed558d75d83 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1550 microversion: 2.1 time: 0.158218 Sep 14 10:06:13.519621 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3853/5590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:13 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:13.541737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:13.542256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:13.544213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:13.545036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:13.551686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:13.552196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:13.552636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:13.553368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:13.554126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:13.554880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:13.640459 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-83dd7c8d-b7a7-4ad6-8465-14b009f1682f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102476 Sep 14 10:06:13.641065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1738/5591] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:06:13 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:14.621167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed50adea-5eaa-486c-b6bf-c8be95ec0392", "tag": "8b3020d0-de5f-4aef-89e1-179ba20b990b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:14.626935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:14.633224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:14.633730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:14.634172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:14.646746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] Creating event network-changed:8b3020d0-de5f-4aef-89e1-179ba20b990b for instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 on n-h2-851028-12 Sep 14 10:06:14.651961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-78816c28-c439-45cb-bd76-328ebaf65198 req-7e750c2e-83a6-4396-8ad9-232b6e73139a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Sep 14 10:06:14.652603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3854/5592] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:06:46.079385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:46.080496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=35 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:46.083552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a35765-966c-4c6b-a4ca-6734e2724355", "tag": "9ba86180-5907-4c8e-9d1a-6c16180acaec"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:46.085372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:46.085936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:46.093985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:46.094673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:06:46.097039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:46.097322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:46.097787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:46.097923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:46.098255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:46.098467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:46.099096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:46.099635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:46.100146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:46.111810 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] Creating event network-changed:9ba86180-5907-4c8e-9d1a-6c16180acaec for instance d9a35765-966c-4c6b-a4ca-6734e2724355 on n-h2-851028-12 Sep 14 10:06:46.116990 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8a742356-6cca-4606-834e-ae84fbdf779e req-8183dfb8-bcf7-4f55-974d-ad8bff05edc8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037313 Sep 14 10:06:46.117632 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3855/5593] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:06:46.132989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:06:46.222847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-216d5cda-63be-405a-8a1f-c8db45d7ddd3 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 204 len: 0 microversion: 2.1 time: 0.145894 Sep 14 10:06:46.223511 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1739/5594] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:06:46 2022] DELETE /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:06:46.234694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:46.235536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:46.247124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:46.248755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:46.249286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:46.250102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:46.250498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:46.250940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:46.401390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:46.409285 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-feb75668-eae8-42b7-9ec5-8e37584e97c9 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1577 microversion: 2.1 time: 0.180864 Sep 14 10:06:46.409882 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3856/5595] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:46 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:47.435401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:47.436166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:47.443195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:47.443687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:47.444166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:47.444853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:47.445306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:47.445730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:47.619039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:47.627446 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5bec7dc-ce65-408d-b8c9-05220ab78638 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1577 microversion: 2.1 time: 0.197224 Sep 14 10:06:47.628067 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1740/5596] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:47 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:48.367855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a35765-966c-4c6b-a4ca-6734e2724355", "name": "network-vif-deleted", "tag": "9ba86180-5907-4c8e-9d1a-6c16180acaec"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:48.381610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:48.382523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:48.383386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:48.401606 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] Creating event network-vif-deleted:9ba86180-5907-4c8e-9d1a-6c16180acaec for instance d9a35765-966c-4c6b-a4ca-6734e2724355 on n-h2-851028-12 Sep 14 10:06:48.406775 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ab142c91-4cfa-47b7-825d-3dbac98de96f req-5cd0c8c9-4964-4620-b01b-19e811549660 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042492 Sep 14 10:06:48.407391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3857/5597] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:48.651229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:48.652435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:48.670470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:48.670979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:48.671652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:48.672483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:48.672946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:48.673380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:48.746305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:48.755086 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac8773e1-0424-4f62-b17c-8daa98e44eb4 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1225 microversion: 2.1 time: 0.108082 Sep 14 10:06:48.755847 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1741/5598] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:48 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:49.780706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:49.781494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:49.787831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:49.788373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:49.788826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:49.789545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:49.790012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:49.790455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:49.855747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:49.863997 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7b5250f-9db9-42d7-abb0-ee9e504d0f9b tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1225 microversion: 2.1 time: 0.089232 Sep 14 10:06:49.864589 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3858/5599] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:49 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:50.783714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:50.784343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:50.792039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:50.792544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:50.792982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:50.793700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:50.794152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:50.794590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:50.819339 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e91116f9-e8ea-46e2-bed0-d5bb3c2f90eb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/ips" status: 200 len: 146 microversion: 2.1 time: 0.039640 Sep 14 10:06:50.819954 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1742/5600] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 10:06:50 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:50.887581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:50.888355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:50.895552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:50.896165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:50.896631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:50.897327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:50.897789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:50.898222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:50.965888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:50.974287 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-10aafe11-306f-4845-b20f-0071c189d503 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1225 microversion: 2.1 time: 0.091448 Sep 14 10:06:50.974874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3859/5601] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:50 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:51.997890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:51.998797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:52.006134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:52.006628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:52.007077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:52.008012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:52.008480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:52.009175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:52.107616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:52.118134 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0e7c2b4c-f3fe-49b2-9662-13b23766ef73 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 200 len: 1225 microversion: 2.1 time: 0.124282 Sep 14 10:06:52.118721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1743/5602] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:51 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:06:52.830494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43a96735-b171-42fa-b63c-c6e6e8a0055b"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:52.832850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:52.840143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:52.840652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:52.841105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:52.841851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:52.842370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:52.842815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:53.094399 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6559beab-f6c4-47b1-a5b6-25426913e41c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267637 Sep 14 10:06:53.100516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3860/5603] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:06:52 2022] POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:53.143046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:53.144012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: d9a35765-966c-4c6b-a4ca-6734e2724355] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:53.158586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:53.170249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:53.171279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:53.172324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:53.173090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:53.173651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:53.189090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 HTTP/1.1 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'd9a35765-966c-4c6b-a4ca-6734e2724355'} Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:06:53.191085 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance d9a35765-966c-4c6b-a4ca-6734e2724355 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4a72a4d-1039-41ad-b7c0-2e188c452d23 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355" status: 404 len: 111 microversion: 2.1 time: 0.054639 Sep 14 10:06:53.196817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1744/5604] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:53 2022] GET /compute/v2.1/servers/d9a35765-966c-4c6b-a4ca-6734e2724355 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:06:59.496697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:59.497298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2ce349-2555-45ac-b933-f207451ccf50", "tag": "c343988c-fb73-4f35-91da-1ddbe1cc39cc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:06:59.498047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:59.506427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:59.507487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:59.508418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:59.509515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:59.510222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:59.510975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:59.511270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:59.511459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:59.512124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:59.525373 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] Creating event network-changed:c343988c-fb73-4f35-91da-1ddbe1cc39cc for instance 1b2ce349-2555-45ac-b933-f207451ccf50 on n-h1-851028-12 Sep 14 10:06:59.534479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-dab6887d-db8e-463b-8868-88a36bd63b81 req-e8978c41-a6c9-47d7-b34b-7499a5cd6f8c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038672 Sep 14 10:06:59.535668 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1745/5605] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:06:59.545164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:06:59.642476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-462e5a0b-9216-4851-9aea-a2dcd61d83de tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 204 len: 0 microversion: 2.1 time: 0.150301 Sep 14 10:06:59.643097 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3861/5606] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:06:59 2022] DELETE /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:06:59.652749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:06:59.653895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:06:59.661729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:59.662656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:59.663304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:59.664558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:06:59.665197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:06:59.666622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:06:59.832543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:06:59.842432 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d683026a-e365-4058-9b89-63780dd0f8a0 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1577 microversion: 2.1 time: 0.194508 Sep 14 10:06:59.843204 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1746/5607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:06:59 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:00.871066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:00.871799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:00.879713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:00.880258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:00.880698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:00.881427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:00.881892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:00.882367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:01.035387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:01.043289 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e76baba-954e-4bf4-a6a5-ff45ddf7d761 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1577 microversion: 2.1 time: 0.179075 Sep 14 10:07:01.043884 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3862/5608] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:00 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:01.831157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2ce349-2555-45ac-b933-f207451ccf50", "name": "network-vif-deleted", "tag": "c343988c-fb73-4f35-91da-1ddbe1cc39cc"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:01.841045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:01.841547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:01.841970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:01.853725 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] Creating event network-vif-deleted:c343988c-fb73-4f35-91da-1ddbe1cc39cc for instance 1b2ce349-2555-45ac-b933-f207451ccf50 on n-h1-851028-12 Sep 14 10:07:01.859282 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8a6a4d77-9b1f-452b-a944-7846815e4e54 req-bc2d3313-c91e-4c21-a06f-a5d3c4bd8400 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104018 Sep 14 10:07:01.859923 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1747/5609] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:07:02.067054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:02.067680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:02.076134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:02.076641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:02.077090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:02.077805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:02.078268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:02.078923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:02.152349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:02.172403 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89f1fd10-65c1-4b93-8051-569f6f8be3c2 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1224 microversion: 2.1 time: 0.109288 Sep 14 10:07:02.173611 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3863/5610] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:02 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:03.197551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:03.198261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:03.205757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:03.206254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:03.206858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:03.208089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:03.208914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:03.209369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:03.273484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:03.282021 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cebe528d-31e1-458e-82af-fcbab2957d26 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1224 microversion: 2.1 time: 0.089525 Sep 14 10:07:03.282607 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1748/5611] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:03 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:03.908505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:03.916233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:03.916755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:03.917207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:03.941231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:07:03.986699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8619a7c3-f24a-4810-8703-3531d97f0acb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action" status: 202 len: 0 microversion: 2.1 time: 0.081880 Sep 14 10:07:03.987397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3864/5612] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:03 2022] POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:07:03.996513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:03.997138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:04.003489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:04.004161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:04.004658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:04.005416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:04.006061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:04.006675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:04.154187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:04.163397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cea1b7ca-7b58-4641-bf21-0753e28259bb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.171729 Sep 14 10:07:04.164217 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1749/5613] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:03 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:07:04.306586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:04.307412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:04.313809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:04.314308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:04.314760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:04.315469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:04.315961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:04.316406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:04.384766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:04.392809 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3349e114-40c7-4d96-a160-a60b7df44692 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1224 microversion: 2.1 time: 0.091093 Sep 14 10:07:04.393403 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3865/5614] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:04 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:05.187771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:05.188420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:05.195625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:05.196159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:05.197206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:05.197910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:05.198369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:05.198799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:05.335848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:05.344680 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c64d5ce-4bc1-4847-858e-8e1b4a2444d2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.160706 Sep 14 10:07:05.345276 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1750/5615] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:05 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:05.417116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:05.417745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:05.424637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:05.425135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:05.425582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:05.426281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:05.426743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:05.427183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:05.495578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10b27920d66c46b08759ef197dabb0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed45e38a5194b1ab295ef8b087bccc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:05.503723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-760f2d1a-2f62-4c82-bc7b-6dcc3c207012 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 200 len: 1224 microversion: 2.1 time: 0.090846 Sep 14 10:07:05.504346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3866/5616] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:05 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:06.369275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:06.370107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:06.377074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:06.377822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:06.378302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:06.379045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:06.379551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:06.380047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:06.512351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:06.520601 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-23f93a12-21a9-4836-804f-eeb76a430540 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.155565 Sep 14 10:07:06.521221 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1751/5617] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:06 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:06.527377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:06.528124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 1b2ce349-2555-45ac-b933-f207451ccf50] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:06.535066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:06.535564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:06.536044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:06.536749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:06.537219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:06.537659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:06.551834 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 HTTP/1.1 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '1b2ce349-2555-45ac-b933-f207451ccf50'} Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:06.553567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance 1b2ce349-2555-45ac-b933-f207451ccf50 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19a09371-4c33-433f-adba-9846d33c36fe tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50" status: 404 len: 111 microversion: 2.1 time: 0.032147 Sep 14 10:07:06.559567 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3867/5618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:06 2022] GET /compute/v2.1/servers/1b2ce349-2555-45ac-b933-f207451ccf50 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:07:07.017784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:07.018222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:07.024531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.025277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.025458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.026156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.026616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.027047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.040521 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 HTTP/1.1 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '15590244-d05a-4d79-a4e6-2179503747b1'} Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:07:07.042242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5c57902-fc60-451e-b6e3-56cf1931a5ca tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 404 len: 111 microversion: 2.1 time: 0.029897 Sep 14 10:07:07.047273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1752/5619] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:07:07 2022] DELETE /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:07:07.052410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:07.053097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] [instance: 15590244-d05a-4d79-a4e6-2179503747b1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:07.059763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.060293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.060730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.061431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.061894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.062329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.076563 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] HTTP exception thrown: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Request method failure captured: Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 HTTP/1.1 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaUQ2zd5v_NIJj0y1t0lVPMb-aIIsNLr4YzQ0XsjnWWkxmWeqt_m5aRA54gW8nxIvCHnBKnYidDpYPzvD94xKhdrkeNjt0BzkRxIZjxbADuWdaJd3qsote8p17Uuhny6VLVIHZvAlwKOZpGHEULpsNnPTB2dq1pHzjgWSX-LqIIlmQY Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_2ed45e38a5194b1ab295ef8b087bccc3", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/2ed45e38a5194b1ab295ef8b087bccc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/2ed45e38a5194b1ab295ef8b087bccc3"}]}] Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 2ed45e38a5194b1ab295ef8b087bccc3 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestVolumeBootPattern-1892082458 Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 10b27920d66c46b08759ef197dabb0cd Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestVolumeBootPattern-1892082458-project Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '15590244-d05a-4d79-a4e6-2179503747b1'} Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:07:07.078079 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Returning 404 to user: Instance 15590244-d05a-4d79-a4e6-2179503747b1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-034330eb-020c-46a9-a3e9-d1dd49c70ae1 tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1" status: 404 len: 111 microversion: 2.1 time: 0.031019 Sep 14 10:07:07.082871 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3868/5620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:07 2022] GET /compute/v2.1/servers/15590244-d05a-4d79-a4e6-2179503747b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:07:07.545273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:07.545886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:07.552718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.553195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.553623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.554303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:07.554750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:07.555173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:07.690386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:07.698914 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6fc1a368-88a3-418a-8fd6-20a2df107c6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.157558 Sep 14 10:07:07.699483 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1753/5621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:07 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:08.722896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:08.723568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:08.731120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:08.731630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:08.732120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:08.732847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:08.733340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:08.733830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:08.874283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:08.882700 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3af36d8-83e1-4166-93f4-47951348ddbf tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.163893 Sep 14 10:07:08.883282 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3869/5622] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:08 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:09.906768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:09.907435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:09.914598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:09.916303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:09.916785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:09.917494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:09.917946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:09.918371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:10.052823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:10.062346 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12b2be45-1ff3-4293-bef4-40e8a14be975 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.159610 Sep 14 10:07:10.062948 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1754/5623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:09 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:10.515749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2ddaba5-a7b3-4cfb-806f-724213f3d97c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] Calling method '.version_select at 0x7f693c408160>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:10.545269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2ddaba5-a7b3-4cfb-806f-724213f3d97c tempest-TestVolumeBootPattern-1892082458 tempest-TestVolumeBootPattern-1892082458-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-229185920" status: 202 len: 0 microversion: 2.1 time: 0.033327 Sep 14 10:07:10.546205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3870/5624] 10.222.0.90 () {58 vars in 1260 bytes} [Wed Sep 14 10:07:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-229185920 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:07:11.087795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:11.088594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:11.098703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:11.099404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:11.099967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:11.100826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:11.101607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:11.102865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:11.332353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:11.341755 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a16e659a-9c87-49b2-9964-33f9be93c380 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.258925 Sep 14 10:07:11.342287 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1755/5625] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:11 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:12.365798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:12.366582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:12.375371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:12.375884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:12.376368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:12.377123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:12.377602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:12.378054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:12.382409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:12.552039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:12.561625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1908a9d-2c9b-401b-bf0b-b653e1ca9a24 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.199661 Sep 14 10:07:12.562160 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3871/5626] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:12 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:13.586585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:13.587510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:13.594319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:13.594809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:13.595244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:13.596163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:13.596794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:13.597226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:13.814472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:13.819683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:13.826721 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2692560e-d71c-4ed2-84b1-7760f8568b3b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.244152 Sep 14 10:07:13.827581 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1756/5627] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:13 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:14.856397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:14.857756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:14.865259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:14.865816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:14.866271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:14.867010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:14.868354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:14.868810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:15.062774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:15.071335 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6185ae32-de2f-4e4b-b712-1a14a432fc46 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.220574 Sep 14 10:07:15.071948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3872/5628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:14 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:16.096039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:16.097709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:16.101138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:16.108990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:16.109498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:16.110160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:16.110884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:16.111345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:16.111777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:16.282610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:16.291887 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0a6bd109-37c3-4a13-8e3c-1bc680c3b222 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.199871 Sep 14 10:07:16.292524 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1757/5629] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:16 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:17.318147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:17.322295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:17.329168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:17.331790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:17.332592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:17.332771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:17.334116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:17.334632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:17.335236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:17.528955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:17.538309 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08d7d025-4526-43b0-b122-b7dd6909a0e4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.224079 Sep 14 10:07:17.541650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3873/5630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:17 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:18.566819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:18.567440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:18.576311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:18.576801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:18.577236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:18.577945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:18.578398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:18.578830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:18.723084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:18.732179 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07625170-ca7f-4f9f-885e-09a66087e93c tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1724 microversion: 2.1 time: 0.169447 Sep 14 10:07:18.738568 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1758/5631] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:18 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:19.755724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:19.756400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:19.763882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:19.764398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:19.764850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:19.765551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:19.766018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:19.766453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.192248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:20.201627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4250a2a4-07df-4d71-bdd7-d79d23388f16 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1701 microversion: 2.1 time: 0.449836 Sep 14 10:07:20.202215 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3874/5632] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:19 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1701 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:20.224744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:07:20.232735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:20.233212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:20.233647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.256510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Going to try to start instance {{(pid=122443) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:07:20.298287 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f751537b-33a7-404f-8236-f7a5e41aa10a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action" status: 202 len: 0 microversion: 2.1 time: 0.077071 Sep 14 10:07:20.298896 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1759/5633] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:07:20 2022] POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:07:20.308471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:20.309105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:20.318044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:20.319824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:20.321112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.322418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:20.324343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:20.325407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:20.468620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:20.477863 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9a9ae41-11dc-438e-a0ee-5fb8e5200a62 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1710 microversion: 2.1 time: 0.174256 Sep 14 10:07:20.478446 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3875/5634] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:20 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1710 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:21.502223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:21.502930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:21.510266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.510755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.511195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.511887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:21.512369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:21.512794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:21.647938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:07:21.656549 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-023bf760-d4cb-40a1-ae20-0bc150d0dee7 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1714 microversion: 2.1 time: 0.158476 Sep 14 10:07:21.657127 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1760/5635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:07:21 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:07:54.597531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:07:54.598159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:07:54.600129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:54.600931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=28 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:07:54.601859 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:07:54.602288 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:07:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments/43a96735-b171-42fa-b63c-c6e6e8a0055b (ip 10.222.0.90) !!! Sep 14 10:07:54.615683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:54.616219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:54.616676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:54.617399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:07:54.617872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:07:54.618386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:07:54.701818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lazy-loading 'services' on Instance uuid ed50adea-5eaa-486c-b6bf-c8be95ec0392 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:07:54.773860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-663a068c-fb1f-4fa4-9e2c-d37db388c0b3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments/43a96735-b171-42fa-b63c-c6e6e8a0055b" status: 202 len: 0 microversion: 2.1 time: 0.180485 Sep 14 10:07:54.774489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3876/5636] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:07:54 2022] DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments/43a96735-b171-42fa-b63c-c6e6e8a0055b => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:08:00.139709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:00.141984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:00.142875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:00.150515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:00.150863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:00.151233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:00.175131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Going to try to stop instance {{(pid=122443) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:08:00.216746 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-91cc31d7-c846-4fca-948e-043f16f5129b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action" status: 202 len: 0 microversion: 2.1 time: 0.081126 Sep 14 10:08:00.217359 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1761/5637] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:08:00 2022] POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:08:00.226147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:00.227171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:00.235917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:00.236505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:00.236979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:00.237898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:00.238501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:00.238956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:00.373069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:00.381106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b95a380b-e298-4c18-b441-67eaecd60fe3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.159241 Sep 14 10:08:00.381699 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3877/5638] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:00 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:01.410092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:01.410802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:01.417154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:01.417640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:01.418081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:01.418771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:01.419228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:01.419655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:01.555133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:01.563584 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b376cbbc-db11-4e5c-9c13-392db7f6c9d3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.158890 Sep 14 10:08:01.564193 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1762/5639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:01 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:02.588019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:02.588841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:02.597446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:02.597951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:02.598400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:02.599118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:02.599722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:02.600230 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:02.732228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:02.741219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64d617b5-75bb-4a58-b551-96544679bd8b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.157324 Sep 14 10:08:02.741804 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3878/5640] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:02 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:03.767567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:03.768191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:03.774156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:03.774662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:03.775143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:03.775827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:03.776300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:03.776720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:03.910827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:03.919069 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-69453af2-e47b-4a59-aeb7-8f216bbedb67 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.157034 Sep 14 10:08:03.919655 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1763/5641] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:03 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:04.942754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:04.943425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:04.951109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:04.951619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:04.952184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:04.952861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:04.953332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:04.953781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:05.091761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:05.099756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2153478d-0b08-4a14-bf4f-6f5b50df09df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.160982 Sep 14 10:08:05.100363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3879/5642] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:04 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:06.123607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:06.124260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:06.131018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:06.131486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:06.131933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:06.132618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:06.133066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:06.133541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:06.267479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:06.277294 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-90a159a9-0394-4197-ac3e-d2bdeae9588d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.157549 Sep 14 10:08:06.277878 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1764/5643] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:06 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:07.302208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:07.302842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:07.309990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:07.310509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:07.310943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:07.311657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:07.312156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:07.312599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:07.446895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:07.455159 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d85fd8e-5311-47ac-9039-b8f6a2b091f8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.156818 Sep 14 10:08:07.455738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3880/5644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:07 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:08.481143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:08.481720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:08.488963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:08.489440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:08.489871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:08.490552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:08.491000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:08.491417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:08.632274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:08.640227 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cfe62208-1f27-4bb5-8d5b-afb264492164 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.163753 Sep 14 10:08:08.640797 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1765/5645] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:08 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:09.663150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:09.663797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:09.670877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:09.671475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:09.671955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:09.672875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:09.673345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:09.673781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:09.811394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:09.819143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2560e0e5-3276-4ab1-ac4b-952364598660 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1678 microversion: 2.1 time: 0.159879 Sep 14 10:08:09.819715 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3881/5646] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:09 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:10.844320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:10.845169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:10.853324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:10.853808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:10.854255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:10.854957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:10.855412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:10.855848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:10.990043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:10.998290 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c9189a1d-daba-4192-bbc3-8558b432af5e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1655 microversion: 2.1 time: 0.158502 Sep 14 10:08:10.998872 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1766/5647] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:10 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:11.021218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:11.028904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:11.029426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:11.029879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:11.052074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Going to try to start instance {{(pid=122444) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:08:11.094249 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-35ee0515-2c55-4483-9f48-478dd329783f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action" status: 202 len: 0 microversion: 2.1 time: 0.076742 Sep 14 10:08:11.094954 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3882/5648] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:08:11 2022] POST /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:08:11.103511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:11.104155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:11.110160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:11.110966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:11.111366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:11.112377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:11.112877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:11.113399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:11.261998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:11.270037 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-408ba7f6-cc0d-43dd-b5aa-47a343da5de2 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1664 microversion: 2.1 time: 0.170809 Sep 14 10:08:11.270660 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1767/5649] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:11 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:12.295628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:12.296400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:12.303104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:12.303619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:12.304118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:12.305380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:12.305880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:12.306322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:12.442623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:12.451759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3faa99fc-bfe9-4899-bd9d-2c75229200ad tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1668 microversion: 2.1 time: 0.161586 Sep 14 10:08:12.452447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3883/5650] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:12 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:45.278032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:45.280678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:45.282897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=14 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:45.283670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:45.289866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.290357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.290800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.291501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.291980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.292408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.325648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-800de225-915e-4e33-a7c0-c6dd1711032e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051880 Sep 14 10:08:45.326220 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1768/5651] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:08:45 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:08:45.391754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:45.392330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:45.394895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:45.395593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:08:45.402284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.402785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.403236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.403976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.404446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.404881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.431973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:08:45.507869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31dc270f-1403-4660-8652-68879348ea1d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 204 len: 0 microversion: 2.1 time: 0.119723 Sep 14 10:08:45.508898 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3884/5652] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:08:45 2022] DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:08:45.517107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:45.517723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:45.524199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.524690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.525128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.525818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:45.526274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:45.526697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:45.658744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:45.667444 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85367483-0926-45cd-beea-a5675ef18878 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1674 microversion: 2.1 time: 0.154157 Sep 14 10:08:45.668053 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1769/5653] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:45 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:08:46.692155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:46.692919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:46.700522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:46.701037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:46.701484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:46.702217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:46.702694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:46.703129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:46.855247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:46.863205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05d1ee53-cb63-4643-918b-11aa590ea462 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1674 microversion: 2.1 time: 0.175572 Sep 14 10:08:46.863782 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3885/5654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:46 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:47.887644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:47.889111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:47.896770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:47.898951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:47.899057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:47.899718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:47.900212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:47.900646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:47.980353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:47.988108 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cef7d169-a676-4815-a6f0-193ece0deb0f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 200 len: 1606 microversion: 2.1 time: 0.104694 Sep 14 10:08:47.988701 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1770/5655] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:47 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 1606 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:08:48.392443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed50adea-5eaa-486c-b6bf-c8be95ec0392", "name": "network-vif-deleted", "tag": "8b3020d0-de5f-4aef-89e1-179ba20b990b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:48.408259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:48.408760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:48.409205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:48.421648 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] Creating event network-vif-deleted:8b3020d0-de5f-4aef-89e1-179ba20b990b for instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 on n-h2-851028-12 Sep 14 10:08:48.426883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7eb042a3-036f-4d13-adbe-a42e77f51345 req-e1069a39-6679-4c29-be33-cc2dd02e0ecc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224365 Sep 14 10:08:48.427490 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3886/5656] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:49.013628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:49.014339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:49.021362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:49.021931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:49.022559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:49.023349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:49.023915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:49.024427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:49.039160 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 HTTP/1.1 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ed50adea-5eaa-486c-b6bf-c8be95ec0392'} Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:08:49.041029 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af0da7ff-377c-47cb-b021-a465e89fb759 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 404 len: 111 microversion: 2.1 time: 0.032848 Sep 14 10:08:49.046588 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1771/5657] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:49 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:08:49.052023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a465d58-d2f4-423a-afb2-b9fe044d42cb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '.version_select at 0x7f693dc85ee0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:49.074991 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a465d58-d2f4-423a-afb2-b9fe044d42cb tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848244319" status: 202 len: 0 microversion: 2.1 time: 0.027064 Sep 14 10:08:49.075601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3887/5658] 10.222.0.90 () {58 vars in 1221 bytes} [Wed Sep 14 10:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1848244319 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:08:49.731254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0c58d39e-969d-4573-8c04-8c3b80b236bd tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: .version_select at 0x7f693f286ee0>, body: {"keypair": {"name": "tempest-keypair-813763714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoBd+h0dNE3uaAy7gh8p0Dcho+j560TtaiRgI5b6nZh3prtm7oZValUc2L2LSSNC3g5rbragfjYZdiLFobjg7Z0vx0DhlwF5IxZXl/75s4HMF/yNpUjtQXxIdfe/QmzEQ=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:49.749422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0c58d39e-969d-4573-8c04-8c3b80b236bd tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for project d0263098aeeb4022a35bf9549acc980c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:08:49.754517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0c58d39e-969d-4573-8c04-8c3b80b236bd tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for user 75b4506b5a5245218ce16eb7564d5c31 and project d0263098aeeb4022a35bf9549acc980c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:08:49.779087 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0c58d39e-969d-4573-8c04-8c3b80b236bd tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051729 Sep 14 10:08:49.779730 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1772/5659] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:08:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:51.090258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1970590242", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a3bf139b-9ad6-47b7-a61f-ccba687294ba"}], "security_groups": [{"name": "tempest-securitygroup--1416919741"}], "key_name": "tempest-keypair-813763714", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:51.200076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] validate_networks() for [('a3bf139b-9ad6-47b7-a61f-ccba687294ba', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:08:51.636620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:08:51.637083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:08:51.637659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:08:51.638101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:08:51.638528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:08:51.647940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:51.648441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:51.648886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:51.649671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:51.650087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:51.650523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:51.668349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for project d0263098aeeb4022a35bf9549acc980c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:08:51.673720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Getting quotas for user 75b4506b5a5245218ce16eb7564d5c31 and project d0263098aeeb4022a35bf9549acc980c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:08:51.686264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:08:51.688833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:08:51.738450 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f912569e-6e9b-4cbd-8685-097624a7c440 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653849 Sep 14 10:08:51.739261 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3888/5660] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:08:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:08:51.752148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41cc9c31-a407-4374-bab3-24edec901b72 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:51.752786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41cc9c31-a407-4374-bab3-24edec901b72 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:51.822373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-41cc9c31-a407-4374-bab3-24edec901b72 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:51.829831 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41cc9c31-a407-4374-bab3-24edec901b72 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1237 microversion: 2.1 time: 0.083015 Sep 14 10:08:51.830409 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1773/5661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:51 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:52.856018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:52.856793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:52.866461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:52.867588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:52.868091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:52.868886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:52.869741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:52.870559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:52.936583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:52.945797 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60d06d48-7224-4908-b63c-ad2657a6b2c8 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1295 microversion: 2.1 time: 0.096227 Sep 14 10:08:52.946390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3889/5662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:52 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:53.970968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:53.971718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:53.979716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:53.980828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:53.980828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:53.981559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:53.982030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:53.982453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:54.176275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:54.184797 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ca6e5093-841e-4849-8d8a-3be94102665d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.218615 Sep 14 10:08:54.185600 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1774/5663] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:53 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:54.266935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e22c2eb-0b4c-4e25-9171-2bbaf3106907", "tag": "20f15c62-e380-4ff7-8c72-9c4bc5f6a89c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:54.280422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:54.281224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:54.281675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:54.294743 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] Creating event network-changed:20f15c62-e380-4ff7-8c72-9c4bc5f6a89c for instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 on n-h2-851028-12 Sep 14 10:08:54.299743 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c78f04d7-f9bc-439f-a32a-45f3e728489b req-1793e7f9-5d00-4714-b4e8-d8cb920cdaf8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037061 Sep 14 10:08:54.300393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3890/5664] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:55.208711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:55.209994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:55.217036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:55.217512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:55.217941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:55.218622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:55.219069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:55.219516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:55.352026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:55.359713 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f7faf586-cb17-49c9-81dd-bd9bba5ca46b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.155039 Sep 14 10:08:55.360321 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1775/5665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:55 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:56.385817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:56.386577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:56.392903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:56.393414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:56.393870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:56.394590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:56.395065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:56.395514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:56.528149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:56.536067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a2120293-928b-4d5d-bc90-eeb2c707c455 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.156367 Sep 14 10:08:56.536716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3891/5666] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:56 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:57.560570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:57.561169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:57.567964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:57.568445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:57.568876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:57.570225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:57.570678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:57.571099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:57.703646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:57.712223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-af11ec35-cac9-48b3-b5a0-3b296b7bb99e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.155529 Sep 14 10:08:57.712815 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1776/5667] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:57 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:58.735672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:58.736327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:58.743529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:58.744061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:58.744511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:58.745218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:58.745682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:58.746118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:58.892237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:08:58.900736 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a912dd16-bb66-40f0-8f8d-99759e6027c1 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.168989 Sep 14 10:08:58.901320 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3892/5668] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:58 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:08:59.892030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e22c2eb-0b4c-4e25-9171-2bbaf3106907", "name": "network-vif-plugged", "status": "completed", "tag": "20f15c62-e380-4ff7-8c72-9c4bc5f6a89c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:08:59.902307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:59.902718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:59.903145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:59.916434 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] Creating event network-vif-plugged:20f15c62-e380-4ff7-8c72-9c4bc5f6a89c for instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 on n-h2-851028-12 Sep 14 10:08:59.921605 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7766b407-e353-4d54-afd8-0592b9cfd03b req-55f51aba-d718-40cd-885e-0256c011e742 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108034 Sep 14 10:08:59.922221 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1777/5669] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:08:59.923744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:08:59.924508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:08:59.932123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:59.932628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:59.933092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:08:59.933857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:08:59.934336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:08:59.934783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:00.080370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:00.088288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0be38bf-beeb-4155-a7fb-5002d8f94542 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1363 microversion: 2.1 time: 0.168592 Sep 14 10:09:00.088889 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3893/5670] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:08:59 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:09:01.111920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:01.112642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:01.119411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:01.119916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:01.120353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:01.121042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:01.121495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:01.121920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:01.265482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:09:01.273602 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-39f980e3-7798-4c3a-98e2-9895cce9083b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1549 microversion: 2.1 time: 0.166726 Sep 14 10:09:01.274181 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1778/5671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:09:01 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:09:01.296749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:01.297295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:01.305057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:01.305555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:01.306002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:01.306722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:01.307184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:01.307620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:01.390760 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a19a456f-e520-4c47-a6d0-8cd552505ad4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098071 Sep 14 10:09:01.391405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3894/5672] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:09:01 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:02.388211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e22c2eb-0b4c-4e25-9171-2bbaf3106907", "tag": "20f15c62-e380-4ff7-8c72-9c4bc5f6a89c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:02.393805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:02.400876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:02.401371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:02.401806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:02.413777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] Creating event network-changed:20f15c62-e380-4ff7-8c72-9c4bc5f6a89c for instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 on n-h2-851028-12 Sep 14 10:09:02.419259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-86bd0970-895e-4318-917b-b0a075615a74 req-a62a36eb-3acf-47ea-83d7-bd19038d9efe service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034606 Sep 14 10:09:02.419970 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1779/5673] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:38.294146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:38.295020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:38.296981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:38.297811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:38.302647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:38.303154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:38.312756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:38.313259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:38.313714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:38.314426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:38.314893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:38.315344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:38.342258 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f815b506-4904-4d9e-a551-e5ecd8a53139 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/ips" status: 200 len: 146 microversion: 2.1 time: 0.048903 Sep 14 10:09:38.342834 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3895/5674] 10.222.0.90 () {58 vars in 1248 bytes} [Wed Sep 14 10:09:38 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:39.689190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:39.690022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=48 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:39.694439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bec885bf-a33a-4743-bfbf-a642305ac403"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:39.697611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:39.705323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:39.705810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:39.706248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:39.706943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:39.707402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:39.707835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:39.953847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b7d3599d-f3ee-4620-bf8a-a59a6895c88d tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266444 Sep 14 10:09:39.954480 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1780/5675] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:09:39 2022] POST /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:50.716993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:50.719195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:50.721582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:50.722363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:50.729186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.729690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.730137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.730845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.731322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.731765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.763024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4a0d7d17-467c-4f22-9035-28bc2b82fec4 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050014 Sep 14 10:09:50.763608 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3896/5676] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:09:50 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:50.775023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:09:50.775599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:50.778253 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:09:50.778403 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403 (ip 10.222.0.90) !!! Sep 14 10:09:50.779971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:50.780651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:09:50.787947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.789013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.789448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.790144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:50.790619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:50.791040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:50.822770 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5167d83e-08e9-4637-8303-8e7e8d389b31 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403" status: 200 len: 194 microversion: 2.1 time: 0.052054 Sep 14 10:09:50.823377 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1781/5677] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Sep 14 10:09:50 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:09:52.170619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc658a0c-7241-4798-81b9-881060ed4e3c"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:09:52.173059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:09:52.180561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:52.181075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:52.181527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:52.182247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:09:52.182712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:09:52.183185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:09:52.431098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21cdd965-e2c1-4f63-bb36-f617c8dc12b9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "POST /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264558 Sep 14 10:09:52.431720 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3897/5678] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:09:52 2022] POST /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:10:03.152719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:03.155048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:03.157849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:03.158515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:03.164925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.165431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.165921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.166634 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.167093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.167520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.199095 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-91bb93db-be6d-4cff-9e1f-fbc583bca3ea tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050332 Sep 14 10:10:03.199671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1782/5679] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:10:03 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:10:03.340207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:03.340774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:03.343622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:03.344344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:10:03.350610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.351123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.351562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.352526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.352999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.353441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.383872 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c537700d-fef3-4ee3-97b4-0ce8c8b5a930 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403" status: 200 len: 194 microversion: 2.1 time: 0.048899 Sep 14 10:10:03.384511 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3898/5680] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Sep 14 10:10:03 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:10:03.402073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:03.402675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:03.410134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.410635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.411075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.411779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:03.412262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:03.413533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:03.494414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lazy-loading 'services' on Instance uuid 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:10:03.567923 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07feed0b-f1d0-40fe-aa16-d789fe080c6e tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403" status: 202 len: 0 microversion: 2.1 time: 0.176062 Sep 14 10:10:03.568529 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1783/5681] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:10:03 2022] DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bec885bf-a33a-4743-bfbf-a642305ac403 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:10:08.951490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:08.952097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:08.958771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:08.959307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:08.959801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:08.960559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:08.961025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:08.961490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:08.991348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af66125c-9c21-4166-abb0-c333f7a2c45b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bc658a0c-7241-4798-81b9-881060ed4e3c" status: 200 len: 194 microversion: 2.1 time: 0.043077 Sep 14 10:10:08.992231 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3899/5682] 10.222.0.90 () {58 vars in 1413 bytes} [Wed Sep 14 10:10:08 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bc658a0c-7241-4798-81b9-881060ed4e3c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:10:09.004065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:09.004648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:09.014881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:09.015702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:09.016181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:09.016885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:09.017344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:09.017776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:09.097838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lazy-loading 'services' on Instance uuid 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:10:09.170542 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f10ad01-907a-414a-a654-12c9edab5a5a tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bc658a0c-7241-4798-81b9-881060ed4e3c" status: 202 len: 0 microversion: 2.1 time: 0.171369 Sep 14 10:10:09.171137 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1784/5683] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:10:08 2022] DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments/bc658a0c-7241-4798-81b9-881060ed4e3c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:10:14.598728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:14.601281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:14.607853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.608389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.608845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.609560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.610037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.610483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.641519 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bc124b68-5606-420f-a8b5-7acc40bab2f6 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047157 Sep 14 10:10:14.642094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3900/5684] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:10:14 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:10:14.761642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:14.763848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:14.769972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.770473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.770903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.771587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.772578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.773003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.802517 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3053e7c-cf87-4ff0-94e3-576b7525c167 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046879 Sep 14 10:10:14.803103 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1785/5685] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:10:14 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:10:14.866935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:14.867487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:14.873544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.874048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.874505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.875216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.875688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.876169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.902533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:10:14.981535 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36ba86ce-56f3-4a51-9c64-ad2470744d6b tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 204 len: 0 microversion: 2.1 time: 0.118343 Sep 14 10:10:14.982139 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3901/5686] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:10:14 2022] DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:10:14.990761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:14.991280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:14.997400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.997887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.998327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:14.999022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:14.999479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:14.999925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:15.136250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:15.144192 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c796dbe-b319-43b1-a6da-652a9e9878df tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1674 microversion: 2.1 time: 0.157636 Sep 14 10:10:15.144774 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1786/5687] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:14 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:16.169295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:16.170008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:16.177070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:16.177735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:16.178691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:16.179233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:16.179916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:16.180386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:16.316059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:16.327486 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-18b404d7-1081-4023-bfd5-24cfc5f01cc3 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1674 microversion: 2.1 time: 0.162096 Sep 14 10:10:16.332268 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3902/5688] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:16 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:17.353864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:17.354690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:17.361932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.362423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.362924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.363630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.364124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.364753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.597404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b4506b5a5245218ce16eb7564d5c31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0263098aeeb4022a35bf9549acc980c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:10:17.606974 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-169ac8ca-6108-49bf-9301-f1447da49bd9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 200 len: 1674 microversion: 2.1 time: 0.258029 Sep 14 10:10:17.622828 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1787/5689] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:17 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:10:17.870427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e22c2eb-0b4c-4e25-9171-2bbaf3106907", "name": "network-vif-deleted", "tag": "20f15c62-e380-4ff7-8c72-9c4bc5f6a89c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:10:17.884591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:17.885109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:17.885565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:17.899836 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] Creating event network-vif-deleted:20f15c62-e380-4ff7-8c72-9c4bc5f6a89c for instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 on n-h2-851028-12 Sep 14 10:10:17.905152 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1b900f02-3223-4ecf-bdfc-4a7dbfa9655d req-1aaceb22-ea89-483d-866d-b5e27aeb5003 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039840 Sep 14 10:10:17.905772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3903/5690] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:10:18.630682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:18.632350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:18.639570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:18.640107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:18.640548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:18.641258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:18.641713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:18.642145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:18.657013 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 HTTP/1.1 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3e22c2eb-0b4c-4e25-9171-2bbaf3106907'} Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:18.658672 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-baa9d6a7-a62e-4143-a872-dcd1790a2292 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 404 len: 111 microversion: 2.1 time: 0.033386 Sep 14 10:10:18.664302 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1788/5691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:18 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:10:18.671973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2669540-caa0-4ebf-b7f9-19037d81a0ee tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '.version_select at 0x7f693e1d95e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:18.693399 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2669540-caa0-4ebf-b7f9-19037d81a0ee tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-813763714" status: 202 len: 0 microversion: 2.1 time: 0.025425 Sep 14 10:10:18.694926 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3904/5692] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 10:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-813763714 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:10:25.840905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:25.841480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:25.847967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:25.848465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:25.848911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:25.850315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:25.851003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:25.851526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:25.867174 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 HTTP/1.1 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3e22c2eb-0b4c-4e25-9171-2bbaf3106907'} Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:10:25.868769 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae61d72e-224c-4e19-9f60-1553cb2e6eda tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 404 len: 111 microversion: 2.1 time: 0.033919 Sep 14 10:10:25.874167 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1789/5693] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:10:25 2022] DELETE /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:10:25.878917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:25.879669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: 3e22c2eb-0b4c-4e25-9171-2bbaf3106907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:25.888499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:25.889465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:25.890532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:25.891468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:25.891969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:25.892417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:25.906193 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 HTTP/1.1 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '3e22c2eb-0b4c-4e25-9171-2bbaf3106907'} Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:25.907910 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance 3e22c2eb-0b4c-4e25-9171-2bbaf3106907 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-219a9c29-9990-4861-bd2f-f9a941f3a955 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907" status: 404 len: 111 microversion: 2.1 time: 0.034360 Sep 14 10:10:25.913393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3905/5694] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:25 2022] GET /compute/v2.1/servers/3e22c2eb-0b4c-4e25-9171-2bbaf3106907 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:10:29.171868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:29.172445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:29.179433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:29.179943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:29.180426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:29.181128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:29.181574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:29.181991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:29.198579 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 HTTP/1.1 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ed50adea-5eaa-486c-b6bf-c8be95ec0392'} Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:10:29.200191 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9a7278bd-0d24-4917-8bcf-1bb5404093e9 tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 404 len: 111 microversion: 2.1 time: 0.033588 Sep 14 10:10:29.205365 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1790/5695] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:10:29 2022] DELETE /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:10:29.211129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:10:29.211757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] [instance: ed50adea-5eaa-486c-b6bf-c8be95ec0392] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:10:29.218708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:29.219209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:29.219670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:29.220415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:10:29.220880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:10:29.221314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:10:29.234694 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] HTTP exception thrown: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Request method failure captured: Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 HTTP/1.1 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIaeH1wk5r8IapmuiM2sjw_6mwFAlxP2S0MAJH2DzU9AipshKU22L0gpvm9I2PndbPULzm6LV6ohnczb4AUU1JEmw6MiiOiumsLu-iCZkG6REkOSAyRS4IGsDB3PG7MXOJmNmbCFQyyaMYVwNTPkl3B1kCssdWkNH8xeB0vvbMeQIapk Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d0263098aeeb4022a35bf9549acc980c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d0263098aeeb4022a35bf9549acc980c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d0263098aeeb4022a35bf9549acc980c"}]}] Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d0263098aeeb4022a35bf9549acc980c Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-999800552 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 75b4506b5a5245218ce16eb7564d5c31 Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-AttachVolumeTestJSON-999800552-project Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ed50adea-5eaa-486c-b6bf-c8be95ec0392'} Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:10:29.236451 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] Returning 404 to user: Instance ed50adea-5eaa-486c-b6bf-c8be95ec0392 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:10:29.242168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94ba6be1-dc72-4204-8d9e-b8bb78873e6f tempest-AttachVolumeTestJSON-999800552 tempest-AttachVolumeTestJSON-999800552-project] 10.222.0.90 "GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392" status: 404 len: 111 microversion: 2.1 time: 0.031674 Sep 14 10:10:29.243406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3906/5696] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:10:29 2022] GET /compute/v2.1/servers/ed50adea-5eaa-486c-b6bf-c8be95ec0392 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:14:12.887502 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:14:12.888468 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:14:12.889178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=18 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:12.889917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:12.891206 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:14:12.891360 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 10:14:12.892598 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:14:12.892755 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 10:14:12.893803 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:14:12.893911 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.90) !!! Sep 14 10:14:12.899700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1809392788", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:13.216545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:14:13.534305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:14:13.534739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:14:13.535219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:14:13.535763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:14:13.536745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:14:13.546276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:13.546767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:13.547407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:13.548177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:13.548638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:13.549067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:13.569126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Getting quotas for project d8fba55a01b34f58b9410bc89ee31e83. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:14:13.574607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Getting quotas for user 294c0199dde0407eaf50ec6e02aac67c and project d8fba55a01b34f58b9410bc89ee31e83. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:14:13.588093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:14:13.590433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:14:13.639387 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-992af4ee-853e-44ab-b7b0-facc97ca9b1e tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753782 Sep 14 10:14:13.646700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1791/5697] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:14:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:14:13.650404 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:14:13.651696 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:14:13.652319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:13.653271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:13.654501 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:14:13.654656 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 (ip 10.222.0.90) !!! Sep 14 10:14:13.656079 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:14:13.656240 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 (ip 10.222.0.90) !!! Sep 14 10:14:13.658718 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:14:13.658851 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 (ip 10.222.0.90) !!! Sep 14 10:14:13.666745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-061bce97-23dd-439c-9936-879508310eeb tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:13.667641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-061bce97-23dd-439c-9936-879508310eeb tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:13.949586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-061bce97-23dd-439c-9936-879508310eeb tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:13.957054 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-061bce97-23dd-439c-9936-879508310eeb tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1215 microversion: 2.1 time: 0.308696 Sep 14 10:14:13.957661 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3907/5698] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:13 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1215 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:14.981903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:14.982517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:14.992258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:14.992746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:14.993183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:14.993877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:14.994329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:14.994756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:14.998759 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 50272. Sep 14 10:14:14.999686 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 50270. Sep 14 10:14:15.089686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:15.097777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-771ed960-c8bf-45d1-8f70-5f24c8396839 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1273 microversion: 2.1 time: 0.121722 Sep 14 10:14:15.098748 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1792/5699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:14 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:16.121473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:16.122154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:16.135332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:16.135850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:16.136333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:16.137067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:16.137542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:16.138018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:16.160031 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 50278. Sep 14 10:14:16.160980 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 50280. Sep 14 10:14:16.289615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:16.298074 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be14e4a5-4915-429e-a746-9ce4b7a9fac4 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.180509 Sep 14 10:14:16.298792 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3908/5700] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:16 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:16.877881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d99c4b-d841-481d-90bf-4c6eb5a39006", "tag": "6b91cbb7-a446-413c-aa17-3ce3cd5b81a0"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:16.890099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:16.890587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:16.891004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:16.904244 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] Creating event network-changed:6b91cbb7-a446-413c-aa17-3ce3cd5b81a0 for instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 on n-h2-851028-12 Sep 14 10:14:16.910157 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-72651b6f-9be0-4009-bb3b-7b0cffd31072 req-451305c8-708e-41c1-a327-336591a95813 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089730 Sep 14 10:14:16.911361 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1793/5701] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:17.322301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:17.322940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:17.330084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:17.330590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:17.331049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:17.331767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:17.332327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:17.332970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:17.468863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:17.477828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19d969c7-9f17-40d6-88d3-ef0caedcf230 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.159508 Sep 14 10:14:17.478414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3909/5702] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:17 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:18.502410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:18.503117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:18.510423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:18.510926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:18.511372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:18.512134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:18.512596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:18.513026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:18.660055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:18.667939 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46d0a00f-a6e0-454c-91bc-21d558192950 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.170693 Sep 14 10:14:18.668524 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1794/5703] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:18 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:19.690663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:19.691298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:19.699190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:19.699702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:19.700189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:19.701115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:19.701387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:19.701834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:19.845677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:19.857791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1bce1486-aeed-4b66-840f-8088bb0452be tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.170978 Sep 14 10:14:19.858400 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3910/5704] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:19 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:20.881241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:20.881859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:20.888764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:20.889251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:20.889691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:20.890381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:20.890841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:20.891278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:21.025458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:21.033090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-019f8bc3-8bcc-4f54-8448-e8b1ab3ad122 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.155953 Sep 14 10:14:21.033659 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1795/5705] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:20 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:21.515832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d99c4b-d841-481d-90bf-4c6eb5a39006", "name": "network-vif-plugged", "status": "completed", "tag": "6b91cbb7-a446-413c-aa17-3ce3cd5b81a0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:21.526241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:21.526743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:21.527195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:21.539283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] Creating event network-vif-plugged:6b91cbb7-a446-413c-aa17-3ce3cd5b81a0 for instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 on n-h2-851028-12 Sep 14 10:14:21.545563 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-313d7430-6e6f-47a6-9970-d970d7f33890 req-7ba72a78-2769-4a7a-a646-577289b9fa4a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082258 Sep 14 10:14:21.546170 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3911/5706] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:22.056678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:22.057280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:22.064054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:22.064565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:22.064992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:22.065669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:22.066116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:22.066674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:22.203368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:22.211336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e26e5711-3154-4a51-91c4-527b942fda8c tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1315 microversion: 2.1 time: 0.158508 Sep 14 10:14:22.211936 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1796/5707] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:22 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:23.234601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:23.235324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:23.243437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.243970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.244468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.245195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.245673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.246121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.381858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:23.389695 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d838987d-06c4-4857-93fb-3f8491cf551a tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1465 microversion: 2.1 time: 0.159406 Sep 14 10:14:23.390269 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3912/5708] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:23 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1465 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:23.439919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:23.440476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:23.448060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.448541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.448975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.449658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.450110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.450532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.478639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:14:23.554764 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21186c58-cc4a-4813-85f4-47e925792586 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 204 len: 0 microversion: 2.1 time: 0.118342 Sep 14 10:14:23.555423 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1797/5709] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:14:23 2022] DELETE /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:14:23.564144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:23.564771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:23.571194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.571692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.572170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.572875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:23.573342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:23.573782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:23.704209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:23.712993 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-341c6ea9-1e68-499c-9151-34a963818a0d tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1471 microversion: 2.1 time: 0.152745 Sep 14 10:14:23.713580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3913/5710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:23 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:24.737447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:24.738150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:24.741423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:24.742295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:24.749402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:24.749896 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:24.750335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:24.751060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:24.751488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:24.751942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:24.969500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '294c0199dde0407eaf50ec6e02aac67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8fba55a01b34f58b9410bc89ee31e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:24.977461 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1613fb22-a79d-4c0a-b164-9ce3380560d2 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 200 len: 1471 microversion: 2.1 time: 0.244492 Sep 14 10:14:24.978046 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1798/5711] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:24 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:25.369522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d99c4b-d841-481d-90bf-4c6eb5a39006", "name": "network-vif-deleted", "tag": "6b91cbb7-a446-413c-aa17-3ce3cd5b81a0"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:25.375609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:25.382822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:25.383326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:25.383777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:25.402318 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] Creating event network-vif-deleted:6b91cbb7-a446-413c-aa17-3ce3cd5b81a0 for instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 on n-h2-851028-12 Sep 14 10:14:25.407342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c92e7352-f743-4284-ac4b-47a04b630ca1 req-f859dd77-b859-463f-88d2-4f60f6f340d8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041737 Sep 14 10:14:25.408644 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3914/5712] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:26.001148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:26.001757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] [instance: c6d99c4b-d841-481d-90bf-4c6eb5a39006] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:26.009464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:26.009884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:26.010311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:26.010994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:26.011443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:26.011865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:26.032308 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] HTTP exception thrown: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Request method failure captured: Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 HTTP/1.1 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIalzOm0uW0J4J8SExVi_pDYRYZqtMFkz5mbTJr9wiJItEVl3j71cINa3lLtJgKmS2FD9d5aGOwwMYHKVz5LkQI6PW5x3Gwuxk_HXMTZ0afnNEiO3fiASj7iEYEzSd5uuW1HEkIM3pR1uc0ozu8XBSsNssVbMp32Zr36158j39FNEceE Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d8fba55a01b34f58b9410bc89ee31e83 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-VolumesNegativeTest-956453414 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d8fba55a01b34f58b9410bc89ee31e83", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8fba55a01b34f58b9410bc89ee31e83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8fba55a01b34f58b9410bc89ee31e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d8fba55a01b34f58b9410bc89ee31e83"}]}] Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-VolumesNegativeTest-956453414 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d8fba55a01b34f58b9410bc89ee31e83 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-VolumesNegativeTest-956453414 Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-VolumesNegativeTest-956453414-project Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 294c0199dde0407eaf50ec6e02aac67c Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-VolumesNegativeTest-956453414-project Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'c6d99c4b-d841-481d-90bf-4c6eb5a39006'} Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:14:26.033970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] Returning 404 to user: Instance c6d99c4b-d841-481d-90bf-4c6eb5a39006 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18cc7861-0aba-46a2-8509-8d9c93096f83 tempest-VolumesNegativeTest-956453414 tempest-VolumesNegativeTest-956453414-project] 10.222.0.90 "GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006" status: 404 len: 111 microversion: 2.1 time: 0.038151 Sep 14 10:14:26.069170 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1799/5713] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:25 2022] GET /compute/v2.1/servers/c6d99c4b-d841-481d-90bf-4c6eb5a39006 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:14:33.133867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7027a9df-3bdb-472a-a0c6-5cc571b86b83 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: .version_select at 0x7f693df63430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-46703761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGgLJEnJ0BQc5xqd0+y2S8B5ZWKRz/muv4NiS2Ya5+EuFPOYW7aO7e9k62yrgzA4Sf9rlqov02UQRrEkIcVFVEsFiGAqxx6+3lu8JKgoFIE8YxesT72FYtSygonAnMWrA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:33.150381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7027a9df-3bdb-472a-a0c6-5cc571b86b83 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:14:33.156345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7027a9df-3bdb-472a-a0c6-5cc571b86b83 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:14:33.187234 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7027a9df-3bdb-472a-a0c6-5cc571b86b83 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.219913 Sep 14 10:14:33.187871 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3915/5714] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:14:32 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:39.180549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-826415936", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "8012734b-1729-40dd-af10-06593baf7ae4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-46703761", "security_groups": [{"name": "tempest-secgroup-smoke-1070492531"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:39.190408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:39.191692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:39.317903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] validate_networks() for [('8012734b-1729-40dd-af10-06593baf7ae4', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:14:39.948308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:14:39.949021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:14:39.949912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:14:39.950469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:14:39.950914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:14:39.964431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:39.964741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:39.965357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:39.966084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:39.966534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:39.966966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:39.989189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:14:39.997104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:14:40.013697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:14:40.017038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:14:40.071709 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9835a1c7-317f-433a-a120-ec13bf8173a7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.895468 Sep 14 10:14:40.072526 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1800/5715] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:14:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:14:40.082379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=34 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:40.086719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ccd9e29-a7cb-4c6d-b1ee-80244d48c4af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:40.094414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ccd9e29-a7cb-4c6d-b1ee-80244d48c4af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:40.177257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3ccd9e29-a7cb-4c6d-b1ee-80244d48c4af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:40.184929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ccd9e29-a7cb-4c6d-b1ee-80244d48c4af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1264 microversion: 2.1 time: 0.104229 Sep 14 10:14:40.185523 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3916/5716] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:40 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1264 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:41.209930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:41.211246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:41.218491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:41.218977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:41.219408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:41.220119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:41.220572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:41.220992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:41.287703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:41.296794 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03d7bd85-57d7-400f-b357-9d7620181e6d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1316 microversion: 2.1 time: 0.091929 Sep 14 10:14:41.297553 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1801/5717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:41 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:42.322911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:42.323456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:42.337360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:42.337867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:42.338320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:42.339044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:42.339510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:42.339985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:42.510491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:42.530299 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95c8a001-ec50-453f-bfdd-d2999882e14d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.213820 Sep 14 10:14:42.531293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3917/5718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:42 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:43.254245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:43.267863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.268366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.268994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.280810 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] Creating event network-changed:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h2-851028-12 Sep 14 10:14:43.287044 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9c04a832-6c3e-430e-b400-d3dd09696863 req-e6bab8af-9dbb-48fc-bb93-2fe2d5ef04c3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036489 Sep 14 10:14:43.287671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1802/5719] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:43.556350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:43.556988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:43.564327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.564837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.565458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.566245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:43.567007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:43.567582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:43.746215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:43.753205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c87296b-30e6-4a96-9183-9def330eeded tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.200882 Sep 14 10:14:43.753816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3918/5720] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:43 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:14:44.777029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:44.777732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:44.783993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:44.785076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:44.785479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:44.786189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:44.786652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:44.787075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:44.983758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:44.993614 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5bd149ff-263b-4efe-8581-f290ac97339a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.221764 Sep 14 10:14:44.994200 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1803/5721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:44 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:46.017500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:46.018156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:46.021429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:46.027034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.027536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.028035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.028795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:46.029277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:46.029726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:46.169932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:46.179202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79e6ca62-5c75-4481-aef9-bf99d3039941 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.165709 Sep 14 10:14:46.179796 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3919/5722] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:46 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:47.202575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:47.203181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:47.210615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:47.211099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:47.211529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:47.212241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:47.212688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:47.213105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:47.355189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:47.364355 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eef8e4df-02cb-4ff6-ac40-0d27cba6af95 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.165595 Sep 14 10:14:47.364972 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1804/5723] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:47 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:47.585557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "name": "network-vif-plugged", "status": "completed", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:47.597918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:47.598617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:47.599071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:47.610584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] Creating event network-vif-plugged:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h2-851028-12 Sep 14 10:14:47.616705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cbe1bf26-c438-436d-96eb-059c85eb8b1f req-70a0541e-a055-4b6d-8f4e-34f7b60490fb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 Sep 14 10:14:47.617312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3920/5724] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:48.389536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:48.390150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:48.397824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:48.398313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:48.398750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:48.399435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:48.399889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:48.400336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:48.535745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:48.543765 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12cf6f89-49a6-4f1a-9e4a-7515b04cc16d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1390 microversion: 2.1 time: 0.158150 Sep 14 10:14:48.544382 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1805/5725] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:48 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:49.568698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:49.569419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:49.575709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:49.576253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:49.576706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:49.577465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:49.578118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:49.578743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:49.718871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:49.727961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5f5f1e7-5334-4898-a7ec-951c78678dbf tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1562 microversion: 2.1 time: 0.164807 Sep 14 10:14:49.728554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3921/5726] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:49 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:49.750493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:49.751097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:49.758064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:49.758540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:49.759069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:49.759759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:49.760307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:49.760740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:49.895925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:49.904108 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e8fd2ae-7a52-43b8-8c3f-173b8f647f8e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1562 microversion: 2.1 time: 0.157435 Sep 14 10:14:49.904691 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1806/5727] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:49 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:14:51.949855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:14:51.950810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:14:51.951862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:14:51.953472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:51.957274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:51.957957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:14:51.963538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:51.964233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:51.964696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:51.965435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:51.965530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:14:51.965913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:51.966013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:14:51.966359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:51.966459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:14:51.979969 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] Creating event network-changed:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h2-851028-12 Sep 14 10:14:51.985799 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7cf8ed45-ec25-4f59-b084-21cddb4e8cee req-3bc2f0a1-c550-44db-8244-62a7a39587e9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037440 Sep 14 10:14:51.987064 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1807/5728] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:14:52.135725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:14:52.146729 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb7e1a25-c133-477c-9304-53e96515930f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1562 microversion: 2.1 time: 0.200684 Sep 14 10:14:52.147576 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3922/5729] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:14:51 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1562 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:15:15.412023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:15.412883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=36 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:15.417495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:15.419741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:15.427061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:15.427560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:15.428052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:15.428756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:15.429213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:15.429644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:15.486756 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a85776cf-16a7-404a-bd30-b7133ac023eb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action" status: 200 len: 24567 microversion: 2.1 time: 0.077267 Sep 14 10:15:15.487431 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1808/5730] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:15:15 2022] POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:15:21.960444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:21.961206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:21.963810 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:21.964613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:15:21.973086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:21.974174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:21.974633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:21.975363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:21.975877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:21.976352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.211095 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41c88e02-c49d-4bf1-ba31-45558c91b1ad tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1834 microversion: 2.1 time: 0.255578 Sep 14 10:15:22.211724 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3923/5731] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:21 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1834 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:22.236291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:22.236997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:22.244837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.245343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.245757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.246455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.246907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.247337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.386705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:22.394627 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-034fd8d3-da73-4159-8a19-019b47320231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1681 microversion: 2.1 time: 0.163464 Sep 14 10:15:22.395202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1809/5732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:22 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:22.500352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:22.502548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:22.509805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.510309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.510773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.511485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.511994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.512441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.570216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4f0804a-0dd6-4752-9e20-79055d57be9e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action" status: 200 len: 32641 microversion: 2.1 time: 0.073635 Sep 14 10:15:22.570883 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3924/5733] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:15:22 2022] POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action => generated 32641 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:15:22.820232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:22.820809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:22.829469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.829958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.830396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.831088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:22.831543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:22.832001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:22.920585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0d213f3197d45b496eb8ca5d93949ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c796fe410e214ce4a575ac982a29c16a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:22.921186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] flavor_id is None. Assuming migration. {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 10:15:22.921657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:15:23.180282 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d2908fee-d5bf-4d7b-b6d0-83e163b247b5 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action" status: 202 len: 0 microversion: 2.1 time: 0.364147 Sep 14 10:15:23.181102 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1810/5734] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:15:22 2022] POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:15:23.189748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:23.190488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:23.198770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:23.199291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:23.199757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:23.200525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:23.201007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:23.201465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:23.343710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:23.351973 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-50697574-0ca5-4c6d-8eff-25e04e1c60d6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1690 microversion: 2.1 time: 0.166421 Sep 14 10:15:23.352763 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3925/5735] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:23 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:24.376386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:24.377121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:24.385677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:24.386169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:24.386609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:24.387311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:24.387789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:24.388237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:24.526360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:24.535221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c931ea78-2aa8-4252-9a37-1d5b954ff67b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1690 microversion: 2.1 time: 0.163634 Sep 14 10:15:24.535811 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1811/5736] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:24 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:25.559330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:25.559979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:25.571491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:25.572049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:25.572543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:25.573515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:25.574048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:25.574509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:25.709971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:25.718209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d80c2b1d-5d84-42ed-991d-26363e7e1c8b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.162824 Sep 14 10:15:25.718816 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3926/5737] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:25 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:15:26.743155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:26.743766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:26.750682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:26.751196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:26.751629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:26.752355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:26.752808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:26.753231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:26.884904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:26.892775 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02bda14e-5964-4291-aea8-c4adb58476d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.153975 Sep 14 10:15:26.893357 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1812/5738] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:26 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:27.915603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:27.916325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:27.923222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:27.923731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:27.924220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:27.924956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:27.925417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:27.925865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:28.059110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:28.067015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3fa3921b-f7c1-4f56-a11d-9e54b1fd3e90 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.155576 Sep 14 10:15:28.067668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3927/5739] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:27 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:29.090725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:29.091332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:29.098486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:29.098965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:29.100276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:29.101053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:29.101506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:29.101930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:29.240260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:29.248094 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-26193945-0859-432c-9b8d-bef992924a82 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.161167 Sep 14 10:15:29.248671 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1813/5740] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:29 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:30.273021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:30.273698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:30.280633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:30.281133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:30.281586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:30.282580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:30.283056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:30.283514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:30.422265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:30.431036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7ef75e6-8b31-4769-ba05-dd2d4482615c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.162734 Sep 14 10:15:30.431631 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3928/5741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:30 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:31.454668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:31.455184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:31.462101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:31.462572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:31.462997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:31.463674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:31.464156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:31.464576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:31.604691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:31.612423 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-54e9c7c0-e7b4-4793-943d-c921a4d6c073 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.161719 Sep 14 10:15:31.613003 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1814/5742] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:31 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:32.638341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:32.638973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:32.646803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:32.647534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:32.647983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:32.648728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:32.649204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:32.649653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:32.793274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:32.801385 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c647d108-24d3-4a9a-b234-1f335659e243 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.167163 Sep 14 10:15:32.801973 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3929/5743] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:32 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:33.825974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:33.826580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:33.834661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:33.835154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:33.835588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:33.836309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:33.836756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:33.837178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:33.972466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:33.980543 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4fd9989b-8551-4099-9602-b9e56f25db45 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.158494 Sep 14 10:15:33.981115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1815/5744] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:33 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:35.002886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:35.003516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:35.011027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:35.011534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:35.012032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:35.012748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:35.013224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:35.013668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:35.148795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:35.156714 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5e169099-29e5-426f-9515-d36725c7530a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.157890 Sep 14 10:15:35.157292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3930/5745] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:34 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:36.181235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:36.181852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:36.188713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:36.189197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:36.189638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:36.190335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:36.190791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:36.191216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:36.329533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:36.337659 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bd0ebc70-b843-4260-aace-2ad8c4aa9788 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1695 microversion: 2.1 time: 0.160761 Sep 14 10:15:36.338232 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1816/5746] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:36 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:37.361394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:37.362061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:37.369305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:37.369812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:37.370270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:37.370991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:37.371462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:37.371919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:37.624393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:37.633301 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ac8ff42-6ea9-4f43-b7be-7b37693c2494 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1694 microversion: 2.1 time: 0.275838 Sep 14 10:15:37.633906 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3931/5747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:37 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1694 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:38.261080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "name": "network-vif-unplugged", "status": "completed", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:38.270468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:38.270951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:38.271379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:38.284899 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Creating event network-vif-unplugged:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h1-851028-12 Sep 14 10:15:38.293068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:15:38.304468 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f09f952b-e08a-4d5a-be84-0e8677b5176a req-e4292ec4-ccfd-4d75-8384-f36e39bc0e07 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104495 Sep 14 10:15:38.304979 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1817/5748] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:15:38.658258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:38.659534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:38.667360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:38.667870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:38.668392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:38.669120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:38.669601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:38.670045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:38.898285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:38.906229 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ced1baac-800a-44e7-b5a4-a442d2357329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1694 microversion: 2.1 time: 0.251999 Sep 14 10:15:38.906839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3932/5749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:38 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:39.932675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:39.933459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:39.940231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:39.940710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:39.941143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:39.941834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:39.942351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:39.942779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:40.077859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:40.086060 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-52d15c72-4697-4392-9e45-c84c575a8214 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1692 microversion: 2.1 time: 0.159822 Sep 14 10:15:40.086637 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1818/5750] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:39 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:40.352860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:40.363309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:40.363811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:40.364301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:40.377854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Creating event network-changed:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h1-851028-12 Sep 14 10:15:40.384657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:15:40.395866 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-111210f1-119c-4efa-8f57-2aec84b4ec1f req-9c1f8155-35a9-4cf5-969b-19e1337c20b6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057657 Sep 14 10:15:40.396577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3933/5751] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:15:41.109658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:41.110283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:41.117670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.118157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.118598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.119288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.119739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.120218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.263922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:41.278054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8fde9ed2-e092-4e40-b682-21fc0f9204e3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1689 microversion: 2.1 time: 0.172203 Sep 14 10:15:41.278680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1819/5752] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:41 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:41.304873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:41.305523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:41.312019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.312494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.312950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.313667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.314293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.314890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.384219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a87d86a-844a-4946-828d-c4846ae02614 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action" status: 204 len: 0 microversion: 2.1 time: 0.085024 Sep 14 10:15:41.388393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3934/5753] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:15:41 2022] POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:15:41.393771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:41.394689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:41.401504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.402395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.403126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.404081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:41.404725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:41.405337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:41.652476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:41.660838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b718caa5-92b6-4fa9-98b7-ba865e86498f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1689 microversion: 2.1 time: 0.270907 Sep 14 10:15:41.661712 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1820/5754] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:41 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:42.686077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:15:42.686812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:15:42.694702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:42.695219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:42.695677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:42.696439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:42.696915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:42.698168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:42.946373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:15:42.954302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce84b019-9504-4cf1-b4f9-d955638e17d7 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1681 microversion: 2.1 time: 0.272631 Sep 14 10:15:42.955062 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3935/5755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:15:42 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:15:43.477076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "name": "network-vif-plugged", "status": "completed", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:15:43.487799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:15:43.488574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:15:43.489001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:15:43.503772 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] Creating event network-vif-plugged:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h1-851028-12 Sep 14 10:15:43.509962 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2be3b2ca-3f51-445e-a490-d789a8eeb545 req-5d3b3c57-7a55-47e4-b6a0-4d8538e35c23 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037150 Sep 14 10:15:43.510666 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1821/5756] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:05.206104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:05.208388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:05.211335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=26 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:05.212069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:05.221977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:05.222490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:05.222952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:05.223687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:05.224202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:05.224656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:05.277804 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c3c624a5-9f02-49cd-99a0-dafb3a34781a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action" status: 200 len: 24575 microversion: 2.1 time: 0.075532 Sep 14 10:16:05.278463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3936/5757] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:16:05 2022] POST /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d/action => generated 24575 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:16:11.459740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:11.460415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:11.465225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=30 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:11.465921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:11.475714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:11.476858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:11.477592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:11.478300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:11.478756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:11.479179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:11.612026 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2cd8fb8b-d5bf-4d54-b9e5-18389ac4c2d0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1834 microversion: 2.1 time: 0.156277 Sep 14 10:16:11.612609 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1822/5758] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:11 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1834 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:12.514864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:12.522596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:12.523374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:12.533923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:12.534154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:12.534439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:12.534809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:12.534918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:12.535245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:12.535742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:12.536541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:12.536756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:12.546776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] Creating event network-changed:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h1-851028-12 Sep 14 10:16:12.552162 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0ef91e5f-1a7a-486a-b171-3d9c65bcf8d5 req-141f0df5-a714-47f0-a1dc-114104d72577 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040895 Sep 14 10:16:12.552770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1823/5759] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:12.568103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:16:12.665040 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9921a4c5-8a91-44ea-afae-617cbb28b79c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 204 len: 0 microversion: 2.1 time: 0.156401 Sep 14 10:16:12.666270 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3937/5760] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:16:12 2022] DELETE /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:16:12.675501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:12.676305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:12.687205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:12.687879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:12.688400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:12.689186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:12.689646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:12.690073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:12.850240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:12.858906 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0c5c8811-913f-420f-bc40-37d685de84d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1687 microversion: 2.1 time: 0.188206 Sep 14 10:16:12.859500 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1824/5761] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:12 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:13.886575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:13.887307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:13.895290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:13.895932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:13.896384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:13.897118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:13.897597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:13.898214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:14.229766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:14.238561 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-142a7674-09f7-49ed-9e24-38410709feb4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 200 len: 1687 microversion: 2.1 time: 0.357519 Sep 14 10:16:14.239241 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3938/5762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:13 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 1687 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:14.624604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee68d1d1-af68-4a91-bb4c-22962a1c348d", "name": "network-vif-deleted", "tag": "91d6cab3-fce5-4b21-b909-0be616a81813"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:14.640491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:14.641085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:14.641553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:14.657427 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] Creating event network-vif-deleted:91d6cab3-fce5-4b21-b909-0be616a81813 for instance ee68d1d1-af68-4a91-bb4c-22962a1c348d on n-h1-851028-12 Sep 14 10:16:14.662795 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2da0b15b-79af-4d21-bec8-d010ef63908a req-0f514267-6078-47da-bf9e-1cd2c4fe9a41 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044095 Sep 14 10:16:14.663648 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1825/5763] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:15.268431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:15.269069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ee68d1d1-af68-4a91-bb4c-22962a1c348d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:15.276707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:15.277217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:15.277678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:15.278399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:15.278877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:15.279328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:15.293807 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] HTTP exception thrown: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Request method failure captured: Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d HTTP/1.1 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIamIwn3RJ2sV4qyfWlr30OzV_ISlamKzy4dn7OYMfGqc8Cun6CdN9vh8jEb2O_F_O8tOP_4EsShPcYfSJB4CdmM_m5W3BkOC_jT7qj2p_wBelFwpUhhIzGLJnilQti5MQ3XuEvMAnHnXydOswIfQWRI4FPooaVrNvr5P7iJmrsuIx_o Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36e1ed33e600400cacb79a98608cd2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36e1ed33e600400cacb79a98608cd2fd"}]}] Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0fd5e84c18c44fef9a307110ff93e368 Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ee68d1d1-af68-4a91-bb4c-22962a1c348d'} Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:16:15.296075 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Returning 404 to user: Instance ee68d1d1-af68-4a91-bb4c-22962a1c348d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-388ee67a-3b63-42d3-8bfb-ffed4387dc02 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d" status: 404 len: 111 microversion: 2.1 time: 0.033641 Sep 14 10:16:15.301158 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3939/5764] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:15 2022] GET /compute/v2.1/servers/ee68d1d1-af68-4a91-bb4c-22962a1c348d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:16:18.665696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18d6e902-6db0-4cbc-86dc-f660c9c51c14 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '.version_select at 0x7f693f6cf040>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:18.729868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18d6e902-6db0-4cbc-86dc-f660c9c51c14 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-46703761" status: 202 len: 0 microversion: 2.1 time: 0.073732 Sep 14 10:16:18.731115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1826/5765] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 10:16:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-46703761 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:16:18.759886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab964c93-8b20-40c4-bceb-aab8786c7cde tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: .version_select at 0x7f693dc85dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2106946443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaE4OerRdiAGDF/FFEEYQDN18EMy3JzdXFyFf3m81Wl6PPml5vivwUlbvwtIEZuXX/cTSQgPlpCrwPBqjxaz5Ss0b6c2KrzOfYiHQhTeCjiCZxtK4zExg8JK4XWq/yXEA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:18.780700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ab964c93-8b20-40c4-bceb-aab8786c7cde tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:16:18.787419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ab964c93-8b20-40c4-bceb-aab8786c7cde tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:16:18.825953 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab964c93-8b20-40c4-bceb-aab8786c7cde tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.070270 Sep 14 10:16:18.826825 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3940/5766] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:16:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:16:24.897043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-242540973", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "4f5a6c4f-55df-4769-8129-9a77c3734b43"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2106946443", "security_groups": [{"name": "tempest-secgroup-smoke-241123989"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:24.909146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=16 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:25.024225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] validate_networks() for [('4f5a6c4f-55df-4769-8129-9a77c3734b43', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:16:25.446989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:16:25.447449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:16:25.447943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:16:25.448354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:16:25.448767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:16:25.461153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:25.461872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:25.462312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:25.463054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:25.463503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:25.463949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:25.487434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:16:25.492827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:16:25.505484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:16:25.508903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:16:25.557739 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3aecbe64-4a05-4094-97d2-55d44d9dd910 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664806 Sep 14 10:16:25.563980 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1827/5767] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:16:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:16:25.568231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:25.573784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05ae60b0-b001-4e7c-9b05-ed9a21e63f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:25.574418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05ae60b0-b001-4e7c-9b05-ed9a21e63f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:25.649386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-05ae60b0-b001-4e7c-9b05-ed9a21e63f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:25.657139 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05ae60b0-b001-4e7c-9b05-ed9a21e63f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1266 microversion: 2.1 time: 0.090585 Sep 14 10:16:25.665302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3941/5768] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:25 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:26.684314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:26.685091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:26.697497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:26.701536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:26.701999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:26.702764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:26.703396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:26.704296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:26.804906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:26.817074 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee621a1f-1132-4ce6-bdfe-710f029e6fa6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1326 microversion: 2.1 time: 0.138653 Sep 14 10:16:26.817857 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1828/5769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:26 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:27.847819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:27.848642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:27.856617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:27.857141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:27.857591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:27.858344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:27.858988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:27.859433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:28.074408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:28.082282 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c393fb7-581a-4364-901d-645f6fd69eff tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.240278 Sep 14 10:16:28.083122 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3942/5770] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:27 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:16:28.418667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:28.434900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:28.435381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:28.435810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:28.461508 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] Creating event network-changed:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:16:28.466137 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-fadb981c-c3bf-48f2-bc89-5eee82f97209 req-55a47b0a-3d04-4561-9ebb-596aea38645b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051367 Sep 14 10:16:28.467661 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1829/5771] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:29.106563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:29.107198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:29.114547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:29.114784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:29.115250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:29.116009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:29.116495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:29.116946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:29.252596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:29.260536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8719b2d8-099a-4b34-946f-f676a08b801e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.157942 Sep 14 10:16:29.261115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3943/5772] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:29 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:30.283941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:30.284558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:30.291616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:30.292322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:30.292764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:30.293459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:30.293922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:30.294349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:30.428152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:30.436847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1b8f5f86-641b-4a73-bb8f-213068f760d3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.157435 Sep 14 10:16:30.437441 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1830/5773] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:30 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:16:31.460858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:31.461419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:31.468662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:31.469171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:31.469634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:31.470362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:31.470839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:31.471288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:31.604789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:31.612803 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3cae348-f294-40ec-b308-ac4f1c890b96 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.156781 Sep 14 10:16:31.613395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3944/5774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:31 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:32.636478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:32.637098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:32.644136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:32.644624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:32.645058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:32.645748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:32.646196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:32.646614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:32.790011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:32.798190 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-50543fa6-9130-48eb-927b-0b68c4cb5b2b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.166225 Sep 14 10:16:32.798970 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1831/5775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:32 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:33.786270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-plugged", "status": "completed", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:33.798665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:33.799172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:33.799629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:33.811800 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] Creating event network-vif-plugged:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:16:33.817547 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5c43e252-11ab-45e5-b6bc-7c8d239eb234 req-28d2073a-4f49-46f9-8b27-f56d42e6ceff service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Sep 14 10:16:33.818133 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3945/5776] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:33.824644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:33.825981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:33.832977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:33.833459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:33.834199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:33.835952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:33.836699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:33.837469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:33.976696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:33.984704 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-90c0ab02-dc5d-4201-8e0e-6b32336dab06 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.166276 Sep 14 10:16:33.985289 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1832/5777] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:33 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:35.009159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:35.009906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:35.018238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:35.018755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:35.019221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:35.020040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:35.020524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:35.020978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:35.168137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:35.176096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54390ca3-26d3-4929-96ee-0a9f6ac3c26f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1391 microversion: 2.1 time: 0.171366 Sep 14 10:16:35.176680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3946/5778] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:35 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:36.200348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:36.200954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:36.203740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:36.204437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:36.211065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:36.211560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:36.212022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:36.212718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:36.213156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:36.213579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:36.351605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:36.359338 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a052b83-f43e-4dbb-86fc-f1aa80819ab1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1564 microversion: 2.1 time: 0.162948 Sep 14 10:16:36.359922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1833/5779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:36 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:36.382280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:36.383061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:36.385879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:36.386581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:16:36.392937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:36.393435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:36.393887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:36.394600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:36.395066 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:36.395504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:36.534057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:36.542598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8699eed-98b1-479f-8ac4-1e0ca89f157c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1564 microversion: 2.1 time: 0.164827 Sep 14 10:16:36.543203 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3947/5780] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:36 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:16:38.535452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:16:38.536148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:16:38.538132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:16:38.543221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:38.543704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:38.544164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:38.544855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:38.545519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:38.545940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:38.549638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:16:38.550408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:16:38.550863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:16:38.563785 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] Creating event network-changed:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:16:38.570100 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0b9c0301-f4da-460f-9b0f-877c2de55861 req-a28f0767-a1af-485c-b241-3efc35dbeb7e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Sep 14 10:16:38.570946 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3948/5781] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:16:38.694869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:16:38.703333 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bfc9451b-7fc3-4c70-bf84-80b4b7beaf2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1564 microversion: 2.1 time: 0.171592 Sep 14 10:16:38.704280 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1834/5782] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:16:38 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:00.015154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:00.016126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=34 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:00.020627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:00.022984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:00.030177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:00.030691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:00.031152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:00.031889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:00.032395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:00.032850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:00.086036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-266779c7-4bd9-42ad-8629-471891bcf1f9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action" status: 200 len: 24539 microversion: 2.1 time: 0.072653 Sep 14 10:17:00.086698 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3949/5783] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:00 2022] POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action => generated 24539 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:17:11.150773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:11.151300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:11.153597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:11.154244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=40 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:11.160922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.161397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.161824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.162521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.162968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.163384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.298724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-86a7ac9d-4d5d-4060-8cfa-63b5cfe033fd tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1836 microversion: 2.1 time: 0.151667 Sep 14 10:17:11.299313 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1835/5784] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:11 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1836 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:11.324786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:11.325536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:11.328610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:11.329299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:11.335456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.336624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.337065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.337777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.338256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.338697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.481476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:11.489383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-904246c0-664a-42c8-91b7-c733f5afe2c3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1683 microversion: 2.1 time: 0.169696 Sep 14 10:17:11.489965 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3950/5785] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:11 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:11.587305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:11.589580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:11.596145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.596633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.597075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.597766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.598281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.598639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.651945 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a35adb6b-6c81-43f9-a69c-399f8aec82ef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action" status: 200 len: 32609 microversion: 2.1 time: 0.069361 Sep 14 10:17:11.652640 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1836/5786] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:11 2022] POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action => generated 32609 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:17:11.834868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:11.835467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:11.842594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.843101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.843557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.844298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:11.844773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:11.845218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:11.959400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b0d213f3197d45b496eb8ca5d93949ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c796fe410e214ce4a575ac982a29c16a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:11.960085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] flavor_id is None. Assuming migration. {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 14 10:17:11.960578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:17:12.160143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-75c31697-f1a1-4a44-b5f4-1a231f33ed6c tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action" status: 202 len: 0 microversion: 2.1 time: 0.329051 Sep 14 10:17:12.161055 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3951/5787] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:11 2022] POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:17:12.170748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:12.172445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:12.180373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:12.181196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:12.181643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:12.182364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:12.182822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:12.183253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:12.350108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:12.358456 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a964377a-f8fa-4b92-b03b-ca4b7e6d8609 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1692 microversion: 2.1 time: 0.192093 Sep 14 10:17:12.359034 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1837/5788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:12 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:13.385266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:13.385942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:13.392796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:13.393369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:13.394090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:13.395091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:13.395547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:13.396049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:13.650158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:13.658177 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a06a610-a2c2-471f-8a29-2ad24b1a8c7e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1692 microversion: 2.1 time: 0.278676 Sep 14 10:17:13.658749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3952/5789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:13 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1692 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:14.682720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:14.683344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:14.690307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:14.690795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:14.691234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:14.691948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:14.692406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:14.692833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:14.833579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:14.842791 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-73976857-7ed0-4c51-9b3c-b48dc317fe18 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.164237 Sep 14 10:17:14.843377 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1838/5790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:14 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:15.867874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:15.868670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:15.875587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:15.876127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:15.876579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:15.877285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:15.877756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:15.878220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:16.013611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:16.021397 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b801b944-e9c1-477d-8b08-79ffc3ecdccd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.158360 Sep 14 10:17:16.021970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3953/5791] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:15 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:17.046089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:17.046699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:17.053140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:17.053629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:17.054065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:17.055342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:17.055792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:17.056244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:17.188495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:17.196576 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb1d341c-38b3-44ec-9bb2-3e3e54c804bb tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.154615 Sep 14 10:17:17.197158 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1839/5792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:17 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:18.220679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:18.221313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:18.228739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:18.229247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:18.229706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:18.230422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:18.230896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:18.231341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:18.363870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:18.372957 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c60b4761-a74f-4e61-8632-ec7824df2963 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.156621 Sep 14 10:17:18.373553 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3954/5793] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:18 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:19.397811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:19.398497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:19.405998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.406484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.406917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:19.407611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:19.408099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:19.408525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:19.549116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:19.557359 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-df0c43b3-a660-49c4-b3de-44c386326aec tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.163634 Sep 14 10:17:19.557938 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1840/5794] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:19 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:20.581422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:20.582055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:20.589606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:20.590108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:20.590561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:20.591270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:20.592029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:20.592475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:20.729988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:20.737943 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4380cc9e-71c8-4d91-b423-f170b396a7a0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.160490 Sep 14 10:17:20.738518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3955/5795] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:20 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:21.762343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:21.762951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:21.769799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:21.770273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:21.770704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:21.771378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:21.771822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:21.772263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:21.927093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:21.936050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5d84fda-b06e-40dd-b7a5-7fbb0745052e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.177575 Sep 14 10:17:21.936633 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1841/5796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:21 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:22.960962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:22.961863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:22.969262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:22.969768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:22.970228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:22.970946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:22.971420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:22.971866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:23.107874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:23.116011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8b8f79f4-84a4-4611-9400-7098cdbcc5b9 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.159467 Sep 14 10:17:23.122293 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3956/5797] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:22 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:24.141248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:24.141862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:24.149446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:24.149876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:24.150314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:24.151019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:24.151472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:24.151913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:24.287742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:24.296190 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-65adc4ed-7745-4846-8a51-3cecd0730750 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.158792 Sep 14 10:17:24.296763 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1842/5798] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:24 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:25.319911 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:25.320681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:25.327618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:25.328154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:25.328605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:25.329306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:25.329773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:25.330212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:25.470332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:25.479175 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70115b01-f321-4e9b-860e-0b6f0d7074e4 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.163234 Sep 14 10:17:25.479765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3957/5799] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:25 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:26.503534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:26.504178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:26.511838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:26.512362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:26.512800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:26.513496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:26.513952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:26.514382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:26.651385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:26.659041 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d5ba7be-6eab-4d1a-b607-ae4076745ca3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.159374 Sep 14 10:17:26.659614 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1843/5800] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:26 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:27.682891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:27.683522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:27.690409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:27.690920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:27.691375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:27.692119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:27.692594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:27.693042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:27.827385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:27.835505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c043d8f-405b-43f7-a114-417825f679d2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.156881 Sep 14 10:17:27.836107 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3958/5801] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:27 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:28.860196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:28.860829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:28.868562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:28.869040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:28.869469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:28.870155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:28.870600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:28.871019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:29.003268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:29.011803 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-baeadb64-45ce-43a9-bfb2-4c85f97ea839 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.155494 Sep 14 10:17:29.012419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1844/5802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:28 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:30.035438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:30.036099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:30.043150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:30.043651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:30.044159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:30.044874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:30.045344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:30.045809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:30.182082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:30.189773 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6a3a7df-feee-4823-bff7-b78d46a288f0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1697 microversion: 2.1 time: 0.158231 Sep 14 10:17:30.190358 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3959/5803] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:30 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:31.214080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:31.214691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:31.221683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:31.222163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:31.222591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:31.223279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:31.223725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:31.224167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:31.455821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:31.464706 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-62cd7fbc-cb5a-4ab3-a073-c5c41342f8b1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1696 microversion: 2.1 time: 0.255010 Sep 14 10:17:31.465301 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1845/5804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:31 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1696 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:31.552074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:31.564302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:31.564858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:31.565307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:31.578314 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Creating event network-vif-unplugged:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h2-851028-12 Sep 14 10:17:31.584394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:17:31.596589 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-71465445-3613-4279-a21d-b11bdcd74408 req-59f07598-fe96-42bf-8486-f283b4ba56fc service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048367 Sep 14 10:17:31.597217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3960/5805] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:32.489569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:32.490222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:32.498822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:32.499635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:32.500107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:32.500820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:32.501482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:32.501916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:32.685929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:32.694987 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afe7e7c4-b15f-495d-ac01-23d824fc339f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1696 microversion: 2.1 time: 0.209382 Sep 14 10:17:32.710539 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1846/5806] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:32 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:33.629381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:33.640288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:33.640787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:33.641240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:33.654328 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Creating event network-changed:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h2-851028-12 Sep 14 10:17:33.659699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:17:33.671681 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6fa2455d-af3e-4ffd-a459-d62155413a6e req-b985dbc7-a5e4-4aad-82e0-ba3131480c43 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047380 Sep 14 10:17:33.672319 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3961/5807] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:33.720300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:33.720871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:33.729176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:33.729670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:33.730107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:33.730818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:33.731297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:33.731696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:33.875001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:33.884169 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ceee783a-992e-4d2f-80c2-14d33be43757 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1694 microversion: 2.1 time: 0.167967 Sep 14 10:17:33.884834 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1847/5808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:33 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:34.912772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:34.913515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:34.921450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.921957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.922413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:34.923133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:34.923601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:34.924101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.064379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:35.072343 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06a06eef-915a-4791-bba5-dc7327a57b60 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1691 microversion: 2.1 time: 0.167181 Sep 14 10:17:35.072931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3962/5809] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:34 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:35.095768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:35.096317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:35.103918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.104407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.104827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.105510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.105955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.106371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.217923 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e15c5f16-6427-4213-a1e5-3a7c681e9f30 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action" status: 202 len: 0 microversion: 2.1 time: 0.125965 Sep 14 10:17:35.218723 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1848/5810] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:17:35 2022] POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:17:35.228834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:35.229480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:35.235709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.236726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.237392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.238295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:35.238853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:35.239347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:35.383931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:35.391843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b0cb7afe-4fad-4ec9-bf90-58b751f79934 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1690 microversion: 2.1 time: 0.168758 Sep 14 10:17:35.392564 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3963/5811] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:35 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:36.162199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-plugged", "status": "completed", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:36.177297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:36.177774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:36.178197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:36.191327 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Creating event network-vif-plugged:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h2-851028-12 Sep 14 10:17:36.197031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:17:36.208340 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5e6b669f-d350-43e0-b767-7385c0ff50d8 req-caa295b5-b9c3-4d4f-a0c4-aef6f892dcd9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050195 Sep 14 10:17:36.209115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1849/5812] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:36.416672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:36.417216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:36.424157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:36.424669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:36.425129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:36.425851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:36.426324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:36.426778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:36.571116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:36.578900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e76ecb4e-36d4-4cdc-b905-f080b3bba770 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1690 microversion: 2.1 time: 0.166592 Sep 14 10:17:36.579480 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3964/5813] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:36 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:37.604228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:37.604934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:37.611037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:37.611524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:37.611985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:37.612675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:37.613135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:37.613758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:37.636398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:38.102488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:38.110391 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-692d7340-e2e1-46fb-b1d5-d4526620460b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1690 microversion: 2.1 time: 0.511472 Sep 14 10:17:38.110969 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1850/5814] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:37 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1690 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:38.265013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:38.275136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:38.275652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:38.276366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:38.288580 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Creating event network-vif-unplugged:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:17:38.291875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:38.295940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:17:38.307960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b1f1e162-6dd7-4df6-8c25-86b11effc306 req-2b2511f1-e475-478f-9a52-182a29408bdf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047685 Sep 14 10:17:38.308774 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3965/5815] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:39.135703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:39.136479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:39.143186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:39.143678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:39.144158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:39.144860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:39.145316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:39.145741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:39.281192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:39.289819 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-969603a6-b72d-4188-abf6-75657e20f3d0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1690 microversion: 2.1 time: 0.158353 Sep 14 10:17:39.290421 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1851/5816] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:39 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:40.315769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:40.316426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:40.322923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:40.323421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:40.323919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:40.324378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:40.325093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:40.325558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:40.325997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:40.333120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:40.333602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:40.334156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:40.346519 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Creating event network-changed:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:17:40.352763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:17:40.363366 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-34c29042-a099-43a7-b699-b70f71d08a3e req-71971d2c-74a8-498e-acc7-d20401a56784 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044061 Sep 14 10:17:40.364001 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1852/5817] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:17:40.551415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:40.561557 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f4e92fd0-e040-4b34-abe2-31a0454c2c12 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1690 microversion: 2.1 time: 0.251497 Sep 14 10:17:40.562676 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3966/5818] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:40 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1690 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:17:41.587611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:17:41.588335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:17:41.590324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=41 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:41.596293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:41.596778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:41.597218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:41.597911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:41.598372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:41.598797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:41.745246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:17:41.752958 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e4afd30-d527-4f3a-b81f-e2bc89d5e0ce tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1683 microversion: 2.1 time: 0.170645 Sep 14 10:17:41.753539 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1853/5819] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:17:41 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:17:44.008287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-plugged", "status": "completed", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:17:44.014301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=37 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:17:44.020104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:17:44.021713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:17:44.021713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:17:44.033383 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] Creating event network-vif-plugged:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:17:44.038487 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-09792c0e-66c9-45a3-b40d-b099bbd14cb2 req-9940c465-fae5-42cd-8b77-73c66b12242d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Sep 14 10:17:44.040158 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3967/5820] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:05.966916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:05.969105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:05.971864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:05.972563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=19 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:05.979659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:05.980164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:05.980629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:05.981302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:05.981754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:05.982175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:06.036599 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c13820f7-50ce-4c79-90e6-bc3ebbd64efd tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action" status: 200 len: 63253 microversion: 2.1 time: 0.074783 Sep 14 10:18:06.037265 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1854/5821] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:18:05 2022] POST /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c/action => generated 63253 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:18:12.250975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:12.251726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:12.255767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:12.256500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:12.263973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:12.264505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:12.264957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:12.265662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:12.266156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:12.266594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:12.395626 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-71aa61d2-8a2a-4c26-9816-72a1da05ecb0 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1836 microversion: 2.1 time: 0.147221 Sep 14 10:18:12.396140 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3968/5822] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:12 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1836 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:13.260399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:13.261594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:13.262061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:13.268794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:13.269308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:13.269766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:13.270618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:13.270961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:13.271407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:13.272309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:13.272435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:13.272942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:13.285626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] Creating event network-changed:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:18:13.290680 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e3d71d30-8b63-45b2-94f9-70c07dd7be34 req-f139a3ac-b90c-42e2-98c0-20078d1e9526 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 Sep 14 10:18:13.291818 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1855/5823] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:13.302327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:18:13.403949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54455654-9802-45a5-90bd-7b36d98f8020 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 204 len: 0 microversion: 2.1 time: 0.141009 Sep 14 10:18:13.403949 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3969/5824] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:18:13 2022] DELETE /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 10:18:13.412830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:13.413536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:13.420582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:13.421071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:13.421510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:13.422217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:13.422729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:13.423103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:13.565061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:13.573240 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03234001-0349-4259-bd1c-abec6f2f5d68 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1689 microversion: 2.1 time: 0.164550 Sep 14 10:18:13.573829 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1856/5825] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:13 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:14.598619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:14.599344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:14.606799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:14.607305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:14.607797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:14.608540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:14.609017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:14.609465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:14.910869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:14.919777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa28adb2-2079-4c5b-adc3-4bf739066235 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 200 len: 1689 microversion: 2.1 time: 0.325462 Sep 14 10:18:14.920738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3970/5826] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:14 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:15.371296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9f6f6f2-9524-4621-87c3-65a09c39ce2c", "name": "network-vif-deleted", "tag": "e4b4c588-e151-49c1-b460-b00d9e717de1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:15.382096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:15.382573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:15.382998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:15.394802 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] Creating event network-vif-deleted:e4b4c588-e151-49c1-b460-b00d9e717de1 for instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c on n-h1-851028-12 Sep 14 10:18:15.399804 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9968e33c-49eb-4744-b328-fba4fcd59bce req-b145b2ee-069d-47ad-a46f-aa3b9fabce1b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032901 Sep 14 10:18:15.400448 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1857/5827] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:15.944669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:15.945209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: d9f6f6f2-9524-4621-87c3-65a09c39ce2c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:15.952473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:15.952988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:15.953447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:15.954182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:15.954664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:15.955115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:15.969422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] HTTP exception thrown: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Request method failure captured: Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c HTTP/1.1 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIamIwn3RJ2sV4qyfWlr30OzV_ISlamKzy4dn7OYMfGqc8Cun6CdN9vh8jEb2O_F_O8tOP_4EsShPcYfSJB4CdmM_m5W3BkOC_jT7qj2p_wBelFwpUhhIzGLJnilQti5MQ3XuEvMAnHnXydOswIfQWRI4FPooaVrNvr5P7iJmrsuIx_o Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36e1ed33e600400cacb79a98608cd2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36e1ed33e600400cacb79a98608cd2fd"}]}] Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0fd5e84c18c44fef9a307110ff93e368 Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'd9f6f6f2-9524-4621-87c3-65a09c39ce2c'} Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:18:15.971442 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Returning 404 to user: Instance d9f6f6f2-9524-4621-87c3-65a09c39ce2c could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38229cd8-6a8a-4e79-9b73-c377f4a3ffe3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c" status: 404 len: 111 microversion: 2.1 time: 0.032583 Sep 14 10:18:15.975514 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3971/5828] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:15 2022] GET /compute/v2.1/servers/d9f6f6f2-9524-4621-87c3-65a09c39ce2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:18:19.002704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d6c12579-ac8f-4509-80f7-bb8949e09600 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '.version_select at 0x7f693f26dd30>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:19.023539 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d6c12579-ac8f-4509-80f7-bb8949e09600 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2106946443" status: 202 len: 0 microversion: 2.1 time: 0.025879 Sep 14 10:18:19.024369 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1858/5829] 10.222.0.90 () {58 vars in 1284 bytes} [Wed Sep 14 10:18:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2106946443 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:18:19.058512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14a2b112-1473-4d9a-bbbd-2611a7190200 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: .version_select at 0x7f693e08f550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1282522286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7UnKg2ObLHtY8HwYs5j8NXvNbSFYxBN7iuWoQhPQiyI/+alm2QFVV8P3KZXuZHZ/o2VZtkZDD4hGnVvsVwHQTXkLMji5tSD5eP2xfY1B2j2UeOvXoF/D4fSwwlehXMdg=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:19.074621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-14a2b112-1473-4d9a-bbbd-2611a7190200 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:18:19.080807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-14a2b112-1473-4d9a-bbbd-2611a7190200 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:18:19.104918 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14a2b112-1473-4d9a-bbbd-2611a7190200 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051058 Sep 14 10:18:19.105554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3972/5830] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:18:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:24.852846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-367605238", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "319b5f29-6cc5-4e97-a1e9-51b3df01efc1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1282522286", "security_groups": [{"name": "tempest-secgroup-smoke-1117185238"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:24.994345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] validate_networks() for [('319b5f29-6cc5-4e97-a1e9-51b3df01efc1', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:18:25.387980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=14 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:25.435640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:18:25.436092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:18:25.436734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:18:25.437321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:18:25.437872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:18:25.447348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:25.448662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:25.449332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:25.450062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:25.450531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:25.450954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:25.474400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:18:25.480565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:18:25.497376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:18:25.500176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:18:25.551952 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ddfed87-e875-4e44-bb43-501750b3f724 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708365 Sep 14 10:18:25.553268 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1859/5831] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:18:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:18:25.566630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-655de384-ad3f-4186-969b-170aad74eddc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:25.567366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-655de384-ad3f-4186-969b-170aad74eddc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:25.644191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-655de384-ad3f-4186-969b-170aad74eddc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:25.652203 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-655de384-ad3f-4186-969b-170aad74eddc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1266 microversion: 2.1 time: 0.090704 Sep 14 10:18:25.652884 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3973/5832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:25 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:26.677122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:26.678323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:26.690474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:26.692800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:26.693424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:26.694300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:26.696960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:26.697419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:26.802791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:26.815447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-61eb5701-003a-4006-afe6-c51671047713 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1326 microversion: 2.1 time: 0.143220 Sep 14 10:18:26.816781 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1860/5833] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:26 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:27.845812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:27.847100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:27.849340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:27.859258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:27.859777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:27.860303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:27.861145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:27.861641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:27.862086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:28.018771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:28.028251 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96b5a12d-acb6-4a91-9971-afd89a387da6 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1392 microversion: 2.1 time: 0.191929 Sep 14 10:18:28.029026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3974/5834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:27 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1392 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:28.253434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:28.270126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:28.270864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:28.271722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:28.286038 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] Creating event network-changed:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h2-851028-12 Sep 14 10:18:28.291413 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5d332176-53e9-4782-908f-5420b951fb85 req-b90f4fae-759e-48a8-90f5-c7f896a8ef57 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045172 Sep 14 10:18:28.292332 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1861/5835] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:29.053456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:29.054095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:29.061631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:29.062148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:29.062610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:29.063333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:29.063814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:29.064298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:29.200850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:29.208860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d5deb89-bede-46a2-ac81-2ae1afa8b5bc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1392 microversion: 2.1 time: 0.159265 Sep 14 10:18:29.209645 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3975/5836] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:29 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:30.234272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:30.234976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:30.242116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:30.242605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:30.243042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:30.243751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:30.244240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:30.245295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:30.383810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:30.391758 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e7dd5e64-2aef-4313-bffe-f8c25f4fa7e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1392 microversion: 2.1 time: 0.163259 Sep 14 10:18:30.392419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1862/5837] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:30 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:31.414834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:31.415375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:31.423414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:31.423656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:31.424138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:31.424957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:31.425431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:31.425867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:31.564775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:31.573143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b9b3cdd-3ebb-4cea-a6d0-0ce8c0d97e2a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1392 microversion: 2.1 time: 0.161799 Sep 14 10:18:31.574041 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3976/5838] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:31 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:32.542429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "name": "network-vif-plugged", "status": "completed", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:32.554715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:32.555278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:32.555796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:32.568149 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] Creating event network-vif-plugged:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h2-851028-12 Sep 14 10:18:32.573822 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4805f9f7-ad9a-4d96-9b38-a49eead7f1e5 req-6a568bda-44fe-4f6d-9cf7-930be4b5df1a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Sep 14 10:18:32.574717 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1863/5839] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:32.598806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:32.600792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:32.610565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:32.611272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:32.612049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:32.613219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:32.614012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:32.614581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:32.774314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:32.786607 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9e4c7e35-be8f-4abf-992a-d4fd3caf775f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1392 microversion: 2.1 time: 0.192591 Sep 14 10:18:32.788603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3977/5840] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:32 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:33.813196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:33.814131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:33.820667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:33.821158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:33.821630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:33.822466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:33.823521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:33.824406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:33.965116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:33.973261 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d2a3cd1f-ce3a-42cc-830d-dd7bafa78329 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1563 microversion: 2.1 time: 0.167676 Sep 14 10:18:33.973841 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1864/5841] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:33 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:33.996966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:33.997613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:34.004630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:34.005136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:34.005607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:34.006474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:34.007120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:34.007704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:34.144544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:34.153022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7143e180-6787-4dee-96d8-c504b30e5cd2 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1563 microversion: 2.1 time: 0.160784 Sep 14 10:18:34.153605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3978/5842] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:33 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:36.113074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:36.113966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:36.118648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:18:36.119273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:36.120382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:36.127221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:36.127446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:36.133488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:36.134696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:36.135044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:36.136398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:36.136732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:36.137463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:36.138565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:36.139136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:36.139690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:36.153965 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] Creating event network-changed:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h2-851028-12 Sep 14 10:18:36.176974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6c762827-6a58-491c-b26d-66a687469e01 req-4afc78a7-c868-4857-a2a6-a64d512aed31 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061203 Sep 14 10:18:36.178030 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3979/5843] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:18:36.396132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:18:36.405722 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-09a63098-b151-437b-876a-de08c48f3820 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1563 microversion: 2.1 time: 0.294294 Sep 14 10:18:36.406676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1865/5844] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:18:36 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1563 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:18:59.677983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:18:59.680423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:18:59.682866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:59.683782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:18:59.690797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:59.691307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:59.691765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:59.692515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:18:59.692992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:18:59.693440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:18:59.745282 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05f296df-fe17-436c-a53d-6e0fe8e6e012 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action" status: 200 len: 24567 microversion: 2.1 time: 0.071576 Sep 14 10:18:59.745985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3980/5845] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:18:59 2022] POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action => generated 24567 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:19:10.804981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:10.805534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:10.807482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:10.808144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=30 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:10.814287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:10.814767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:10.815198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:10.815880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:10.816353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:10.816771 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:10.956029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:10.963704 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5e4e618-eec7-43c7-961c-8f54b8e1336b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1682 microversion: 2.1 time: 0.162969 Sep 14 10:19:10.964318 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1866/5846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:10 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:11.064893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:11.067145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:11.070077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:11.070742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:11.079367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.079874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.080361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.081082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.081550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.082001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.142195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e2b4544-3a8d-4caa-ae51-8c5b90d98266 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action" status: 200 len: 32640 microversion: 2.1 time: 0.081836 Sep 14 10:19:11.142887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3981/5847] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:19:11 2022] POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action => generated 32640 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:19:11.316797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:11.317335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:11.323751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.324304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.324768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.325561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.326016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.326435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.461796 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6152361a-82f1-4b73-971a-b4376fe75b05 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1835 microversion: 2.1 time: 0.148841 Sep 14 10:19:11.462410 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1867/5848] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:11 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1835 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:11.492761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:11.495304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:11.503100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.503603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.504090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.504801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:11.505268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:11.505706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:11.531264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lazy-loading 'flavor' on Instance uuid c96ae33c-62de-47fc-b1e1-5323d0026780 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:19:11.543729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Going to try to live migrate instance to another host {{(pid=122444) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 14 10:19:12.831685 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-403c0766-f958-41bc-a389-ad9ef0f4cdd8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action" status: 202 len: 0 microversion: 2.1 time: 1.342969 Sep 14 10:19:12.832777 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3982/5849] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:19:11 2022] POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action => generated 0 bytes in 1345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:19:12.843034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:12.843645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:12.850288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.850887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.851207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:12.851882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:12.852351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:12.852772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:13.082958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:13.091562 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3b29927e-f6f0-483f-8c72-f7fc3dea2585 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.253750 Sep 14 10:19:13.092464 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1868/5850] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:12 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:13.896000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "name": "network-vif-unplugged", "status": "completed", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:13.908604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:13.909116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:13.909775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:13.922855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] Creating event network-vif-unplugged:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h2-851028-12 Sep 14 10:19:13.928270 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-bee3a451-16b9-4d4b-8bfb-a5908ab8368d req-e1fccef0-b988-4777-a0fa-ec40230de1c8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036097 Sep 14 10:19:13.928891 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3983/5851] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:14.116580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:14.117219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:14.124933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:14.126209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:14.126646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:14.128126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:14.128653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:14.129179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:14.268480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:14.276471 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3385ac32-2bf8-40f8-b017-0fc13b5c6162 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.164195 Sep 14 10:19:14.277125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1869/5852] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:14 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:15.302746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:15.303500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:15.309852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:15.310358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:15.310817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:15.311537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:15.312046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:15.312494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:15.506278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:15.514855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8a20924-a755-445b-ae8d-ee73fdfc48e8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.217296 Sep 14 10:19:15.515433 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3984/5853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:15 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:15.945075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:15.954871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:15.955352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:15.955783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:15.969106 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] Creating event network-changed:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h2-851028-12 Sep 14 10:19:15.974198 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d317134a-df79-4b68-a423-3f7027e865e6 req-3df0d376-ae44-4396-8a59-b9d041ae2043 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032853 Sep 14 10:19:15.974820 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1870/5854] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:16.538870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:16.539509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:16.547600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:16.548239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:16.548701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:16.549438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:16.549916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:16.550363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:16.690507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:16.698379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3908f913-b1da-4e13-a246-115155348632 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.163640 Sep 14 10:19:16.698962 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3985/5855] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:16 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:17.724143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:17.724837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:17.732031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:17.732525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:17.732970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:17.733665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:17.734123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:17.734554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:17.869431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:17.879588 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4fdd0d1-69a1-4bec-a078-ed3f08f4b8a1 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.160562 Sep 14 10:19:17.880214 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1871/5856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:17 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:18.903689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:18.904265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:18.911257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:18.911772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:18.912274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:18.913321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:18.913521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:18.913981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:19.050372 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:19.058247 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c00f8f3d-4d9c-4e8e-af57-8cda9e1dc48f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.158777 Sep 14 10:19:19.059743 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3986/5857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:18 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:20.083084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:20.083625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:20.091220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:20.092006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:20.092449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:20.093158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:20.093617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:20.094049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:20.235660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:20.245143 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-15c99ad1-f7d2-4818-a111-d61719e991b3 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1692 microversion: 2.1 time: 0.165994 Sep 14 10:19:20.245826 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1872/5858] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:20 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:21.270158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:21.270784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:21.278671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.279170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.279626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.280371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.280906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.281354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.422835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:21.430799 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b31edef0-2146-44f8-98a4-871bdadd3f56 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1682 microversion: 2.1 time: 0.164644 Sep 14 10:19:21.431391 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3987/5859] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:21 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:21.456597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:21.457237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:21.465399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.465799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.466227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.467175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.467618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.468072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.612269 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9b8cff9-b40b-4904-a37f-a1b1a94c40e8 tempest-TestNetworkAdvancedServerOps-959611175 tempest-TestNetworkAdvancedServerOps-959611175-project-admin] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1835 microversion: 2.1 time: 0.159213 Sep 14 10:19:21.612850 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1873/5860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:21 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1835 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:21.636209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:21.637589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:21.643816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.644365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.644826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.645549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.646026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.646474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.789173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:21.796963 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-87ed98ef-f9de-48cd-8bf4-8b65cc942d32 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1682 microversion: 2.1 time: 0.164724 Sep 14 10:19:21.797536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3988/5861] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:21 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:21.895284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:21.897593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:21.904710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.905182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.905607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.906284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:21.906730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:21.907148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:21.958089 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9264c32-cf4f-40ef-991e-c7767a4623af tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action" status: 200 len: 38679 microversion: 2.1 time: 0.066516 Sep 14 10:19:21.958740 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1874/5862] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:19:21 2022] POST /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780/action => generated 38679 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:19:22.958016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:22.958619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:22.960902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:22.967442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:22.968376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:22.969113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:22.969919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:22.970461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:22.971004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:22.972619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:22.973326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:22.973780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:22.986113 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] Creating event network-changed:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h1-851028-12 Sep 14 10:19:22.991135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-189d5b6b-5fae-4bc6-ae70-d361ca4fa808 req-8585aaaa-ee19-46dd-b2fc-a82a4eb15c0b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034882 Sep 14 10:19:22.991749 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1875/5863] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:22.999801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:19:23.104548 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27b302a6-f762-4c36-9baf-7544eb371b36 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 204 len: 0 microversion: 2.1 time: 0.150189 Sep 14 10:19:23.106046 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3989/5864] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:19:22 2022] DELETE /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:19:23.116184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:23.117434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:23.125468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:23.126061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:23.126569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:23.127460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:23.128195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:23.128708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:23.274376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:23.283614 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34f8ebe8-3209-4cf5-8927-3dd48593b940 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1688 microversion: 2.1 time: 0.172868 Sep 14 10:19:23.284692 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1876/5865] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:23 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:19:24.311352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:24.312213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:24.319243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:24.319742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:24.320220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:24.320946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:24.321410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:24.321849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:24.356996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:24.357530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:24.357988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:24.358459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lazy-loading 'fault' on Instance uuid c96ae33c-62de-47fc-b1e1-5323d0026780 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:19:24.404526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:24.412655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5b68dc9f-cbe8-47c8-8a0b-7ca65cf0e9ba tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 200 len: 1356 microversion: 2.1 time: 0.107341 Sep 14 10:19:24.413252 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3990/5866] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:24 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 1356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:25.006895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c96ae33c-62de-47fc-b1e1-5323d0026780", "name": "network-vif-deleted", "tag": "ae07227d-6629-44f9-a6b7-c2373d8ff751"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:25.018708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:25.019180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:25.019600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:25.030714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] Creating event network-vif-deleted:ae07227d-6629-44f9-a6b7-c2373d8ff751 for instance c96ae33c-62de-47fc-b1e1-5323d0026780 on n-h1-851028-12 Sep 14 10:19:25.035654 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2c8d2a58-e4ff-4357-b992-190667977a33 req-7b7f0ab7-0455-42f6-a4af-11d81b7a804b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Sep 14 10:19:25.036369 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1877/5867] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:25.437236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:25.437869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: c96ae33c-62de-47fc-b1e1-5323d0026780] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:25.444720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:25.445213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:25.445661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:25.446366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:25.446830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:25.447272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:25.460635 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] HTTP exception thrown: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Request method failure captured: Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 HTTP/1.1 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIamIwn3RJ2sV4qyfWlr30OzV_ISlamKzy4dn7OYMfGqc8Cun6CdN9vh8jEb2O_F_O8tOP_4EsShPcYfSJB4CdmM_m5W3BkOC_jT7qj2p_wBelFwpUhhIzGLJnilQti5MQ3XuEvMAnHnXydOswIfQWRI4FPooaVrNvr5P7iJmrsuIx_o Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36e1ed33e600400cacb79a98608cd2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36e1ed33e600400cacb79a98608cd2fd"}]}] Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 0fd5e84c18c44fef9a307110ff93e368 Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'c96ae33c-62de-47fc-b1e1-5323d0026780'} Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:19:25.462320 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Returning 404 to user: Instance c96ae33c-62de-47fc-b1e1-5323d0026780 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40ed9b25-8ea6-4379-b85b-4397e84ac560 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780" status: 404 len: 111 microversion: 2.1 time: 0.030596 Sep 14 10:19:25.467542 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3991/5868] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:25 2022] GET /compute/v2.1/servers/c96ae33c-62de-47fc-b1e1-5323d0026780 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:19:29.147009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e8625c1-5d10-42a5-a535-5958895d7172 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '.version_select at 0x7f694798a790>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:29.171505 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e8625c1-5d10-42a5-a535-5958895d7172 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1282522286" status: 202 len: 0 microversion: 2.1 time: 0.029292 Sep 14 10:19:29.173392 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1878/5869] 10.222.0.90 () {58 vars in 1284 bytes} [Wed Sep 14 10:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1282522286 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:19:29.201411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38837f11-ffe9-4ad2-99d0-00bc06619231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: .version_select at 0x7f693f86bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-704403459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJX3ojNy92fgapV+JgjhbKukwKJz05AFAc6cIkUfBk7drNbk9m6+YoJTKQ0rtYs3aDnDDIuDq/gs6SssjzyO7FAiJjPr5KIRmWbhjWqCPu97yD/Beb0MYW0hIEyaSIJeA=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:29.219036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-38837f11-ffe9-4ad2-99d0-00bc06619231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:19:29.225270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-38837f11-ffe9-4ad2-99d0-00bc06619231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:19:29.249349 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38837f11-ffe9-4ad2-99d0-00bc06619231 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052135 Sep 14 10:19:29.249978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3992/5870] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:19:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:34.834777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1246087465", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "bd00bb19-56c2-42a7-9f1e-54f2f8238fd2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-704403459", "security_groups": [{"name": "tempest-secgroup-smoke-682890872"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:34.991396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] validate_networks() for [('bd00bb19-56c2-42a7-9f1e-54f2f8238fd2', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:19:35.024756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=58 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:35.449621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:19:35.450029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:19:35.450501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:19:35.450906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:19:35.451317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:19:35.460300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:35.460825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:35.461256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:35.462008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:35.462450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:35.462868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:35.481814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:19:35.487302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Getting quotas for user 0fd5e84c18c44fef9a307110ff93e368 and project 36e1ed33e600400cacb79a98608cd2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:19:35.500574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:19:35.503190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:19:35.551356 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-263212df-a062-4679-9a2d-bdbfd8f0c27d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720377 Sep 14 10:19:35.557149 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1879/5871] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:19:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:19:35.562142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:35.566848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-324fbbbc-1721-495f-8275-b1787e5ad42a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:35.567484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-324fbbbc-1721-495f-8275-b1787e5ad42a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:35.638298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-324fbbbc-1721-495f-8275-b1787e5ad42a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:35.646051 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-324fbbbc-1721-495f-8275-b1787e5ad42a tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1266 microversion: 2.1 time: 0.085747 Sep 14 10:19:35.646838 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3993/5872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:35 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:36.671406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:36.672304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:36.678951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:36.679515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:36.680074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:36.680821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:36.681267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:36.681684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:36.747448 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:36.755368 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-de0897b6-cdbf-4cbc-90c1-83f857ddd439 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1318 microversion: 2.1 time: 0.089095 Sep 14 10:19:36.755965 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1880/5873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:36 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:19:37.784252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:37.785494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:37.806408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:37.807129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:37.807759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:37.813141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:37.814391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:37.814960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:38.247711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:38.258268 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fa8516f2-05f3-47bd-826a-9e8683348206 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1391 microversion: 2.1 time: 0.483363 Sep 14 10:19:38.260479 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3994/5874] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:37 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1391 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:19:38.673681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:38.683969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:38.684603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:38.685223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:38.697670 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] Creating event network-changed:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:19:38.704422 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-622f8c89-11ba-4386-b596-7e695931b08c req-eef8b064-2c8a-4396-9c52-aeaa65f0151d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099220 Sep 14 10:19:38.705354 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1881/5875] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:39.288280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:39.288962 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:39.297326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:39.297944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:39.298510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:39.299339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:39.299881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:39.300425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:39.450593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:39.458419 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6a39b43c-16d8-4a76-a2c3-7e8bc4b6b452 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1391 microversion: 2.1 time: 0.174411 Sep 14 10:19:39.459017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3995/5876] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:39 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:40.485508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:40.486211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:40.492590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:40.493072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:40.493504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:40.494197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:40.494651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:40.495073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:40.720695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:40.728805 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b836befe-8431-4ed1-bda0-c7068fba6b59 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1391 microversion: 2.1 time: 0.249947 Sep 14 10:19:40.729466 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1882/5877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:40 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1391 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:41.752085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:41.752720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:41.755823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:41.762497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:41.763004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:41.763463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:41.764226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:41.764703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:41.765147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:41.905494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:41.913719 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5a19db7-3190-4ffa-a875-34adc0318cca tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1391 microversion: 2.1 time: 0.165678 Sep 14 10:19:41.914326 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3996/5878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:41 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:42.927839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "name": "network-vif-plugged", "status": "completed", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:42.935978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:42.940178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:42.940657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:42.941080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:42.945265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:42.947803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:42.953543 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] Creating event network-vif-plugged:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:19:42.955190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:42.955702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:42.956191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:42.957226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:42.957442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:42.958059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:42.958628 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-de675eed-af2e-4975-bdee-288dfbebe0bb req-1aca36db-f532-4165-973e-580363646f6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092813 Sep 14 10:19:42.959345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1883/5879] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:43.101035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:43.109655 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1efaa442-9b8b-4a0d-86b2-1e2ffd73786d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1391 microversion: 2.1 time: 0.172189 Sep 14 10:19:43.110240 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3997/5880] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:42 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:44.137486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:44.138169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:44.145186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:44.145661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:44.146090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:44.146780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:44.147230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:44.147651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:44.292806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:44.300847 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae740e1c-6846-4b2a-b41c-4b28e1a57aaa tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1563 microversion: 2.1 time: 0.169968 Sep 14 10:19:44.301429 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1884/5881] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:44 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:44.324841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:44.325474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:44.332679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:44.333186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:44.333646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:44.334361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:44.334841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:44.335287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:44.468714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:44.477984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ca77b46e-a24b-4b5b-9678-dbe6dad4a1f8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1563 microversion: 2.1 time: 0.157166 Sep 14 10:19:44.478581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3998/5882] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:44 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:19:46.173471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:19:46.174494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:19:46.180080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:19:46.180654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:46.181055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:46.188400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:46.188875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:46.189699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:19:46.189844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:46.190425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:46.191029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:46.191796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:46.194707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:19:46.195440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:19:46.195929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:19:46.209479 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] Creating event network-changed:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:19:46.216644 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c96e25a4-3a18-4946-b01c-adab7b19f0f4 req-e59f0013-d8c5-45b4-9a5f-280e146fb2f4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049010 Sep 14 10:19:46.217545 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 3999/5883] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:19:46.429763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:19:46.440868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ef6446a-559c-4b35-bc17-91da1022d43b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1563 microversion: 2.1 time: 0.274692 Sep 14 10:19:46.441589 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1885/5884] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:19:46 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1563 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:09.813682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=7 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:09.814445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:09.818903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:20:09.821237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:09.829660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:09.830169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:09.830632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:09.831364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:09.831845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:09.832319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:09.892292 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-61c39b8a-64dc-4d05-a7cd-a219fa09ea93 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action" status: 200 len: 24576 microversion: 2.1 time: 0.081411 Sep 14 10:20:09.892944 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4000/5885] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:20:09 2022] POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action => generated 24576 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:20:20.679763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:20:20.682538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:20.684745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=5 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:20.686211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=30 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:20.692696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.693187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.693624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:20.694318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.694770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.695228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:20.776488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:20:20.776912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:20:20.777385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:20:20.777793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:20:20.778208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:20:20.839138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:20.845398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.845889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.846325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:20.847025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.847475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.847917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:20.876438 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9e31790c-6b9b-4ace-9829-c8b8c02d31dc tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action" status: 202 len: 1138 microversion: 2.1 time: 0.200055 Sep 14 10:20:20.876661 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1886/5886] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:20:20 2022] POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action => generated 1138 bytes in 201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 14 10:20:20.897141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:20.897858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:20.900586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:20.901400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:20:20.906995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.907494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.907969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:20.908683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:20.909152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:20.909597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:21.054521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:21.063220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce5d1e0e-9f4c-45c8-82ab-2a2f1643aa1c tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.170396 Sep 14 10:20:21.063807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4001/5887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:20 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:22.086812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:22.087431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:22.095439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:22.095961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:22.096406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:22.097105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:22.097560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:22.098618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:22.247183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:22.255323 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a8b41e69-b40f-44c0-bc49-df1e24faa77e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.172405 Sep 14 10:20:22.255914 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1887/5888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:22 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:23.278417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:23.279725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:23.287006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:23.287517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:23.288015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:23.288744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:23.289222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:23.289674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:23.421471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:23.429767 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9124bdd-0f83-4630-8cc8-5890c8865c54 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.155609 Sep 14 10:20:23.430274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4002/5889] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:23 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:20:24.454571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:24.455097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:24.462011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:24.462504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:24.462938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:24.463624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:24.464114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:24.464538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:24.597707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:24.605493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46bc36e2-1b55-47de-b974-414374c8c83b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.155043 Sep 14 10:20:24.606079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1888/5890] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:24 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:25.632280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:25.632921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:25.640168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:25.640674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:25.641134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:25.641862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:25.642346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:25.642895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:25.782707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:25.790859 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce655d9c-0852-4d16-b0cd-e958a8823bf0 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.164095 Sep 14 10:20:25.791483 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4003/5891] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:25 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:20:26.815793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:26.816360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:26.823162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:26.823646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:26.824114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:26.824810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:26.825265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:26.825693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:26.957133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:26.965501 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f487ca83-70e9-4272-a0c8-0bd54479062d tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.154234 Sep 14 10:20:26.966451 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1889/5892] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:26 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:27.990610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:27.991310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:27.998231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:27.998733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:27.999187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:28.000557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:28.001034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:28.001585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:28.132575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:28.141848 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b629692-728d-44c2-be75-6266dee7f469 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.155194 Sep 14 10:20:28.142432 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4004/5893] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:27 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:29.165202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:29.165815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:29.173212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:29.173691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:29.174120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:29.175104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:29.175658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:29.176146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:29.309228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:29.317728 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5341be88-c51d-4423-8d12-95c7c0d6a04e tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.156456 Sep 14 10:20:29.318310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1890/5894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:29 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:30.341278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:30.341918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:30.349267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:30.349776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:30.350233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:30.350955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:30.351431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:30.351879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:30.490481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:30.498353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-911764d3-7426-4013-8cb1-a5af0b781af5 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.161043 Sep 14 10:20:30.498948 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4005/5895] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:30 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:31.522202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:31.522810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:31.530028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:31.530508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:31.531614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:31.532392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:31.532842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:31.533265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:31.673763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:31.684472 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-50d52310-7180-4bbc-a17a-c1deefc58d75 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.165737 Sep 14 10:20:31.685525 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1891/5896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:31 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:32.709458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:32.710098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:32.717476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:32.717981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:32.718443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:32.719168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:32.719650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:32.720131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:32.857639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:32.866782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7891c4d6-5f38-4476-9987-779758aa8525 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.161209 Sep 14 10:20:32.867422 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4006/5897] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:32 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:33.891625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:33.892250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:33.898964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:33.899446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:33.899930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:33.900616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:33.901060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:33.901478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:34.037612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:34.045722 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5fe9e60c-352a-4645-ba83-987758c66a38 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.158564 Sep 14 10:20:34.046304 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1892/5898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:33 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:35.069108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:35.069747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:35.076899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:35.077405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:35.078682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:35.079498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:35.080014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:35.080470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:35.217466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:35.225947 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-719d6c1e-7c89-4c43-96f1-ce2863d9d042 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.160824 Sep 14 10:20:35.226549 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4007/5899] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:35 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:36.250514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:36.251151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:36.257982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:36.258491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:36.258922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:36.259610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:36.260112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:36.260535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:36.393088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:36.400906 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-522d26c7-e18b-409b-818d-1ebfc095e227 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.154593 Sep 14 10:20:36.401475 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1893/5900] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:36 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:37.426503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:37.427054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:37.433970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:37.434478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:37.434938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:37.435691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:37.436194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:37.436645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:37.576772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:37.585514 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a008441f-3c46-45b0-a171-a7c7158dd911 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1691 microversion: 2.1 time: 0.163274 Sep 14 10:20:37.586106 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4008/5901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:37 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:38.611184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:38.611798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:38.618905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:38.619393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:38.619832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:38.620555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:38.621010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:38.621435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:38.764562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:38.772624 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5b93f80b-1411-4e90-bede-3203ebd52af8 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1709 microversion: 2.1 time: 0.166070 Sep 14 10:20:38.773198 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1894/5902] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:38 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:39.797525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:39.798178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:39.805787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:39.806304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:39.806768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:39.807498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:39.808086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:39.808541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:39.944916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:39.954351 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-855c9fc7-43f2-42d5-87a6-4afeb5468e40 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1697 microversion: 2.1 time: 0.161412 Sep 14 10:20:39.954942 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4009/5903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:39 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:40.978537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:20:40.979263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:20:40.989629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:40.990108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:40.990538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:40.991224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:40.991668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:40.992122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:41.128291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:20:41.136336 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-49890d9a-21ea-4b24-8ec9-712306bc849f tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1682 microversion: 2.1 time: 0.161370 Sep 14 10:20:41.136647 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1895/5904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:20:40 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:20:41.237036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "name": "network-vif-unplugged", "status": "completed", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:20:41.250207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:41.250738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:41.251183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:41.264269 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] Creating event network-vif-unplugged:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:20:41.270395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ccf0815a-0120-4085-a880-a26dab450d78 req-766f521a-c13c-4e6c-ac4d-2059772ccf55 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037478 Sep 14 10:20:41.271030 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4010/5905] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:20:43.290395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "name": "network-vif-plugged", "status": "completed", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:20:43.300935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:20:43.301410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:20:43.301839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:20:43.313369 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] Creating event network-vif-plugged:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:20:43.318479 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-928ea319-d0d9-4d5f-a17a-c7623b309b4d req-24e26d6e-da62-412d-bdb6-655ba68eee48 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Sep 14 10:20:43.319090 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1896/5906] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:07.686958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=20 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:07.688596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=56 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:07.693540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:07.695905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:07.703768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:07.704591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:07.705064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:07.705788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:07.706264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:07.706710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:07.765312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf8e353c-3136-4dab-ab4d-e8e31e300039 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action" status: 200 len: 24570 microversion: 2.1 time: 0.080009 Sep 14 10:21:07.766806 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4011/5907] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:21:07 2022] POST /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936/action => generated 24570 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:21:19.393669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=26 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:19.401082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:19.402034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:19.406579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:19.407049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:19.407397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:19.414537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:19.415229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:19.415924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:19.416806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:19.417414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:19.418084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:19.451186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:21:19.500228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:19.512356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:19.512802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:19.513571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:19.525790 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] Creating event network-changed:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:21:19.531303 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-05acf7cf-52a8-4d61-bd66-6baebe2c5caa req-1051e42c-ea9e-4e0e-bd5f-1dfa6d1fc463 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135573 Sep 14 10:21:19.532895 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4012/5908] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:19.540081 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-03de346b-47f6-46a2-8f7f-91a4b6ab3e49 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 204 len: 0 microversion: 2.1 time: 0.147892 Sep 14 10:21:19.544345 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1897/5909] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:21:19 2022] DELETE /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:21:19.567749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:19.568518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:19.574983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:19.575498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:19.575990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:19.576723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:19.577205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:19.577655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:19.729824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:19.739212 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6f7989d3-c6d1-4629-a20b-5a44304e33ab tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1688 microversion: 2.1 time: 0.176850 Sep 14 10:21:19.739802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4013/5910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:19 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:20.763750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:20.764507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:20.772198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:20.772685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:20.773113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:20.773802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:20.774244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:20.774811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:21.086710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd5e84c18c44fef9a307110ff93e368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36e1ed33e600400cacb79a98608cd2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:21.095686 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06e65ba8-68d9-43d5-bdee-07cde3193eef tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 200 len: 1688 microversion: 2.1 time: 0.335383 Sep 14 10:21:21.096312 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1898/5911] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:20 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 1688 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:21.585536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecdc9655-76d3-4df1-949c-1cbc1eea6936", "name": "network-vif-deleted", "tag": "de67caef-33ab-4f82-be10-fdacf3856a15"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:21.597923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:21.598418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:21.598859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:21.611277 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] Creating event network-vif-deleted:de67caef-33ab-4f82-be10-fdacf3856a15 for instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 on n-h2-851028-12 Sep 14 10:21:21.616380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a0395928-e68a-48d0-af05-c58277273d15 req-307d2079-7c24-46f9-b8e7-6acb28b45bb7 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034457 Sep 14 10:21:21.617026 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4014/5912] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:22.118742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:22.119266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] [instance: ecdc9655-76d3-4df1-949c-1cbc1eea6936] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:22.126710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:22.127209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:22.127649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:22.128405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:22.129071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:22.129503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:22.146347 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] HTTP exception thrown: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Request method failure captured: Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 HTTP/1.1 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIamIwn3RJ2sV4qyfWlr30OzV_ISlamKzy4dn7OYMfGqc8Cun6CdN9vh8jEb2O_F_O8tOP_4EsShPcYfSJB4CdmM_m5W3BkOC_jT7qj2p_wBelFwpUhhIzGLJnilQti5MQ3XuEvMAnHnXydOswIfQWRI4FPooaVrNvr5P7iJmrsuIx_o Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_36e1ed33e600400cacb79a98608cd2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/36e1ed33e600400cacb79a98608cd2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/36e1ed33e600400cacb79a98608cd2fd"}]}] Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 36e1ed33e600400cacb79a98608cd2fd Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1743257912 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 0fd5e84c18c44fef9a307110ff93e368 Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1743257912-project Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ecdc9655-76d3-4df1-949c-1cbc1eea6936'} Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:22.148023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Returning 404 to user: Instance ecdc9655-76d3-4df1-949c-1cbc1eea6936 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b8211132-3dee-4ab2-9bee-fa7ebc720e5b tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936" status: 404 len: 111 microversion: 2.1 time: 0.034761 Sep 14 10:21:22.152461 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1899/5913] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:22 2022] GET /compute/v2.1/servers/ecdc9655-76d3-4df1-949c-1cbc1eea6936 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:21:25.258110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c3379297-4c60-455d-b1be-f22baed23a67 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] Calling method '.version_select at 0x7f693e08f4c0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:25.285974 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c3379297-4c60-455d-b1be-f22baed23a67 tempest-TestNetworkAdvancedServerOps-1743257912 tempest-TestNetworkAdvancedServerOps-1743257912-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-704403459" status: 202 len: 0 microversion: 2.1 time: 0.032855 Sep 14 10:21:25.287538 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4015/5914] 10.222.0.90 () {58 vars in 1281 bytes} [Wed Sep 14 10:21:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-704403459 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:21:37.214202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:37.215084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:37.326716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1982128685", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:37.380792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] validate_networks() for None {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:21:37.579969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:21:37.580391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:21:37.580855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:21:37.581269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:21:37.581679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:21:37.590386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:37.590861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:37.591292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:37.592052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:37.592764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:37.593184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:37.611239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Getting quotas for project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:21:37.616552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Getting quotas for user 3ee9e788b48545fabc1ed2afa877872d and project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:21:37.628571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:21:37.630842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:21:37.677757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-968cdbd4-59d6-460d-844e-8aea7e123678 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.470194 Sep 14 10:21:37.678435 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1900/5915] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:21:37.691975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f7d9b99f-f702-4db2-8347-4415adb31bbe tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:37.692738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f7d9b99f-f702-4db2-8347-4415adb31bbe tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:37.699790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:37.700898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:37.761632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f7d9b99f-f702-4db2-8347-4415adb31bbe tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:37.769619 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f7d9b99f-f702-4db2-8347-4415adb31bbe tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1222 microversion: 2.1 time: 0.082377 Sep 14 10:21:37.770344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4016/5916] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:37 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:38.792843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:38.793686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:38.801500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:38.801986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:38.802420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:38.803112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:38.803562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:38.804012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:38.870714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:38.879501 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2970e1ff-177b-4ad8-ba6d-1d9abc66f8ed tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1274 microversion: 2.1 time: 0.090509 Sep 14 10:21:38.880131 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1901/5917] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:38 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:39.903378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:39.903950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:39.912171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:39.912673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:39.913123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:39.913873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:39.914393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:39.914856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:40.064392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:40.072904 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2e44beb-2e65-48c2-bc68-151785b74546 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.173975 Sep 14 10:21:40.073729 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4017/5918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:39 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:40.724646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653d6dae-f017-4d08-ab57-d36c4ca9774c", "tag": "5289d135-a301-410f-ace5-a5d745afa0cd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:40.738550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:40.739034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:40.739470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:40.751858 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] Creating event network-changed:5289d135-a301-410f-ace5-a5d745afa0cd for instance 653d6dae-f017-4d08-ab57-d36c4ca9774c on n-h2-851028-12 Sep 14 10:21:40.756999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-dd9e79d3-6462-428b-92bb-60ac0b93df1a req-b8464613-4e8b-43e3-9cb7-68a58d07a647 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036430 Sep 14 10:21:40.757772 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1902/5919] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:41.097382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:41.098007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:41.105267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:41.105775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:41.106227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:41.106955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:41.107416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:41.107855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:41.243549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:41.252113 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4bf12c2-d11b-42be-80c1-f0abef18ed7e tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.158800 Sep 14 10:21:41.252690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4018/5920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:41 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:42.275396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:42.276059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:42.284013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:42.284499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:42.284936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:42.285640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:42.286094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:42.286521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:42.489136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:42.496911 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-074d83b3-6634-4f0e-ba20-df516650db7d tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.225858 Sep 14 10:21:42.497500 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1903/5921] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:42 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:43.524899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:43.525527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:43.532840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:43.533350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:43.533811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:43.534532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:43.535008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:43.535452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:43.668853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:43.677996 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04ce2dc4-86ba-42c2-a826-443819f9b8e0 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.157040 Sep 14 10:21:43.678583 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4019/5922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:43 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:44.700408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:44.701025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:44.708050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:44.708567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:44.709068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:44.709834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:44.710289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:44.710837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:44.848216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:44.855951 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a201d341-3d1f-4c72-a63f-214ed8f3682a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.159502 Sep 14 10:21:44.856544 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1904/5923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:44 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:45.879708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:45.880516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:45.887670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:45.888216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:45.888664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:45.889410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:45.889876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:45.890318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:46.022624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:46.030451 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b079bb8-363e-476b-b8a9-c45d1db21c0a tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.155527 Sep 14 10:21:46.031035 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4020/5924] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:45 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:47.053459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:47.054059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:47.060262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:47.060746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:47.061176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:47.061853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:47.062296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:47.062712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:47.418857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:47.427742 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0eb51b5f-08f7-4126-943c-90ee1169f09c tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.378019 Sep 14 10:21:47.428370 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1905/5925] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:47 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:47.508393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653d6dae-f017-4d08-ab57-d36c4ca9774c", "name": "network-vif-plugged", "status": "completed", "tag": "5289d135-a301-410f-ace5-a5d745afa0cd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:47.520010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:47.520562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:47.521017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:47.533087 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] Creating event network-vif-plugged:5289d135-a301-410f-ace5-a5d745afa0cd for instance 653d6dae-f017-4d08-ab57-d36c4ca9774c on n-h2-851028-12 Sep 14 10:21:47.538242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7f84e472-117b-4cde-a96b-8cd3773a6411 req-0c3e7703-4789-47d4-81b3-382e081bc964 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035557 Sep 14 10:21:47.538968 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4021/5926] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:48.450742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:48.451348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:48.453347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:48.454364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:48.465240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:48.466007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:48.466676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:48.468072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:48.468860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:48.470146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:48.625415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:48.637714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-400bc32c-f717-44c5-8265-1cd26d670063 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1322 microversion: 2.1 time: 0.190526 Sep 14 10:21:48.638701 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1906/5927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:48 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:49.661517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:21:49.666611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:49.667337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:49.674539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:49.675040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:49.675493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:49.676246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:49.676720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:49.677180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:49.808830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:49.817131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce93b7bb-5209-4275-a412-c88def98d3a9 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1472 microversion: 2.1 time: 0.156707 Sep 14 10:21:49.817706 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4022/5928] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:49 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:49.888540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-028987b6-657c-43e9-86d5-0ae1916613dc tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '.version_select at 0x7f693ec223a0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:49.953662 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-028987b6-657c-43e9-86d5-0ae1916613dc tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/5103772c3de7438ca8fc25b8197837f7" status: 200 len: 371 microversion: 2.1 time: 0.115181 Sep 14 10:21:49.954229 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1907/5929] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 10:21:49 2022] GET /compute/v2.1/os-quota-sets/5103772c3de7438ca8fc25b8197837f7 => generated 371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:49.966111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9729b27-0280-4115-94e8-f59e876e47f3 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-212427460", "id": 1271568601, "os-flavor-access:is_public": "True"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:49.973968 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:21:49.974129 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/flavors (ip 10.222.0.90) !!! Sep 14 10:21:49.995361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9729b27-0280-4115-94e8-f59e876e47f3 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.032930 Sep 14 10:21:49.996025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4023/5930] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:21:49 2022] POST /compute/v2.1/flavors => generated 437 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:50.008674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1271568601"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:50.011191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:50.017557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.018038 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.018468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.019153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.019597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.020113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.200688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '63597202377f4a439c7a6eccda5d2576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5103772c3de7438ca8fc25b8197837f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:50.207603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-212427460 {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:21:50.214190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.214665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.215093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.215806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.216285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.216702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.240207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Getting quotas for project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:21:50.245132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Getting quotas for user 3ee9e788b48545fabc1ed2afa877872d and project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:21:50.260622 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.compute.api [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] ram quota exceeded for 5103772c3de7438ca8fc25b8197837f7, tried to resize instance. Sep 14 10:21:50.261155 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Request method failure captured: Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action HTTP/1.1 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 39 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIasxCg9I6xd-SALLlJw1wuOvzyFEbHuPHLrzeCl3VgAACaDEl3fBTkQ0tHfcMFS9-eOcC4qIBT-HDn_hw7fNLjItN9lUXFTpxsXSIw9rF2DcRGKvW4HVBpfx8sla1bonzhZJL-0FpmseYfIXtSabZPVTK6GQ5yTgbeCQfpsTiQuU4yQ Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 5103772c3de7438ca8fc25b8197837f7 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Role: admin,member,reader Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: admin,member,reader Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5103772c3de7438ca8fc25b8197837f7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5103772c3de7438ca8fc25b8197837f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5103772c3de7438ca8fc25b8197837f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5103772c3de7438ca8fc25b8197837f7"}]}] Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 5103772c3de7438ca8fc25b8197837f7 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-1127749128-project-admin Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 63597202377f4a439c7a6eccda5d2576 Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1127749128-project-admin Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: {"resize": {"flavorRef": "1271568601"}} Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '653d6dae-f017-4d08-ab57-d36c4ca9774c', 'body': {'resize': {'flavorRef': '1271568601'}}} Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.276325 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1921a2ed-d2f0-4479-a43c-182a16f55af0 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action" status: 403 len: 118 microversion: 2.1 time: 0.272978 Sep 14 10:21:50.283824 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1908/5931] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:21:50 2022] POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action => generated 118 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:21:50.288822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1e15a3cd-4ed2-4f22-be65-5cd37e9cb541 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.309036 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1e15a3cd-4ed2-4f22-be65-5cd37e9cb541 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1271568601" status: 202 len: 0 microversion: 2.1 time: 0.023945 Sep 14 10:21:50.309603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4024/5932] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 10:21:50 2022] DELETE /compute/v2.1/flavors/1271568601 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:21:50.317620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f761882e-dda8-44a4-abcf-5ebc1c3eab97 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.340663 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f761882e-dda8-44a4-abcf-5ebc1c3eab97 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026678 Sep 14 10:21:50.341232 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1909/5933] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 10:21:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:21:50.362826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46114ae0-2cad-44c7-b748-823fdb9eb67b tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '.version_select at 0x7f693e9395e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.433213 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46114ae0-2cad-44c7-b748-823fdb9eb67b tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "GET /compute/v2.1/os-quota-sets/5103772c3de7438ca8fc25b8197837f7" status: 200 len: 371 microversion: 2.1 time: 0.074350 Sep 14 10:21:50.433779 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4025/5934] 10.222.0.90 () {58 vars in 1242 bytes} [Wed Sep 14 10:21:50 2022] GET /compute/v2.1/os-quota-sets/5103772c3de7438ca8fc25b8197837f7 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:50.446077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-789953ce-d3aa-4ea8-817d-07cdacbd83f5 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-845050237", "id": 1885691549, "os-flavor-access:is_public": "True"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:50.464433 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-789953ce-d3aa-4ea8-817d-07cdacbd83f5 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021985 Sep 14 10:21:50.465078 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1910/5935] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:21:50 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:50.478261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1885691549"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:50.480713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:50.487010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.487523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.488012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.488753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.489215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.489661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.577431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '63597202377f4a439c7a6eccda5d2576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5103772c3de7438ca8fc25b8197837f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:50.584303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-845050237 {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:21:50.591033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.591539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.592038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.593051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.593529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.594068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.618277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Getting quotas for project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:21:50.623512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Getting quotas for user 3ee9e788b48545fabc1ed2afa877872d and project 4fca3cc732a04b04a0560ffffa3501f5. Resources: {'cores', 'ram'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:21:50.637003 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] cores quota exceeded for 5103772c3de7438ca8fc25b8197837f7, tried to resize instance. Sep 14 10:21:50.637586 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Request method failure captured: Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action HTTP/1.1 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 39 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIasxCg9I6xd-SALLlJw1wuOvzyFEbHuPHLrzeCl3VgAACaDEl3fBTkQ0tHfcMFS9-eOcC4qIBT-HDn_hw7fNLjItN9lUXFTpxsXSIw9rF2DcRGKvW4HVBpfx8sla1bonzhZJL-0FpmseYfIXtSabZPVTK6GQ5yTgbeCQfpsTiQuU4yQ Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 5103772c3de7438ca8fc25b8197837f7 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Role: admin,member,reader Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: admin,member,reader Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_5103772c3de7438ca8fc25b8197837f7", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5103772c3de7438ca8fc25b8197837f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/5103772c3de7438ca8fc25b8197837f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/5103772c3de7438ca8fc25b8197837f7"}]}] Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 5103772c3de7438ca8fc25b8197837f7 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1127749128 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersAdminNegativeTestJSON-1127749128-project-admin Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 63597202377f4a439c7a6eccda5d2576 Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1127749128-project-admin Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: {"resize": {"flavorRef": "1885691549"}} Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '653d6dae-f017-4d08-ab57-d36c4ca9774c', 'body': {'resize': {'flavorRef': '1885691549'}}} Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.639699 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9879e6b-e9ad-4225-b91f-b33690294c01 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action" status: 403 len: 113 microversion: 2.1 time: 0.166890 Sep 14 10:21:50.644604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4026/5936] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:21:50 2022] POST /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c/action => generated 113 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:21:50.650717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6ab1ea8-cefb-4033-821e-bd8e0990e4c9 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.669137 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b6ab1ea8-cefb-4033-821e-bd8e0990e4c9 tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "DELETE /compute/v2.1/flavors/1885691549" status: 202 len: 0 microversion: 2.1 time: 0.022118 Sep 14 10:21:50.669709 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1911/5937] 10.222.0.90 () {58 vars in 1161 bytes} [Wed Sep 14 10:21:50 2022] DELETE /compute/v2.1/flavors/1885691549 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:21:50.678169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6ed63f8c-7cff-4eec-bd1f-c7eebac7ccbf tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.700201 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6ed63f8c-7cff-4eec-bd1f-c7eebac7ccbf tempest-ServersAdminNegativeTestJSON-1127749128 tempest-ServersAdminNegativeTestJSON-1127749128-project-admin] 10.222.0.90 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025588 Sep 14 10:21:50.700712 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4027/5938] 10.222.0.90 () {58 vars in 1146 bytes} [Wed Sep 14 10:21:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:50.722945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.723477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:50.729489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.729978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.730405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.731087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.731532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.731998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.757347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:21:50.833330 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5bae64a0-65fb-4560-9656-af9965386677 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "DELETE /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 204 len: 0 microversion: 2.1 time: 0.113994 Sep 14 10:21:50.834004 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1912/5939] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:21:50 2022] DELETE /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:21:50.842531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:50.843535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:50.849729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.850249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.850689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.851403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:50.851874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:50.852385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:50.991787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:50.999667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fdba09c5-c1ad-432e-a230-008a47983d9b tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1478 microversion: 2.1 time: 0.161279 Sep 14 10:21:51.000952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4028/5940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:50 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1478 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:52.024914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:52.025619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:52.032832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:52.033345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:52.033788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:52.034482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:52.034944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:52.035372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:52.178484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ee9e788b48545fabc1ed2afa877872d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fca3cc732a04b04a0560ffffa3501f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:21:52.186259 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6b82de7c-0f3b-4c71-8632-db4d33e349d3 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 200 len: 1478 microversion: 2.1 time: 0.165681 Sep 14 10:21:52.186846 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1913/5941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:52 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 1478 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:21:52.634534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653d6dae-f017-4d08-ab57-d36c4ca9774c", "name": "network-vif-deleted", "tag": "5289d135-a301-410f-ace5-a5d745afa0cd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:52.646507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:52.647010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:52.647462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:52.662227 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] Creating event network-vif-deleted:5289d135-a301-410f-ace5-a5d745afa0cd for instance 653d6dae-f017-4d08-ab57-d36c4ca9774c on n-h2-851028-12 Sep 14 10:21:52.669245 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6e169875-2c80-4651-bb0c-089ec7b3b63e req-a3738c4c-ee39-4732-8c55-5fec47ba934a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038131 Sep 14 10:21:52.669887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4029/5942] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:21:53.208665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:21:53.209288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] [instance: 653d6dae-f017-4d08-ab57-d36c4ca9774c] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:21:53.216271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:53.216762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:53.217204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:53.218223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:21:53.218633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:21:53.219214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:21:53.232763 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] HTTP exception thrown: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Request method failure captured: Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c HTTP/1.1 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIaswv_InCvaJxl_Fl_z3uOrTtMrIDThXc7vW7lQm8z5NW-G7Mi6ewdQNg3d_1bCuSpCSBx9UA-0Eix2Acc88Ds20jKX0gl6YhVI9_GPTaMmbmk-6QH3TGeBVOKdwtt82L19JI6j00Bw-qPm66cO28ROwiIJIo8iacLx-_RxrvMM5Pqw Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4fca3cc732a04b04a0560ffffa3501f5 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-883892082 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4fca3cc732a04b04a0560ffffa3501f5", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4fca3cc732a04b04a0560ffffa3501f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4fca3cc732a04b04a0560ffffa3501f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4fca3cc732a04b04a0560ffffa3501f5"}]}] Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersAdminNegativeTestJSON-883892082 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4fca3cc732a04b04a0560ffffa3501f5 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-883892082 Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersAdminNegativeTestJSON-883892082-project Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 3ee9e788b48545fabc1ed2afa877872d Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersAdminNegativeTestJSON-883892082-project Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '653d6dae-f017-4d08-ab57-d36c4ca9774c'} Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:53.234423 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] Returning 404 to user: Instance 653d6dae-f017-4d08-ab57-d36c4ca9774c could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f65477c-f023-4fdd-8595-f4e0bbc7dcb7 tempest-ServersAdminNegativeTestJSON-883892082 tempest-ServersAdminNegativeTestJSON-883892082-project] 10.222.0.90 "GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c" status: 404 len: 111 microversion: 2.1 time: 0.031716 Sep 14 10:21:53.239171 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1914/5943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:21:53 2022] GET /compute/v2.1/servers/653d6dae-f017-4d08-ab57-d36c4ca9774c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:21:59.558781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-680887553", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "34e0cb12-67cd-4bc4-b5ef-c0fea859ccb9"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:21:59.615695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] validate_networks() for [('34e0cb12-67cd-4bc4-b5ef-c0fea859ccb9', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:22:00.130167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:22:00.130618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:22:00.131120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:22:00.131555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:22:00.132017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:22:00.142511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:00.143019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:00.143473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:00.144290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:00.144764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:00.145205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:00.164206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Getting quotas for project e4c3ed6645fb4bcb861ddb9e3d39998a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:22:00.169917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Getting quotas for user d2c1a890761048dd9f28c0ecf1a6fe31 and project e4c3ed6645fb4bcb861ddb9e3d39998a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:22:00.184116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:22:00.186572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:22:00.238829 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3dae73c-c12f-480e-a95f-40d1093045bd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812898 Sep 14 10:22:00.239822 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4030/5944] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:21:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:22:00.252159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1acfdb18-19a3-4626-9b29-45163c3b4b2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:00.252933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1acfdb18-19a3-4626-9b29-45163c3b4b2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:00.255988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:00.256879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:00.315755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1acfdb18-19a3-4626-9b29-45163c3b4b2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:00.327506 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1acfdb18-19a3-4626-9b29-45163c3b4b2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1214 microversion: 2.1 time: 0.080305 Sep 14 10:22:00.329621 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1915/5945] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:00 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:01.359290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:01.360434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:01.369366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:01.370170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:01.371013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:01.371476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:01.371981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:01.372438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:01.445555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:01.455749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b93a0543-938e-48df-90a7-e15783c2d7c5 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1266 microversion: 2.1 time: 0.102616 Sep 14 10:22:01.461018 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4031/5946] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:01 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:02.484614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:02.485226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:02.492505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:02.493060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:02.493526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:02.494438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:02.494914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:02.495351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:02.938566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:02.954546 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17207ec0-9083-44e4-9ca8-419787422b84 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.473791 Sep 14 10:22:02.955318 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1916/5947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:02 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:03.372023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:03.387927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:03.388712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:03.389399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:03.409548 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] Creating event network-changed:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h2-851028-12 Sep 14 10:22:03.415708 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0fbe62cc-1d7b-404d-9ffe-737009c1b831 req-12cb3d6a-349d-45c8-8096-df8e17968222 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049050 Sep 14 10:22:03.416908 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4032/5948] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:03.979162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:03.979764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:03.986830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:03.987320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:03.987765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:03.988496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:03.988960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:03.989391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:04.125911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:04.133964 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7687ef38-faf4-404c-8f89-9cbe508c6f51 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.158863 Sep 14 10:22:04.134549 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1917/5949] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:03 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:05.157616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:05.158376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:05.165888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:05.166407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:05.166871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:05.167643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:05.168443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:05.168685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:05.301052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:05.309162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af27f811-7103-4fbb-b5ba-b33f7d2073da tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.156067 Sep 14 10:22:05.309763 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4033/5950] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:05 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:06.331735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:06.332382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:06.339249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:06.339738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:06.340228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:06.340927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:06.341386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:06.341816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:06.477501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:06.485980 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5923bb38-aa23-477e-8e6b-228087a6537e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.157592 Sep 14 10:22:06.486578 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1918/5951] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:06 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:07.509399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:07.510158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:07.517292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:07.517819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:07.518286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:07.519051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:07.519518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:07.520177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:07.666407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:07.674704 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-950c93a8-46d5-44b2-9ded-e8da29b3bea0 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.169313 Sep 14 10:22:07.675302 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4034/5952] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:07 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:08.698798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:08.699412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:08.702132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:08.708953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:08.709443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:08.709909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:08.710607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:08.711066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:08.711496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:08.716057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:08.846568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:08.854345 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94910516-9ed0-4433-9805-565fae0f099e tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.159570 Sep 14 10:22:08.854928 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1919/5953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:08 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:09.589233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "name": "network-vif-plugged", "status": "completed", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:09.597846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:09.602594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:09.603068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:09.603513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:09.606871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=76 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:09.618105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] Creating event network-vif-plugged:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h2-851028-12 Sep 14 10:22:09.623549 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1efbee0d-f4a6-4153-83e9-464bd3dab2a3 req-09306509-894c-4657-8c5d-4d4e02f33e2d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Sep 14 10:22:09.624225 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4035/5954] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:09.878827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:09.879454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:09.886271 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:09.886755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:09.887194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:09.888055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:09.888520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:09.888947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:10.021687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:10.029595 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2931289a-5bb9-4ff3-bc9e-a1a81d633b02 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1314 microversion: 2.1 time: 0.155375 Sep 14 10:22:10.030176 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1920/5955] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:09 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:11.051443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:11.052180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:11.057506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:11.058305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:11.066950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.067461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.067949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.068679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.069158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.069608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.203170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:11.211217 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1847bd20-e80f-4923-8f6d-86645275ebfd tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1502 microversion: 2.1 time: 0.160876 Sep 14 10:22:11.211805 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4036/5956] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:11 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:11.233676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:11.236186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:11.238862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:11.245212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.245703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.246148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.246869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.247326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.247751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.325017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:11.330843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:22:11.337843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:22:11.338268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:22:11.338747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:22:11.339161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:22:11.339575 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:22:11.452782 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9baad4a9-f550-48c7-b267-8eed2fac007d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "POST /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e/action" status: 202 len: 0 microversion: 2.1 time: 0.223056 Sep 14 10:22:11.453684 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1921/5957] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:22:11 2022] POST /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:22:11.461675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:11.462309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:11.468970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.469479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.469931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.470642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:11.471686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:11.472166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:11.614878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:11.623002 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d936e45-f8ca-4048-aa6a-9f24cf2af096 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1511 microversion: 2.1 time: 0.165176 Sep 14 10:22:11.623718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4037/5958] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:11 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:12.648341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:12.648956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:12.655207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:12.655691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:12.656155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:12.656846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:12.657298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:12.657722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:12.790699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:12.798618 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-788805e3-e563-49d0-95df-fc32c0b92bb9 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1511 microversion: 2.1 time: 0.155845 Sep 14 10:22:12.800160 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1922/5959] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:12 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:13.822804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:13.823432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:13.830450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:13.830957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:13.831410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:13.832158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:13.832636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:13.833084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:13.970615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:13.979835 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-394dd7ec-8d97-4597-b4a5-947a04b528d8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.160985 Sep 14 10:22:13.980458 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4038/5960] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:13 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:15.004185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:15.004797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:15.012286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:15.012775 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:15.013207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:15.013900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:15.014382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:15.014809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:15.147839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:15.155597 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-348bc5bd-13f4-4c60-8852-67a7fbe1e492 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.155447 Sep 14 10:22:15.156196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1923/5961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:14 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:16.179925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:16.180560 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:16.186667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:16.187160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:16.187604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:16.188337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:16.188802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:16.189237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:16.325938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:16.334320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66d7594a-fafa-4012-bce6-25269c0471f7 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158689 Sep 14 10:22:16.334904 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4039/5962] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:16 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:17.358163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:17.358758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:17.366350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:17.366830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:17.367270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:17.367987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:17.368438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:17.368857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:17.505343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:17.514791 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9b5312ba-645d-4cd5-907a-84b9cddf2f4c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.160532 Sep 14 10:22:17.515381 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1924/5963] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:17 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:18.538072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:18.538700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:18.545601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:18.546100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:18.546547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:18.547250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:18.547716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:18.548205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:18.684044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:18.692808 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fe0b96c5-4217-4a95-94a3-4fc778af4a09 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158627 Sep 14 10:22:18.693403 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4040/5964] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:18 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:19.717048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:19.717681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:19.724825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:19.725310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:19.725741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:19.726421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:19.726866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:19.727284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:19.863576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:19.871556 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34283954-d89d-4860-be7c-bf8da277820d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158541 Sep 14 10:22:19.872173 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1925/5965] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:19 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:20.896370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:20.896944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:20.903963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:20.904477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:20.904936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:20.905657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:20.906134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:20.906585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:21.037671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:21.045388 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d42a2ec8-af4b-4958-b64b-411859569a0c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.154010 Sep 14 10:22:21.045970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4041/5966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:20 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:22.068444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:22.068975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:22.075913 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:22.076532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:22.076969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:22.077664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:22.078121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:22.078548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:22.219826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:22.228345 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fdce5d07-6a02-4671-a5de-bab92af33ded tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.164274 Sep 14 10:22:22.228931 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1926/5967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:22 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:23.252627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:23.254033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:23.261243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.261753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.262209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.262925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:23.263408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:23.263855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:23.400507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:23.409091 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-677d9301-1260-4071-a035-5cfbb862ba33 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.159659 Sep 14 10:22:23.409920 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4042/5968] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:23 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:24.433914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:24.434511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:24.442098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:24.442586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:24.443028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:24.443727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:24.444215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:24.444654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:24.577888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:24.586928 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-def3280f-4536-4ae9-afcf-000ece28ae5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.156889 Sep 14 10:22:24.587518 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1927/5969] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:24 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:22:25.610791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:25.612146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:25.619036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:25.619527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:25.620001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:25.620707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:25.621169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:25.621602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:25.751638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:25.759981 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6502ce14-1090-4ffb-988b-a7e87ad0d332 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.153076 Sep 14 10:22:25.760569 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4043/5970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:25 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:26.783256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:26.784123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:26.790925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:26.791408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:26.791844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:26.792565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:26.793020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:26.793560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:26.926915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:26.934631 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18192ff6-35e5-4859-be3f-96de11554d46 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.155489 Sep 14 10:22:26.935206 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1928/5971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:26 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:27.959075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:27.959639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:27.966573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:27.967076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:27.967534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:27.968527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:27.969000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:27.969442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:28.103077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:28.110984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ef2a92d3-356b-4fd2-96ca-0a3dfedba859 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.157037 Sep 14 10:22:28.111605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4044/5972] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:27 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:29.133999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:29.134615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:29.141605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:29.142090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:29.143144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:29.143866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:29.144355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:29.144786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:29.280695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:29.288549 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3915776-6633-47aa-8b1e-a238d34fd6f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158473 Sep 14 10:22:29.289132 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1929/5973] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:29 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:30.312347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:30.312995 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:30.320733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:30.321239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:30.321699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:30.322420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:30.322898 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:30.323404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:30.462168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:30.470925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a07811b-7cbd-438d-a124-28c1fc580a15 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.162052 Sep 14 10:22:30.471579 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4045/5974] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:30 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:31.494885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:31.495523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:31.503200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:31.503653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:31.504131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:31.504920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:31.505507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:31.505996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:31.640382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:31.648906 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3631f60-cea3-4cf2-a68e-37606826b5f8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158024 Sep 14 10:22:31.649481 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1930/5975] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:31 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:32.672032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:32.672660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:32.679786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:32.680315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:32.680767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:32.681482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:32.681948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:32.682391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:32.818444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:32.826355 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1cb5aeea-f849-4dd0-8050-98d3b4e28c82 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.158355 Sep 14 10:22:32.826933 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4046/5976] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:32 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:33.850678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:33.851279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:33.858206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:33.858686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:33.859121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:33.859813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:33.860295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:33.860723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:34.001873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:34.009619 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae106afd-1e4c-4645-8035-d8d784b85465 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.162911 Sep 14 10:22:34.010207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1931/5977] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:33 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:35.034174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:35.034832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:35.042118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:35.042626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:35.043084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:35.043806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:35.044310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:35.044758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:35.190190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:35.198237 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8815695-6ef3-4e3f-a05f-a230cc05d909 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.168502 Sep 14 10:22:35.198830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4047/5978] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:35 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:36.221822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:36.222420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:36.229268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:36.229759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:36.230226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:36.230918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:36.231374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:36.231805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:36.363088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:36.370837 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92f6b887-9d57-4391-8291-fc4420986aaa tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.153344 Sep 14 10:22:36.371416 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1932/5979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:36 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:37.394828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:37.395495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:37.402422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:37.402935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:37.403370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:37.404106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:37.404576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:37.405016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:37.547255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:37.555356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1353bbe4-94a6-4df5-aec3-aa6175ac13d6 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.165192 Sep 14 10:22:37.556005 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4048/5980] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:37 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:38.577977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:38.578591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:38.585797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:38.586283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:38.586716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:38.587405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:38.587856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:38.588315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:38.728001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:38.735706 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6c7a5b71-147d-419c-8fc4-0d24a08005f2 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.161691 Sep 14 10:22:38.737104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1933/5981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:38 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:39.759147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:39.759781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:39.766795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:39.767297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:39.767753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:39.768497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:39.768972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:39.769448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:39.773435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=80 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:39.910849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:39.919025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3aae73f1-bdcc-40b6-9758-41bd5768a42a tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1516 microversion: 2.1 time: 0.163808 Sep 14 10:22:39.919612 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4049/5982] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:39 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:40.943449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:40.944105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:40.946909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:40.952599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:40.953095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:40.953541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:40.954247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:40.955417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:40.955835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:40.959088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:41.101427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:41.106551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "name": "network-vif-unplugged", "status": "completed", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:41.110359 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2f73a31e-a091-4dcb-9f68-ce3a65c44c3d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1515 microversion: 2.1 time: 0.171401 Sep 14 10:22:41.115948 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1934/5983] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:40 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:41.116323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=30 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:22:41.121129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:41.121759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:41.122243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:41.135966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Creating event network-vif-unplugged:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h1-851028-12 Sep 14 10:22:41.141470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] Instance b0623010-19f2-4b73-a98d-baf6e0abca2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:22:41.153683 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-ae6ec544-cb13-45a4-959d-ab26c3e87958 req-eafb035d-afba-474d-982e-5ff7eaa58707 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050798 Sep 14 10:22:41.154967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4050/5984] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:42.136602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:42.137296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:42.144667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:42.145329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:42.145836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:42.147310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:42.148273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:42.148817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:42.295187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:42.305182 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07efe5b0-29bd-4512-b888-c58b92706f2c tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1515 microversion: 2.1 time: 0.172776 Sep 14 10:22:42.305699 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1935/5985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:42 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:43.184929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:43.196176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:43.196676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:43.197131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:43.209333 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Creating event network-changed:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h1-851028-12 Sep 14 10:22:43.214786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] Instance b0623010-19f2-4b73-a98d-baf6e0abca2e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:22:43.226995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-11b830f4-85d8-4f11-9fd2-2f66679e472c req-828141f9-447b-4b84-ad0f-357fb775ff18 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046000 Sep 14 10:22:43.228091 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4051/5986] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:43.329213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:43.329912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:43.336868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:43.337353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:43.337786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:43.338473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:43.338925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:43.339382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:43.562632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:43.576085 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e64185ff-cc40-4227-8121-b4811dcb3e41 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1513 microversion: 2.1 time: 0.249651 Sep 14 10:22:43.576834 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1936/5987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:43 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:44.601381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:44.602142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:44.608735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:44.609244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:44.609698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:44.610414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:44.610937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:44.611383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:44.751632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:44.760081 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c857d878-077b-4682-961f-151918522eca tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1510 microversion: 2.1 time: 0.164004 Sep 14 10:22:44.760776 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4052/5988] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:44 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:44.782687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:44.783180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:44.791156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:44.791630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:44.792107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:44.792804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:44.793260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:44.793688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:44.824455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:22:44.876855 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.compute.api [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Found an unconfirmed migration during delete, id: 16, status: finished Sep 14 10:22:46.248754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-db8c9185-fd37-4cba-9559-fd0c9bced05b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 204 len: 0 microversion: 2.1 time: 1.469681 Sep 14 10:22:46.253932 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1937/5989] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:22:44 2022] DELETE /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 0 bytes in 1471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:22:46.262945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:46.263638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:46.270542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:46.271051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:46.271510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:46.272261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:46.272740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:46.273186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:46.407040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:46.415422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4af8950-9955-4f2d-a42c-09621a0b032b tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1502 microversion: 2.1 time: 0.156546 Sep 14 10:22:46.416352 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4053/5990] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:46 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:47.255694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "name": "network-vif-plugged", "status": "completed", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:47.268488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:47.269303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:47.269878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:47.282076 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] Creating event network-vif-plugged:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h1-851028-12 Sep 14 10:22:47.288636 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c2703183-fb8b-4419-a757-d7b57fa477fc req-69a7772e-55eb-4bf1-abd2-f9062c142ac6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037901 Sep 14 10:22:47.289833 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1938/5991] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:47.446316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:47.446985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:47.454951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:47.455503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:47.456359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:47.457521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:47.458650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:47.459113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:47.694014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:47.701809 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-930c6212-a194-4f9f-b0b2-ed9213a1e5f1 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1502 microversion: 2.1 time: 0.259510 Sep 14 10:22:47.702408 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4054/5992] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:47 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:48.441266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0623010-19f2-4b73-a98d-baf6e0abca2e", "name": "network-vif-deleted", "tag": "77be0cdf-1f03-4860-885a-6b7d5dca5ae7"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:48.451174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:48.451661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:48.452131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:48.465002 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] Creating event network-vif-deleted:77be0cdf-1f03-4860-885a-6b7d5dca5ae7 for instance b0623010-19f2-4b73-a98d-baf6e0abca2e on n-h1-851028-12 Sep 14 10:22:48.470489 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-90b3f38c-bee6-472e-b0c1-082394af23c0 req-0d590caa-f9dd-4af6-a068-a25298ceec0a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Sep 14 10:22:48.471111 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1939/5993] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:22:48.730837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:48.731720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:48.740253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:48.740761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:48.741218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:48.741940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:48.742418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:48.742860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:48.779445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:48.779989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:48.780443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:48.780915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lazy-loading 'fault' on Instance uuid b0623010-19f2-4b73-a98d-baf6e0abca2e {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:22:48.824800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2c1a890761048dd9f28c0ecf1a6fe31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4c3ed6645fb4bcb861ddb9e3d39998a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:48.833722 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b2f5f5e9-9b39-4031-8502-b3dcaaaf3c5d tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 200 len: 1304 microversion: 2.1 time: 0.109031 Sep 14 10:22:48.834307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4055/5994] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:48 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:22:49.859865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:49.860930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:49.868580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.869144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.869585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.870657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.871373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.871808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.892274 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] HTTP exception thrown: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Request method failure captured: Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e HTTP/1.1 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIatHMFCGcDBAkKJhjf1bvU5GZC8nIhfF4UvfhU92aRy4C---HCkjtTSfwZiBumOLIkiBhq7gsyLFWI5sRsTqwG8ctS3lG7S53cuZOwtITMVPn3GedmjpGlM8Jmj4aF5vUm3iTe8YEemCDZrGNJjW-xZjaNlmSsFJ_ETNimPw4xgDxyM Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e4c3ed6645fb4bcb861ddb9e3d39998a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}] Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d2c1a890761048dd9f28c0ecf1a6fe31 Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b0623010-19f2-4b73-a98d-baf6e0abca2e'} Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.893970 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Returning 404 to user: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d2ad505-4ec5-4b1c-a7f9-c7e048a8ee90 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 404 len: 111 microversion: 2.1 time: 0.041158 Sep 14 10:22:49.899509 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1940/5995] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:49 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:22:49.909843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:49.910548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:49.918886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.919413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.919856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.920610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.921119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.921569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.936771 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] HTTP exception thrown: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Request method failure captured: Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e HTTP/1.1 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIatHMFCGcDBAkKJhjf1bvU5GZC8nIhfF4UvfhU92aRy4C---HCkjtTSfwZiBumOLIkiBhq7gsyLFWI5sRsTqwG8ctS3lG7S53cuZOwtITMVPn3GedmjpGlM8Jmj4aF5vUm3iTe8YEemCDZrGNJjW-xZjaNlmSsFJ_ETNimPw4xgDxyM Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e4c3ed6645fb4bcb861ddb9e3d39998a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}] Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: d2c1a890761048dd9f28c0ecf1a6fe31 Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'b0623010-19f2-4b73-a98d-baf6e0abca2e'} Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:22:49.938823 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Returning 404 to user: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-449b358d-994a-457c-b325-83391d9771df tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 404 len: 111 microversion: 2.1 time: 0.035017 Sep 14 10:22:49.943738 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4056/5996] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:22:49 2022] DELETE /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:22:49.950273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:49.950920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] [instance: b0623010-19f2-4b73-a98d-baf6e0abca2e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:49.957170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.957673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.958310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.959075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:49.959525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:49.959981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:49.981524 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] HTTP exception thrown: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Request method failure captured: Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e HTTP/1.1 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIatHMFCGcDBAkKJhjf1bvU5GZC8nIhfF4UvfhU92aRy4C---HCkjtTSfwZiBumOLIkiBhq7gsyLFWI5sRsTqwG8ctS3lG7S53cuZOwtITMVPn3GedmjpGlM8Jmj4aF5vUm3iTe8YEemCDZrGNJjW-xZjaNlmSsFJ_ETNimPw4xgDxyM Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_e4c3ed6645fb4bcb861ddb9e3d39998a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/e4c3ed6645fb4bcb861ddb9e3d39998a"}]}] Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: e4c3ed6645fb4bcb861ddb9e3d39998a Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-DeleteServersTestJSON-1628229984 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: d2c1a890761048dd9f28c0ecf1a6fe31 Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-DeleteServersTestJSON-1628229984-project Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b0623010-19f2-4b73-a98d-baf6e0abca2e'} Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:22:49.984367 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] Returning 404 to user: Instance b0623010-19f2-4b73-a98d-baf6e0abca2e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-722b127a-20a9-4ecd-97d5-1d37004eb4e8 tempest-DeleteServersTestJSON-1628229984 tempest-DeleteServersTestJSON-1628229984-project] 10.222.0.90 "GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e" status: 404 len: 111 microversion: 2.1 time: 0.040140 Sep 14 10:22:49.988182 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1941/5997] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:49 2022] GET /compute/v2.1/servers/b0623010-19f2-4b73-a98d-baf6e0abca2e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:22:59.110538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1066560219", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "a112e057-5503-4a4d-a4ae-05f3e6a28794"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:22:59.167573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] validate_networks() for [('a112e057-5503-4a4d-a4ae-05f3e6a28794', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:22:59.623027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:22:59.623488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:22:59.624252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:22:59.624679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:22:59.625102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:22:59.634952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:59.635456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:59.635908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:59.636668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:22:59.637134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:22:59.637572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:22:59.655284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for project d8712d32000244debffcade75e29c98a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:22:59.661041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for user 81f1296bf54443868650164f99482b49 and project d8712d32000244debffcade75e29c98a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:22:59.673891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:22:59.676247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:22:59.722964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04037638-1944-47d5-9008-86346b1aaf50 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735173 Sep 14 10:22:59.723859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4057/5998] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:22:59.735011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17e3fac9-83f9-4c07-9256-8dde966312a1 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:22:59.735613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17e3fac9-83f9-4c07-9256-8dde966312a1 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:22:59.800219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17e3fac9-83f9-4c07-9256-8dde966312a1 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:22:59.808446 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17e3fac9-83f9-4c07-9256-8dde966312a1 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1218 microversion: 2.1 time: 0.077150 Sep 14 10:22:59.820218 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1942/5999] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:22:59 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:00.844679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:00.846081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:00.863511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:00.864910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:00.865370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:00.866135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:00.866606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:00.867048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:00.985002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:00.994624 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b079063a-b26f-41db-9e42-b3a7cf129c43 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1288 microversion: 2.1 time: 0.164342 Sep 14 10:23:00.995217 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4058/6000] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:00 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1288 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:23:02.021126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:02.022087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:02.024254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:02.042025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:02.042672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:02.043350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:02.044188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:02.044871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:02.045495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:02.201531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:02.210905 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c0a8492c-114c-462a-8702-a01be05c5068 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.196067 Sep 14 10:23:02.212525 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1943/6001] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:02 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:02.333251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:02.349324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:02.350235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:02.350628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:02.362934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] Creating event network-changed:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h1-851028-12 Sep 14 10:23:02.373132 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-55491ee7-2c54-461c-b542-bf01022a8afe req-109eca6c-7497-4522-99ae-e510bcd6582b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048273 Sep 14 10:23:02.373927 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4059/6002] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:03.236016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:03.236639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:03.243599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:03.244126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:03.244570 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:03.245275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:03.245710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:03.246139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:03.384436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:03.392116 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-684b6460-4ebf-402e-9deb-31b04bd4d030 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.159962 Sep 14 10:23:03.392694 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1944/6003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:03 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:04.417100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:04.417734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:04.425947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:04.427495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:04.427993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:04.428720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:04.429194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:04.429639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:04.565847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:04.574791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f57ee930-b3cb-4be5-856b-6272e7e2f5c9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.162105 Sep 14 10:23:04.575405 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4060/6004] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:04 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:05.600516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:05.601132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:05.608098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:05.608583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:05.609020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:05.609712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:05.610193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:05.610620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:05.745443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:05.753217 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-95c3f115-ba74-4a5a-8ffd-9b416bd84b2a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.157060 Sep 14 10:23:05.753823 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1945/6005] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:05 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:06.776940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:06.777628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:06.784583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:06.785087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:06.786116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:06.786943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:06.787628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:06.788137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:06.918883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:06.927970 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a185fdc2-6840-40e6-b03e-57549f445677 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.155004 Sep 14 10:23:06.928558 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4061/6006] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:06 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:07.950853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:07.951465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:07.959203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:07.959689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:07.960151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:07.960846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:07.961329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:07.961783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:08.096708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:08.105430 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ba43bcee-b065-45f6-a0e0-6e872074de11 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.158517 Sep 14 10:23:08.106005 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1946/6007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:07 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:09.128164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:09.128793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:09.136349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:09.136848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:09.137309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:09.138013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:09.138478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:09.138917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:09.376595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "name": "network-vif-plugged", "status": "completed", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:09.389586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:09.390206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:09.390685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:09.405682 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] Creating event network-vif-plugged:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h1-851028-12 Sep 14 10:23:09.411277 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-14010416-3b2a-4713-a88a-a99e97023c21 req-76c13d16-b454-4cb0-8db4-7982437a797f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038530 Sep 14 10:23:09.412026 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1947/6008] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:23:09.620623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:09.628469 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8da0077f-994b-4607-a554-c68245ea7035 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.504329 Sep 14 10:23:09.629052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4062/6009] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:09 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:10.649600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:10.655306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:10.656073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:10.663680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:10.664202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:10.664683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:10.665391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:10.665879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:10.666310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:10.806986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:10.814902 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3861b3b8-cd9b-4ee3-94d1-d8b093c03fc2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1318 microversion: 2.1 time: 0.166360 Sep 14 10:23:10.815485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1948/6010] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:10 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:11.838555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:11.839192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:11.841307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:11.842139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:11.844309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:11.852110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:11.852631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:11.853092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:11.853821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:11.854387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:11.854843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:11.859520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=70 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:11.991486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:11.999356 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-912900f9-9894-407a-8b13-b423d5502d57 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1509 microversion: 2.1 time: 0.164824 Sep 14 10:23:11.999954 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4063/6011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:11 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:12.021840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:12.022475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.025154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:12.030917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.031383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.031825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.032544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.033000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.033430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.178855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:12.186663 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-689f14f3-d4b4-4fa1-800f-be012f53f041 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1509 microversion: 2.1 time: 0.169254 Sep 14 10:23:12.187242 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1949/6012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:12 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:12.209384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:12.211754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.217948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.218729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.219192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.219935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.220415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.220884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.285977 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40c7fcb4-82ff-460e-96d3-27a403adc4f8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "PUT /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1081 microversion: 2.1 time: 0.080274 Sep 14 10:23:12.286990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4064/6013] 10.222.0.90 () {60 vars in 1256 bytes} [Wed Sep 14 10:23:12 2022] PUT /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1081 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:12.309382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:12.309988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.316075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.316557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.317079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.317788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.318238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.318658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.452984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:12.461501 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3c5b83a-3fad-4e7a-9660-5e7796f9fc51 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1507 microversion: 2.1 time: 0.155995 Sep 14 10:23:12.462016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1950/6014] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:12 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:12.484225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:12.484888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.491654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.492201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.492669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.493427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.493924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.494431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.625310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:12.633162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cf186a17-9de2-467b-87df-81f46b81ba07 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1507 microversion: 2.1 time: 0.152909 Sep 14 10:23:12.633748 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4065/6015] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:12 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:12.655928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:12.658201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.664852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.665336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.665776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.666469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.666921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.667346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.695395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:12.701021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Old instance type m1.heat2, new instance type m1.heat {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:23:12.710438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:23:12.710867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:23:12.711350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:23:12.711819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:23:12.712225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:23:12.779617 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8e3e6b1b-35f4-4e4f-aa8c-24ab29c94536 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028/action" status: 202 len: 0 microversion: 2.1 time: 0.127564 Sep 14 10:23:12.780270 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1951/6016] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:23:12 2022] POST /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:23:12.789104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:12.789743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:12.795836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.796386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.796849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.797724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:12.798206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:12.798656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:12.947451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:12.955732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85e704b5-29de-41a3-a440-160367ba4394 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1518 microversion: 2.1 time: 0.171204 Sep 14 10:23:12.956427 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4066/6017] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:12 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:13.979926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:13.980546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:13.986562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:13.987054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:13.987484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:13.988446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:13.989258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:13.989748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:14.128534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:14.137083 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6ec2b3a-8531-4931-8ba5-7bec7a8c5153 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1518 microversion: 2.1 time: 0.162037 Sep 14 10:23:14.137675 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1952/6018] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:13 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:15.161465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:15.162391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:15.172361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:15.173131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:15.173302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:15.174028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:15.174494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:15.174932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:15.323168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:15.331097 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd37dc32-b466-4b66-a780-40b85b8ef62f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.174365 Sep 14 10:23:15.331680 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4067/6019] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:15 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:16.354917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:16.355436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:16.362146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:16.362629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:16.363058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:16.364365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:16.364809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:16.365228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:16.503681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:16.512335 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1131d3b7-d470-4ab0-b4ef-027f09164a0e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.161336 Sep 14 10:23:16.512925 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1953/6020] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:16 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:17.538120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:17.538738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:17.546056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:17.546760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:17.547275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:17.548042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:17.548519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:17.549117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:17.687300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:17.695536 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b595979d-abce-481d-b849-cb23e702df73 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.162484 Sep 14 10:23:17.696229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4068/6021] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:17 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:18.719379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:18.720028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:18.727650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:18.728170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:18.728604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:18.729295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:18.729743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:18.730165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:18.862136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:18.870324 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-847e105c-9e22-4697-977a-6e86ae7b16eb tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.155117 Sep 14 10:23:18.870893 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1954/6022] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:18 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:19.894561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:19.895198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:19.902245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:19.902751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:19.903212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:19.903946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:19.904421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:19.904865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:20.040747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:20.048746 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31f4b792-30e2-471a-8826-2417294f3ee4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.158127 Sep 14 10:23:20.049329 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4069/6023] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:19 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:21.073331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:21.073939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:21.080890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:21.081370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:21.081803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:21.082487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:21.082932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:21.084036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:21.213628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:21.222263 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd5f3ffc-7fc3-4545-848b-817b10eb0b21 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.152782 Sep 14 10:23:21.222850 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1955/6024] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:21 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:22.245130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:22.245773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:22.252960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:22.253471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:22.253930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:22.254648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:22.255124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:22.255703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:22.392798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:22.401721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-78c54129-1ab0-4cc6-8d43-614206b57e8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.160650 Sep 14 10:23:22.402312 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4070/6025] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:22 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:23:23.426312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:23.426923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:23.435069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:23.435551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:23.436010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:23.436702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:23.437152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:23.437571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:23.571556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:23.579250 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-040e52cc-dc19-4fb0-86fc-27d0605ab00e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.157262 Sep 14 10:23:23.579825 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1956/6026] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:23 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:24.603446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:24.604097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:24.611154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:24.611652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:24.612137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:24.612843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:24.613312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:24.613747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:24.751540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:24.759512 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05dc6842-4489-41d3-b4b1-ec91b4c1bde0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.160791 Sep 14 10:23:24.760130 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4071/6027] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:24 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:25.781941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:25.782535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:25.790106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:25.790586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:25.791013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:25.791698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:25.792172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:25.792594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:25.926635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:25.934820 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b409b300-ed94-42ba-83a6-e5c3d5b354cc tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.156762 Sep 14 10:23:25.935411 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1957/6028] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:25 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:26.958597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:26.959325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:26.966434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:26.966931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:26.967384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:26.968127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:26.968865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:26.969301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:27.107295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:27.115921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2eeaa119-67d8-4b18-884e-3445d83630ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.160653 Sep 14 10:23:27.116506 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4072/6029] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:26 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:28.138679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:28.139273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:28.146939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:28.147426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:28.147863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:28.148588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:28.149069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:28.149497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:28.286599 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:28.290310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:28.295720 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ae402c2-3aa9-40d9-80db-7a30f5f1edc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.160973 Sep 14 10:23:28.296331 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1958/6030] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:28 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:29.320645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:29.321270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:29.328303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:29.328801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:29.329249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:29.329958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:29.330424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:29.330867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:29.465845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:29.473977 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e99d2d8-22a3-453b-9f9c-e922d1c1d405 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.157942 Sep 14 10:23:29.475225 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4073/6031] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:29 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:30.498334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:30.498946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:30.508307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:30.508789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:30.509253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:30.509972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:30.510426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:30.510843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:30.642578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:30.650313 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6d17bd08-64f4-4186-b060-62406f7202ed tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.155784 Sep 14 10:23:30.651436 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1959/6032] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:30 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:31.673470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:31.674101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:31.684320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:31.684833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:31.685565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:31.686698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:31.687179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:31.687626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:31.827080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:31.835744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdf90192-4549-45d4-ab6c-8a662cd2aa46 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.166356 Sep 14 10:23:31.836358 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4074/6033] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:31 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:32.859695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:32.860544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:32.868908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:32.869399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:32.869839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:32.870583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:32.871040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:32.871461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:33.011106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:33.018840 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad0f0f9b-848d-4994-a1a7-9b11d6017229 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.163996 Sep 14 10:23:33.019412 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1960/6034] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:32 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:34.042355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:34.042991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:34.050046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:34.050549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:34.051006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:34.051716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:34.052221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:34.052666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:34.187017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:34.195164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-396c94fb-a13e-4d9f-8f1c-0c716711121a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.156796 Sep 14 10:23:34.195750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4075/6035] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:34 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:35.219666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:35.220316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:35.228169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:35.228661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:35.229101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:35.229804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:35.230263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:35.230801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:35.371402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:35.379419 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab07fd53-e93a-4f3a-a3ca-6917b361f669 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.164013 Sep 14 10:23:35.380020 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1961/6036] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:35 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:36.403790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:36.404452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:36.411576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:36.412122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:36.412574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:36.413290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:36.413756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:36.414193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:36.556566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:36.564320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8cc7314f-3d00-4d26-9d16-432406b675ae tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.165191 Sep 14 10:23:36.564902 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4076/6037] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:36 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:23:37.587112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:37.587733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:37.595046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:37.595536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:37.596011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:37.596710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:37.597169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:37.597595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:37.727191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:37.737176 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6e81508f-fbd9-4194-b9f3-f50aa1cc9113 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.153995 Sep 14 10:23:37.737754 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1962/6038] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:37 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:38.761475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:38.762036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:38.769035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:38.769544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:38.770001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:38.770723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:38.771203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:38.771650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:38.905585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:38.913705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4410b277-6fc3-40fa-880a-9c2dad20bc28 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.156204 Sep 14 10:23:38.914295 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4077/6039] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:38 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:39.939128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:39.939732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:39.946799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:39.947296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:39.947734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:39.948455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:39.949133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:39.949572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:40.087510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:40.095625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ccb2c7e-45a3-4b13-a9a1-c0ba9bf20f8b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.160707 Sep 14 10:23:40.096249 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1963/6040] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:39 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:41.120680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:41.121320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:41.128452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:41.128960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:41.129415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:41.130144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:41.130616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:41.131061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:41.273473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:41.281513 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a3f52d08-0789-43e3-a8bb-2b3e7571d1c2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.165658 Sep 14 10:23:41.287069 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4078/6041] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:41 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:42.305535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:42.306151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:42.308892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:42.314585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:42.315073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:42.315515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:42.316250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:42.316730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:42.317165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:42.450004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:42.457882 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e899bc3-76c3-47e5-9312-6b5c9b4f470a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.156363 Sep 14 10:23:42.458463 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1964/6042] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:42 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:43.481997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:43.482545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:43.485422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:43.490942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:43.491453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:43.491949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:43.492683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:43.493273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:43.494266 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:43.497131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:43.635446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:43.643337 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-49b82675-50c8-4d49-9147-a4c3d739ce62 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.166044 Sep 14 10:23:43.643966 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4079/6043] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:43 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:44.667315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:44.667986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:44.675125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:44.675621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:44.676127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:44.676826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:44.677284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:44.677712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:44.812077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:44.819809 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ed28f6f3-92ce-4a46-9b69-fbe414f847b9 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.157117 Sep 14 10:23:44.820421 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1965/6044] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:44 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:45.844890 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:45.845492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:45.852586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:45.853333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:45.853835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:45.854639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:45.855109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:45.855787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:45.996953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:46.004832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51f55982-2710-47bb-b518-39f4815dcf6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1523 microversion: 2.1 time: 0.164217 Sep 14 10:23:46.005410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4080/6045] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:45 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:46.861186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "name": "network-vif-unplugged", "status": "completed", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:46.871996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:46.872489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:46.872925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:46.885667 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Creating event network-vif-unplugged:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h2-851028-12 Sep 14 10:23:46.891245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] Instance 9f900fa6-415b-422c-878f-95db47898028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:23:46.903071 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-a8632117-61e0-472f-bca4-b266bbe33f56 req-2a6aaf82-30de-43e9-8411-b1102aa5cb9b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045677 Sep 14 10:23:46.903666 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1966/6046] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:47.029829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:47.030449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:47.036827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:47.037331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:47.037779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:47.038490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:47.038959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:47.039396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:47.184662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:47.192749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0eba5c8-0388-4b88-905b-0e3be27a5eaf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1522 microversion: 2.1 time: 0.167154 Sep 14 10:23:47.193355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4081/6047] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:47 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:48.218968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:48.219675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:48.225906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:48.226394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:48.226835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:48.227721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:48.228181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:48.228614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:48.364961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:48.373354 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0448439c-d4f5-42b5-b48c-491e1a459133 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1520 microversion: 2.1 time: 0.159909 Sep 14 10:23:48.373932 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1967/6048] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:48 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:48.925397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:48.935698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:48.936220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:48.936666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:48.949439 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Creating event network-changed:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h2-851028-12 Sep 14 10:23:48.955042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] Instance 9f900fa6-415b-422c-878f-95db47898028 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:23:48.967705 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4939e652-de94-4e66-90a9-12702b40986f req-8961a878-b0fe-44f1-94ee-88190adb961f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046094 Sep 14 10:23:48.968575 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4082/6049] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:23:49.397357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:49.397959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:49.405207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:49.405683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:49.406109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:49.406824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:49.407270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:49.407690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:49.584629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:49.593425 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b6e7f981-e67b-4e37-a827-d2073bc36026 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1520 microversion: 2.1 time: 0.200017 Sep 14 10:23:49.594278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1968/6050] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:49 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:50.621913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:50.622796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:50.631237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.631792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.632284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:50.633014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.633487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.634658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:50.807860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:50.816174 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e55e1ae-67d2-4a99-93c3-0acd4f33317d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1517 microversion: 2.1 time: 0.200901 Sep 14 10:23:50.816774 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4083/6051] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:50 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:50.843482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:50.844366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:50.853583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.854585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.855025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:50.855836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.856313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.856759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:50.930843 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-776a41d4-1233-45cc-bca8-81837e786e49 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028/action" status: 204 len: 0 microversion: 2.1 time: 0.090931 Sep 14 10:23:50.931419 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1969/6052] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:23:50 2022] POST /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:23:50.941162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:50.942079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:50.951118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.952006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.952479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:50.953223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:50.953706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:50.954178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:51.257532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:51.266592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9ec976d-ff5a-47d3-a9df-59d5a5dcacea tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1517 microversion: 2.1 time: 0.330079 Sep 14 10:23:51.267424 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4084/6053] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:50 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1517 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:52.294262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:52.295150 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:52.304660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:52.305159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:52.306119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:52.307384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:52.307934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:52.308315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:52.458879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:52.467050 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b0e72ad6-a531-46b4-ba99-becf17102d6a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1509 microversion: 2.1 time: 0.178802 Sep 14 10:23:52.467632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1970/6054] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:52 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:52.491725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:52.492390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:52.500125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:52.500624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:52.501074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:52.501788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:52.502253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:52.502692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:52.632910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:52.640721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e1767d91-5396-404b-a890-bbaf2ef38da0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1509 microversion: 2.1 time: 0.152921 Sep 14 10:23:52.641303 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4085/6055] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:52 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:52.666285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-16fad0a6-c85d-48d9-9bf7-3550415c9a09 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'create', calling method: .version_select at 0x7f6944137a60>, body: {"keypair": {"name": "tempest-keypair-204439081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVAp1L5tNgrLAEc3GSSDrSKGrf4X47wVNPTW2LiVVgaXRzudh+2vPfcSN29H3VPQPuA3W5FnuoQu6HWG+f1pKdhkrvvZ2EVMqmO3QtY+7eitkFPcOegyDtw2FQyjCRzbw=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:52.682018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-16fad0a6-c85d-48d9-9bf7-3550415c9a09 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for project d8712d32000244debffcade75e29c98a. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:23:52.687084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-16fad0a6-c85d-48d9-9bf7-3550415c9a09 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for user 81f1296bf54443868650164f99482b49 and project d8712d32000244debffcade75e29c98a. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:23:52.711307 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-16fad0a6-c85d-48d9-9bf7-3550415c9a09 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049380 Sep 14 10:23:52.712117 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1971/6056] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:23:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:53.941518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:53.942296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:53.950966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:53.951707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:53.952531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:53.953737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:53.954299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:53.954776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:53.969770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "name": "network-vif-plugged", "status": "completed", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:53.984944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:53.985748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:53.986402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:53.998900 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] Creating event network-vif-plugged:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h2-851028-12 Sep 14 10:23:54.005185 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d8f933e6-776b-452c-92dc-17e951276d97 req-8647cb6f-a05a-4214-807c-cf2146a18c59 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041027 Sep 14 10:23:54.006431 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1972/6057] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:54.105309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:54.113288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4962fbd-f9a3-4474-960d-c894ee15c59e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 200 len: 1509 microversion: 2.1 time: 0.175956 Sep 14 10:23:54.113876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4086/6058] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:53 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:54.136401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:54.136986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:54.143373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:54.143860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:54.144327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:54.145015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:54.145468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:54.145905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:54.173528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:23:54.251036 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-82472704-8ec1-463b-9bfa-f589e6a956a4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 204 len: 0 microversion: 2.1 time: 0.119076 Sep 14 10:23:54.251845 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1973/6059] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:23:54 2022] DELETE /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:23:54.310378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-931045652", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "a112e057-5503-4a4d-a4ae-05f3e6a28794"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:54.365827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] validate_networks() for [('a112e057-5503-4a4d-a4ae-05f3e6a28794', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:23:54.747706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:23:54.748223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:23:54.748714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:23:54.749137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:23:54.749564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:23:54.759166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:54.759787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:54.760276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:54.761023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:54.761497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:54.761936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:54.779412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for project d8712d32000244debffcade75e29c98a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:23:54.784741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Getting quotas for user 81f1296bf54443868650164f99482b49 and project d8712d32000244debffcade75e29c98a. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:23:54.797212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:23:54.799593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:23:54.846630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ec047c5b-3a3b-41cb-9efa-c4cc61bb823e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540267 Sep 14 10:23:54.847943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4087/6060] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:23:54.858991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-650341d3-565f-40be-a753-d17d7909729b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:54.859700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-650341d3-565f-40be-a753-d17d7909729b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:54.916382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-650341d3-565f-40be-a753-d17d7909729b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:54.923117 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-650341d3-565f-40be-a753-d17d7909729b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1217 microversion: 2.1 time: 0.068312 Sep 14 10:23:54.923705 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1974/6061] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:54 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:55.947612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:55.948829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:55.956314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:55.957034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:55.957930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:55.958631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:55.959258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:55.959875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:56.062678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:56.076587 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1266f208-7f10-4954-850c-979de7a7f57e tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1287 microversion: 2.1 time: 0.134064 Sep 14 10:23:56.077205 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4088/6062] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:55 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1287 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:23:56.148729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f900fa6-415b-422c-878f-95db47898028", "name": "network-vif-deleted", "tag": "5e992373-dec1-4a63-992e-f93cb499710b"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:56.167293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:56.167782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:56.168252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:56.188877 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] Creating event network-vif-deleted:5e992373-dec1-4a63-992e-f93cb499710b for instance 9f900fa6-415b-422c-878f-95db47898028 on n-h2-851028-12 Sep 14 10:23:56.195328 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-3e473d63-a0cb-4bb3-832d-a8b2cdc41926 req-eeff8587-e7b2-45dd-9ba7-1a27936bfa07 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050115 Sep 14 10:23:56.199582 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1975/6063] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:57.100198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:57.100838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:57.107929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:57.108440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:57.108896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:57.109638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:57.110107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:57.110552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:57.312366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:57.320414 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab8bcdbd-e634-4057-a2dd-6af2e8d39601 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.224084 Sep 14 10:23:57.321954 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4089/6064] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:57 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:57.414629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016de18e-ddfe-41e8-9856-e799e15418f6", "tag": "41ed86ed-cba4-490a-ba9b-9e6c78352b3c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:23:57.426447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:57.427115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:57.428161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:57.441757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] Creating event network-changed:41ed86ed-cba4-490a-ba9b-9e6c78352b3c for instance 016de18e-ddfe-41e8-9856-e799e15418f6 on n-h1-851028-12 Sep 14 10:23:57.447868 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-429426e2-8713-494a-81dc-e36ac26baeb8 req-f81d0d05-28d2-45c5-adda-381eb1ec30b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038486 Sep 14 10:23:57.448672 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1976/6065] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:23:58.344896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:58.345548 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:58.353208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:58.353740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:58.354198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:58.354900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:58.355363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:58.355805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:58.495755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:58.503865 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b9982cf-0158-441b-bc1e-b2f5b0f4e23a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.163057 Sep 14 10:23:58.504478 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4090/6066] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:58 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:23:59.529415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:23:59.530049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:23:59.536457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:59.536940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:59.537376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:59.538079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:23:59.538535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:23:59.538962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:23:59.541806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:23:59.676223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:23:59.684547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d11ea046-453d-4f1b-97f4-358e903f974f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.161105 Sep 14 10:23:59.685128 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1977/6067] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:23:59 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:00.708330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:00.708967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:00.716604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:00.717110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:00.717563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:00.718276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:00.718747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:00.719449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:00.857161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:00.865162 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1791feb-4b14-46a7-8699-619a803ca205 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.160871 Sep 14 10:24:00.865749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4091/6068] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:00 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:01.888177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:01.888790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:01.895631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:01.896565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:01.896565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:01.897250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:01.897696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:01.898116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:02.042316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:02.050950 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-447efdca-e267-47c7-a821-c713ccba7b0b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.166692 Sep 14 10:24:02.051534 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1978/6069] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:01 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:03.077754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:03.078382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:03.085318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:03.085815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:03.086261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:03.087781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:03.088352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:03.088795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:03.221434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:03.229961 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c7da19ed-2186-403a-b237-039b1d3be1ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.156271 Sep 14 10:24:03.230554 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4092/6070] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:03 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:03.660357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016de18e-ddfe-41e8-9856-e799e15418f6", "name": "network-vif-plugged", "status": "completed", "tag": "41ed86ed-cba4-490a-ba9b-9e6c78352b3c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:03.671644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:03.672159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:03.672591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:03.686890 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] Creating event network-vif-plugged:41ed86ed-cba4-490a-ba9b-9e6c78352b3c for instance 016de18e-ddfe-41e8-9856-e799e15418f6 on n-h1-851028-12 Sep 14 10:24:03.691835 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-aa0ecc12-e606-41ac-8223-c50e8082c6c1 req-d114e01d-f004-4e74-87e6-a3b331c61ab8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035198 Sep 14 10:24:03.692472 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1979/6071] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:04.253216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:04.253841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:04.260973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:04.262096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:04.262606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:04.263351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:04.263833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:04.264320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:04.396504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:04.404709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-96384d88-586d-43d8-af2b-811a715ac79d tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1317 microversion: 2.1 time: 0.155385 Sep 14 10:24:04.405291 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4093/6072] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:04 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:05.426372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:05.430889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:05.432187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:05.438332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.438826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.439238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.439935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.440388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.440806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.575113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:05.582905 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f2f0638b-9a7d-4f05-827a-dfc86ad311e8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1507 microversion: 2.1 time: 0.158874 Sep 14 10:24:05.583480 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1980/6073] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:05 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:05.606338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:05.606978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:05.609074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:05.609910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:05.616978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.617484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.617941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.618661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.619886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.620555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.755206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:05.763706 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0454f23-7974-4333-8bce-5e711ad0e9aa tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1507 microversion: 2.1 time: 0.162236 Sep 14 10:24:05.764313 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4094/6074] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:05 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:05.785990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:05.788427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:05.795110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.795590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.796052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.796986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.797434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.797853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.827249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:05.832870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Old instance type m1.heat2, new instance type m1.heat {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:24:05.839377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:24:05.839785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:24:05.840277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:24:05.840706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:24:05.841110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:24:05.904397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34452db0-9604-43c2-a6c3-ecac0f118358 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6/action" status: 202 len: 0 microversion: 2.1 time: 0.122594 Sep 14 10:24:05.905016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1981/6075] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:24:05 2022] POST /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:24:05.917900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:05.918092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:05.926480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.926991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.927458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:05.928193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:05.928666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:05.929165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:06.069454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:06.078242 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e665987e-fae3-419d-bb96-c35d7b693ca2 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1514 microversion: 2.1 time: 0.165504 Sep 14 10:24:06.078981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4095/6076] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:05 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:07.102426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:07.103069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:07.110184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:07.110675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:07.111111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:07.111807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:07.112288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:07.112710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:07.260886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:07.268887 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e481aa8-2dc5-419d-af5b-822991693ab8 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1514 microversion: 2.1 time: 0.171155 Sep 14 10:24:07.269477 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1982/6077] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:07 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:08.293215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:08.293850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:08.300907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:08.301411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:08.301864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:08.302579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:08.303206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:08.303653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:08.438714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:08.441012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:08.448782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e599f290-5d81-4e56-ad83-31c96f920432 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.159962 Sep 14 10:24:08.449386 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4096/6078] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:08 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:09.473139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:09.473696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:09.481347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:09.481843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:09.482284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:09.482981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:09.483442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:09.483926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:09.620519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:09.628326 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7dd275c6-2fd3-48bb-a303-e8608806d4ee tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.159469 Sep 14 10:24:09.628907 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1983/6079] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:09 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:10.656684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:10.657304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:10.664528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:10.665034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:10.665486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:10.666697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:10.667170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:10.667614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:10.804619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:10.812521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eb397fe6-ae2c-429e-b5fb-02356895bf06 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.159968 Sep 14 10:24:10.813102 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4097/6080] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:10 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:11.834696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:11.835312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:11.843119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:11.843601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:11.844323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:11.845016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:11.845467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:11.845888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:11.981107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:11.988798 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d13874e-ba30-4473-b4fa-f3af295a0235 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.158021 Sep 14 10:24:11.989371 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1984/6081] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:11 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:13.011820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:13.012491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:13.019766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:13.020307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:13.020767 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:13.021487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:13.021963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:13.022413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:13.156430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:13.164433 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-48a66bc2-d01f-4fe9-a9ec-18873dc85cd3 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.156548 Sep 14 10:24:13.165216 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4098/6082] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:13 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:14.189186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:14.189804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:14.192539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:14.198334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:14.198822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:14.199266 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:14.199985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:14.200443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:14.200873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:14.388301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:14.396175 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-94514e7d-0d88-4ccf-b60d-c5f9bf49f224 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.210938 Sep 14 10:24:14.396751 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1985/6083] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:14 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:15.420706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:15.421322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:15.424340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:15.429791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:15.430293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:15.430744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:15.431455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:15.431942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:15.433036 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:15.622356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:15.630238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2722b39e-ac07-48bb-9583-a218ea4c5029 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.213618 Sep 14 10:24:15.630839 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4099/6084] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:15 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:16.657388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:16.657996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:16.664248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:16.664732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:16.665265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:16.665945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:16.666321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:16.666753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:16.802368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:16.811194 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2bafbdb3-7491-4dde-b28c-b6c7d6be7f7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.158092 Sep 14 10:24:16.811786 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1986/6085] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:16 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:17.834808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:17.835370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:17.842701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:17.843209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:17.843673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:17.844688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:17.845161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:17.845609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:17.977043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:17.985535 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9834c9ec-b96d-44a8-923f-72da253eb084 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.154768 Sep 14 10:24:17.986361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4100/6086] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:17 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:19.008895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:19.009537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:19.016425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:19.016910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:19.017346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:19.018034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:19.018483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:19.018911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:19.150452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:19.161901 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b30d07d-337a-4268-96cd-702beb2fb48b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.156904 Sep 14 10:24:19.162493 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1987/6087] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:19 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:20.186198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:20.186872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:20.193895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:20.194397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:20.194853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:20.195575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:20.196107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:20.196551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:20.344776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:20.352585 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5543757-0e0b-4375-a243-f78173f7346a tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.170411 Sep 14 10:24:20.353166 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4101/6088] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:20 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:21.375093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:21.375701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:21.382489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:21.382967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:21.383464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:21.384108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:21.384554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:21.384974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:21.517598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:21.525337 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-04f58143-fc37-41c6-9cfa-8928114ab4b7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.154612 Sep 14 10:24:21.525917 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1988/6089] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:21 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:22.548906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:22.549688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:22.556824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:22.557331 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:22.557788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:22.558503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:22.559636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:22.560146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:22.695210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:22.703465 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ecb25142-cb27-4beb-a1a1-d480ab9b9047 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.158503 Sep 14 10:24:22.704075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4102/6090] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:22 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:23.726682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:23.727356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:23.736735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:23.737633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:23.738826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:23.739002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:23.739379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:23.739807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:23.875112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:23.882760 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b61e6c60-8f41-43a1-9ce6-30c0e180d534 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.159995 Sep 14 10:24:23.883342 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1989/6091] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:23 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:24.906646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:24.907278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:24.914287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:24.914791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:24.915248 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:24.916001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:24.916482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:24.916927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:25.050975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:25.059488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aba58c18-5a1f-4d91-9773-35bf799d1281 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.157328 Sep 14 10:24:25.060154 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4103/6092] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:24 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:26.082894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:26.083502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:26.091008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:26.091522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:26.091992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:26.092682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:26.093127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:26.093545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:26.226081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:26.234161 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a47fb5c-a806-44f8-847b-4acaeeecd564 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.155192 Sep 14 10:24:26.234767 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1990/6093] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:26 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:27.258262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:27.258906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:27.268768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:27.269278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:27.269734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:27.270455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:27.270924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:27.271370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:27.407251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:27.415142 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81cdca6e-b5f1-4504-a8af-9f946235aa12 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.160781 Sep 14 10:24:27.415732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4104/6094] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:27 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:28.440258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:28.440793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:28.447556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:28.448069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:28.448505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:28.449187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:28.450250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:28.450672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:28.591106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:28.599234 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb4ca248-3342-4df9-8572-c5ff97ee1313 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.163044 Sep 14 10:24:28.599824 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1991/6095] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:28 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:29.621862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:29.622566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:29.629663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:29.630168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:29.630623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:29.631348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:29.631818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:29.632359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:29.767945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:29.775983 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f214c9c6-9e4d-45e3-8ebb-7383db399612 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.158278 Sep 14 10:24:29.776597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4105/6096] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:29 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:30.800721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:30.801337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:30.808247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:30.808735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:30.809923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:30.810623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:30.811077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:30.811505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:30.814087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:30.944174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:30.952185 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c5d7e40-505e-45f4-9027-8723730d9196 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.155324 Sep 14 10:24:30.952765 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1992/6097] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:30 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:31.976398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:31.976957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:31.984554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:31.985050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:31.985498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:31.986202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:31.986666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:31.987105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:32.120316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:32.128512 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd45c250-261f-43b8-ab46-21ebb3bc68cf tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.156220 Sep 14 10:24:32.129112 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4106/6098] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:31 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:33.152407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:33.153790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:33.161559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:33.162056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:33.162493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:33.163207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:33.163665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:33.164142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:33.302509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:33.310877 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-65230f4d-fa09-4911-a02d-242630075c08 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.162407 Sep 14 10:24:33.311453 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1993/6099] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:33 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:34.334895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:34.335464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:34.343656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:34.344566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:34.345019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:34.345734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:34.346207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:34.346648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:34.526628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:34.535260 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79a90393-776b-4906-829f-e3816a0b092f tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1519 microversion: 2.1 time: 0.204408 Sep 14 10:24:34.535858 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4107/6100] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:34 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:35.129228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016de18e-ddfe-41e8-9856-e799e15418f6", "name": "network-vif-unplugged", "status": "completed", "tag": "41ed86ed-cba4-490a-ba9b-9e6c78352b3c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:35.140904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:35.141493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:35.141903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:35.154924 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Creating event network-vif-unplugged:41ed86ed-cba4-490a-ba9b-9e6c78352b3c for instance 016de18e-ddfe-41e8-9856-e799e15418f6 on n-h2-851028-12 Sep 14 10:24:35.160522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] Instance 016de18e-ddfe-41e8-9856-e799e15418f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:24:35.171755 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-c8b190fc-9cf6-49a2-823d-7cb8d38d6d47 req-5969b073-8cb5-4d46-a770-ff73dcab1c3d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046241 Sep 14 10:24:35.172565 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1994/6101] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:35.558945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:35.559645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:35.566700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:35.567238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:35.567707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:35.568458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:35.568935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:35.569384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:35.719862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:35.728744 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97b8eb66-e6b2-4c18-ad2b-6dfa1ef608e0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1518 microversion: 2.1 time: 0.173925 Sep 14 10:24:35.729341 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4108/6102] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:35 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:36.757265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:36.758011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:36.764654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:36.765167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:36.765609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:36.766304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:36.766757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:36.767180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:36.908649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:36.916387 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-70f9c036-01ba-4693-b318-1a9b6f03b7f4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1516 microversion: 2.1 time: 0.164304 Sep 14 10:24:36.916959 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1995/6103] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:36 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:37.187203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016de18e-ddfe-41e8-9856-e799e15418f6", "tag": "41ed86ed-cba4-490a-ba9b-9e6c78352b3c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:37.197998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:37.198492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:37.198934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:37.211444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Creating event network-changed:41ed86ed-cba4-490a-ba9b-9e6c78352b3c for instance 016de18e-ddfe-41e8-9856-e799e15418f6 on n-h2-851028-12 Sep 14 10:24:37.217072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] Instance 016de18e-ddfe-41e8-9856-e799e15418f6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:24:37.229530 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-e4123400-03b6-41fe-969f-a5c492155314 req-f2921cd4-1fc2-4143-b0ca-709ba3c0016c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046662 Sep 14 10:24:37.230190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4109/6104] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:37.941598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:37.942212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:37.948932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:37.949417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:37.949847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:37.950532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:37.951667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:37.952194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:38.084261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:38.092018 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21bbdd70-4741-42a0-ab8d-1fc6320c642b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1513 microversion: 2.1 time: 0.154302 Sep 14 10:24:38.092606 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1996/6105] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:37 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:38.115740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:38.116428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:38.123474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:38.124000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:38.124453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:38.125165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:38.125630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:38.126222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:38.189042 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56183f9c-92c5-412b-b9c9-cfe13360c25c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "POST /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6/action" status: 204 len: 0 microversion: 2.1 time: 0.077635 Sep 14 10:24:38.189704 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4110/6106] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:24:38 2022] POST /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:24:38.197957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:38.198564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:38.204855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:38.205338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:38.205768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:38.206465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:38.206916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:38.207334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:38.341732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:38.349993 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ced0c3b5-c023-41cf-8885-48490af395c7 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1513 microversion: 2.1 time: 0.156022 Sep 14 10:24:38.350591 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1997/6107] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:38 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:39.375589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:39.376432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:39.382809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.383389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.383844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.384587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.385056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.385498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.537342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:39.545371 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd477765-a553-4731-b6ee-19d364bafbc0 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1505 microversion: 2.1 time: 0.175424 Sep 14 10:24:39.545963 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4111/6108] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:39 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:39.567621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:39.568349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:39.575280 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.576331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.576794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.577474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.577927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.578351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.715474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:39.724147 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-db10e7ce-d60a-46c3-99ac-25f54e009831 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1505 microversion: 2.1 time: 0.160314 Sep 14 10:24:39.724724 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1998/6109] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:39 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:39.746351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:39.747194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:39.753498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.754005 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.754674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.755382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.755861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.756334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.779846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:39.899606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:39.908110 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f80daebf-ec80-45c0-a9e4-831355054280 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1505 microversion: 2.1 time: 0.166128 Sep 14 10:24:39.908694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4112/6110] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:39 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:39.930222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:39.930618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:39.937297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.937788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.938225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.938915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:39.939369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:39.939799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:39.965245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:24:40.043504 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3994f5fc-6c90-467b-bf0a-56cdac0103ba tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "DELETE /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 204 len: 0 microversion: 2.1 time: 0.116924 Sep 14 10:24:40.044404 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 1999/6111] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:24:39 2022] DELETE /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:24:40.064765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:40.065287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:40.071371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:40.071883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:40.072379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:40.073103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:40.073581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:40.074031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:40.104629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:24:40.151342 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.compute.api [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Instance is already in deleting state, ignoring this request Sep 14 10:24:40.152239 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-53231d4b-f26e-4a02-8e67-9264e457a3ac tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "DELETE /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 204 len: 0 microversion: 2.1 time: 0.092117 Sep 14 10:24:40.152828 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4113/6112] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:24:40 2022] DELETE /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:24:40.162508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:40.163216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:40.170240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:40.170899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:40.171344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:40.172102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:40.172945 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:40.173615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:40.313502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:40.321888 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ad7b8ea5-e8be-42a5-b55b-041db19ce088 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1511 microversion: 2.1 time: 0.164024 Sep 14 10:24:40.322490 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2000/6113] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:40 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:41.347169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:41.347829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:41.355043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:41.355559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:41.356056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:41.356790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:41.357275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:41.357726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:41.497130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:41.507396 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1e2dfa8-8e98-406d-a168-5b5842046a7c tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1511 microversion: 2.1 time: 0.164336 Sep 14 10:24:41.508414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4114/6114] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:41 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:42.180708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016de18e-ddfe-41e8-9856-e799e15418f6", "name": "network-vif-deleted", "tag": "41ed86ed-cba4-490a-ba9b-9e6c78352b3c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:42.191424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:42.191922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:42.192527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:42.204483 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] Creating event network-vif-deleted:41ed86ed-cba4-490a-ba9b-9e6c78352b3c for instance 016de18e-ddfe-41e8-9856-e799e15418f6 on n-h2-851028-12 Sep 14 10:24:42.209372 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-11d742ae-3eb9-4712-a7ca-ad7f77e739d1 req-51751343-c2b9-4b9b-8cd6-112debd9e364 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096952 Sep 14 10:24:42.209981 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2001/6115] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:42.532760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:42.533406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:42.541181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:42.541748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:42.542218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:42.542953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:42.543423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:42.543868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:42.579631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:42.580217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:42.580715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:42.581229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lazy-loading 'fault' on Instance uuid 016de18e-ddfe-41e8-9856-e799e15418f6 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:24:42.630626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f1296bf54443868650164f99482b49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8712d32000244debffcade75e29c98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:42.637947 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b57eebf2-4ef0-4422-9fa6-78bd2cf9c78b tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 200 len: 1305 microversion: 2.1 time: 0.110486 Sep 14 10:24:42.638580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4115/6116] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:42 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:43.664371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:43.665087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 016de18e-ddfe-41e8-9856-e799e15418f6] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:43.671311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.671797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.672933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.673643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:43.674101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:43.674533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:43.687875 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] HTTP exception thrown: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Request method failure captured: Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 HTTP/1.1 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIauCWqzvppoyh9tUStU1LQckQnFQKpg2sYFooG1Ner8ubRNGMm3Iym-UZYgAwNNGWIk_OQcr0y4g55HPhipj5Rxpl0i4jO6WFYHxDnTEC1_sMliMsJFpC09YH8VA1rKf6xBigOVmRXZQgQdbFiS2pLbZTAsV_nZueJW55DobyAh0DrU Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d8712d32000244debffcade75e29c98a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d8712d32000244debffcade75e29c98a"}]}] Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 81f1296bf54443868650164f99482b49 Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '016de18e-ddfe-41e8-9856-e799e15418f6'} Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:43.689538 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Returning 404 to user: Instance 016de18e-ddfe-41e8-9856-e799e15418f6 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97a3bf7b-9255-472f-abc4-09d31fb713b4 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6" status: 404 len: 111 microversion: 2.1 time: 0.031790 Sep 14 10:24:43.694074 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2002/6117] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:43 2022] GET /compute/v2.1/servers/016de18e-ddfe-41e8-9856-e799e15418f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:24:43.699733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7dfe2170-4914-4dec-be5e-fc1fec955974 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '.version_select at 0x7f693fb785e0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:43.723986 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7dfe2170-4914-4dec-be5e-fc1fec955974 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204439081" status: 202 len: 0 microversion: 2.1 time: 0.028023 Sep 14 10:24:43.724592 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4116/6118] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 10:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204439081 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:24:44.348241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:44.348772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:44.350759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:44.356503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.356989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.357425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.358108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.358591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.359017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.374708 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] HTTP exception thrown: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Request method failure captured: Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 HTTP/1.1 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIauCWqzvppoyh9tUStU1LQckQnFQKpg2sYFooG1Ner8ubRNGMm3Iym-UZYgAwNNGWIk_OQcr0y4g55HPhipj5Rxpl0i4jO6WFYHxDnTEC1_sMliMsJFpC09YH8VA1rKf6xBigOVmRXZQgQdbFiS2pLbZTAsV_nZueJW55DobyAh0DrU Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d8712d32000244debffcade75e29c98a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d8712d32000244debffcade75e29c98a"}]}] Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 81f1296bf54443868650164f99482b49 Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '9f900fa6-415b-422c-878f-95db47898028'} Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:24:44.376744 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Returning 404 to user: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2a19b42-8dff-4aa9-9bb5-42fa887d5919 tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "DELETE /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 404 len: 111 microversion: 2.1 time: 0.034986 Sep 14 10:24:44.383219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2003/6119] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:24:44 2022] DELETE /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:24:44.389295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:44.389933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] [instance: 9f900fa6-415b-422c-878f-95db47898028] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:44.396716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.397215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.397663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.398400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:44.398864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:44.399303 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:44.413583 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] HTTP exception thrown: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Request method failure captured: Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 HTTP/1.1 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIauCWqzvppoyh9tUStU1LQckQnFQKpg2sYFooG1Ner8ubRNGMm3Iym-UZYgAwNNGWIk_OQcr0y4g55HPhipj5Rxpl0i4jO6WFYHxDnTEC1_sMliMsJFpC09YH8VA1rKf6xBigOVmRXZQgQdbFiS2pLbZTAsV_nZueJW55DobyAh0DrU Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_d8712d32000244debffcade75e29c98a", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/d8712d32000244debffcade75e29c98a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/d8712d32000244debffcade75e29c98a"}]}] Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: d8712d32000244debffcade75e29c98a Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1117359071 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 81f1296bf54443868650164f99482b49 Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerDiskConfigTestJSON-1117359071-project Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '9f900fa6-415b-422c-878f-95db47898028'} Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:24:44.415335 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] Returning 404 to user: Instance 9f900fa6-415b-422c-878f-95db47898028 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdf78202-51b0-4365-9712-e97f4d5d43ec tempest-ServerDiskConfigTestJSON-1117359071 tempest-ServerDiskConfigTestJSON-1117359071-project] 10.222.0.90 "GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028" status: 404 len: 111 microversion: 2.1 time: 0.031719 Sep 14 10:24:44.419197 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4117/6120] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:44 2022] GET /compute/v2.1/servers/9f900fa6-415b-422c-878f-95db47898028 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:24:53.658841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97cbb2c4-46a8-4915-9645-e9ec42f5dcc2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: .version_select at 0x7f693f4bb670>, body: {"keypair": {"name": "tempest-keypair-297667874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8sd2Kp/0hfNNpudX7q/S1WERIngQeMeHP816GJtCxKTBPitAr+zywPGWAF0eQTVNMkB61MdRB31mmukFLeF+/Pce7Li4n/dtZV7vE8dmQITzPi2Bwh2GINjPdryDE3qQ=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:53.675165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-97cbb2c4-46a8-4915-9645-e9ec42f5dcc2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:24:53.680917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-97cbb2c4-46a8-4915-9645-e9ec42f5dcc2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:24:53.707105 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97cbb2c4-46a8-4915-9645-e9ec42f5dcc2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173800 Sep 14 10:24:53.707794 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2004/6121] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:24:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:24:55.069996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1054484243", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c0acb54b-56df-4c14-b860-5c190fd47f84"}], "security_groups": [{"name": "tempest-securitygroup--1592678454"}], "key_name": "tempest-keypair-297667874", "user_data": "}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:55.080046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:55.081870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:55.200480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] validate_networks() for [('c0acb54b-56df-4c14-b860-5c190fd47f84', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:24:55.588821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:24:55.589318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:24:55.589856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:24:55.590227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:24:55.590863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:24:55.601368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:55.602015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:55.602484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:55.603254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:55.603724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:55.604219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:55.623019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:24:55.628636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:24:55.641638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:24:55.644177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:24:55.692176 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7966f7a5-fe93-40b1-9534-2551cfde459e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.627057 Sep 14 10:24:55.696067 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4118/6122] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:24:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:24:55.707693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21dc577d-a705-4733-85df-2a5d65a4c1a0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:55.708544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21dc577d-a705-4733-85df-2a5d65a4c1a0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:55.712408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:24:55.783275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21dc577d-a705-4733-85df-2a5d65a4c1a0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:55.792064 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21dc577d-a705-4733-85df-2a5d65a4c1a0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1238 microversion: 2.1 time: 0.091936 Sep 14 10:24:55.792744 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2005/6123] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:55 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:24:56.816909 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:56.818997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:56.830251 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:56.831338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:56.831760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:56.832535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:56.833183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:56.833783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:56.909319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:56.921327 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c67ff84-5e29-4177-b674-910f00750c29 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1290 microversion: 2.1 time: 0.109983 Sep 14 10:24:56.937813 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4119/6124] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:56 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:57.948513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:57.949138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:57.956413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:57.957090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:57.957870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:57.958594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:57.959063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:57.959496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:58.160198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:58.170465 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3a86b7a2-90b7-4be3-9c17-81c0455e060d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.225962 Sep 14 10:24:58.171152 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2006/6125] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:57 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:24:58.496685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:24:58.508191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:58.508698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:58.509156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:58.525278 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] Creating event network-changed:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h2-851028-12 Sep 14 10:24:58.530504 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-68e0ccb8-b00b-460d-b7ee-e245e10c69a7 req-994c62cd-fff7-4be3-adc9-7752f8a0d29b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038150 Sep 14 10:24:58.531137 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4120/6126] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:24:59.193178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:24:59.193785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:24:59.201169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:59.201651 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:59.202089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:59.202769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:24:59.203217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:24:59.203636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:24:59.341984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:24:59.350226 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7c939952-cb4a-4062-aa29-602289e8f1b0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.160920 Sep 14 10:24:59.350810 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2007/6127] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:24:59 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:00.374935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:00.375563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:00.383155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:00.383660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:00.384451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:00.385172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:00.385644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:00.386117 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:00.526055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:00.533892 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88bdbab0-bfe9-4c2c-ba93-5999168fd051 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.164449 Sep 14 10:25:00.534871 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4121/6128] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:00 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:01.556515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:01.557126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:01.563861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:01.564386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:01.564826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:01.565521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:01.565987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:01.566412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:01.698556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:01.706415 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e53a738-b93f-4a16-bfab-a2a6bd5c0749 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.153697 Sep 14 10:25:01.707072 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2008/6129] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:01 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:02.730791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:02.731427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:02.738750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:02.739255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:02.739708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:02.740458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:02.740931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:02.741376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:02.874120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:02.882065 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8bc1ad00-bcb2-4aa4-8698-d99ab3cc9337 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.155271 Sep 14 10:25:02.882660 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4122/6130] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:02 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:03.905720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:03.906238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:03.914583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:03.915079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:03.915520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:03.916261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:03.916720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:03.917152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:04.051728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:04.059453 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8602bdd3-fe29-4718-8e2a-c74e356875b8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.157884 Sep 14 10:25:04.060062 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2009/6131] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:03 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:04.348876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "name": "network-vif-plugged", "status": "completed", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:25:04.358540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:04.359031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:04.359477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:04.370564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] Creating event network-vif-plugged:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h2-851028-12 Sep 14 10:25:04.375793 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1cad6570-fd15-465f-a667-fcc13394ac07 req-3281015e-4136-4910-930b-348c2cb49e29 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095653 Sep 14 10:25:04.376410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4123/6132] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:25:05.082438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:05.083056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:05.089866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:05.090349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:05.090784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:05.091462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:05.091931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:05.092358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:05.230856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:05.240101 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-68e37fc3-9622-40e1-971b-f91468740f8f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1364 microversion: 2.1 time: 0.160772 Sep 14 10:25:05.240795 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2010/6133] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:05 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:06.265426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:06.266151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:06.269032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:06.269733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:06.277392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:06.277906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:06.278364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:06.279088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:06.279561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:06.280044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:06.421150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:06.429391 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85c29f48-5ecb-4977-995b-54b175f90d4c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1550 microversion: 2.1 time: 0.168197 Sep 14 10:25:06.430441 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4124/6134] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:06 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:06.453474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:06.453987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:06.455853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:06.462758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:06.463240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:06.463674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:06.464393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:06.464844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:06.465265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:06.546128 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-59c37f40-dbe3-4ef1-9850-227072432988 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096484 Sep 14 10:25:06.546738 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2011/6135] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:25:06 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:25:07.495558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:25:07.506672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:07.507165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:07.507807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:07.519229 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] Creating event network-changed:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h2-851028-12 Sep 14 10:25:07.525263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b98b9e1d-7ff6-4905-8059-3716c4970301 req-5d9c47a9-08c0-437b-844b-190a6230863f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033401 Sep 14 10:25:07.526299 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4125/6136] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:25:43.864800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:43.865708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:43.869928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:43.870542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:43.877996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:43.878579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:43.879071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:43.880556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:43.881207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:43.881642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.359164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:44.367650 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d78d2fa-41bb-4db4-b593-fcd50834f294 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.505384 Sep 14 10:25:44.368270 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2012/6137] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:43 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:44.389601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:44.390406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:25:44.394815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:44.395958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:44.404854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.405334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.405786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.406497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.406965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.407404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.557469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:44.565462 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5df7a4bd-9351-4f69-a3bf-dffbf7b219f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.178689 Sep 14 10:25:44.566048 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4126/6138] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:44 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:44.588726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:44.589345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:44.595687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.596210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.596648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.597344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.597802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.598336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.735283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:44.745368 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d31471e9-9d3c-4d9f-b8b7-7d7fa30559ef tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.160462 Sep 14 10:25:44.745956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2013/6139] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:44 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:44.768457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:25:44.770968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:44.777155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.777662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.778113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.778824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.779295 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.779743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.812394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:44.819002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Old instance type m1.heat2, new instance type m1.heat {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:25:44.825763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:25:44.826202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:25:44.826695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:25:44.827121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:25:44.827547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:25:44.893267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b0031c4-edd1-479a-8ed9-78b5e454c714 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/action" status: 202 len: 0 microversion: 2.1 time: 0.128850 Sep 14 10:25:44.893991 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4127/6140] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:25:44 2022] POST /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:25:44.903503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:44.904174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:44.911784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.912344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.912736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:44.913465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:44.913915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:44.914589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:45.073429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:45.083873 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-67f8ac7d-743c-43e4-aced-f68ce0b3e0c2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1678 microversion: 2.1 time: 0.183655 Sep 14 10:25:45.084601 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2014/6141] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:44 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:46.108561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:46.109208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:46.117415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:46.117929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:46.118390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:46.119122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:46.119600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:46.120090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:46.261252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:46.269412 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c156b9a-b481-4be5-911c-cbf8e004fdfb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1678 microversion: 2.1 time: 0.164772 Sep 14 10:25:46.270018 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4128/6142] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:46 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:47.294113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:47.294750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:47.302424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:47.302930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:47.303351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:47.304078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:47.304532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:47.304957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:47.441356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:47.449726 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1a703250-2681-4cc8-ba1e-49beadda1a39 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.159886 Sep 14 10:25:47.450316 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2015/6143] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:47 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:48.475072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:48.475626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:48.482683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:48.483199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:48.483653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:48.484406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:48.484884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:48.485362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:48.619351 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:48.627223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8f58776-5a8e-4a57-9298-e928c9c0e58f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.156420 Sep 14 10:25:48.627808 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4129/6144] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:48 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:49.651362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:49.652017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:49.658886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:49.659375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:49.659814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:49.660549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:49.661509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:49.661934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:49.797751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:49.806180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb0a35d4-72b7-4fb6-aaf7-284290b582e7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.158824 Sep 14 10:25:49.806756 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2016/6145] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:49 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:50.830047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:50.830682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:50.838826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:50.839347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:50.839798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:50.840554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:50.841165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:50.841475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:50.981711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:50.990747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30757885-8918-472f-8e2e-2e0db511d39b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.164666 Sep 14 10:25:50.991354 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4130/6146] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:50 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:52.014615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:52.015218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:52.022943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:52.023611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:52.024237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:52.024930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:52.025385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:52.025810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:52.159680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:52.168401 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8635f5a3-8b00-49b5-ba68-12b392272643 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.157578 Sep 14 10:25:52.168996 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2017/6147] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:52 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:53.194663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:53.195416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:53.204460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:53.204984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:53.205492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:53.206789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:53.207279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:53.207739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:53.360797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:53.369806 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c2e341fc-e867-4b45-9563-6b7792bf1595 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.179680 Sep 14 10:25:53.370414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4131/6148] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:53 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:54.393407 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:54.394020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:54.401462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:54.401947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:54.402383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:54.403106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:54.403562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:54.404028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:54.544064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:54.551767 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c369b316-aa18-4073-b840-c130bde75d0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.162226 Sep 14 10:25:54.552382 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2018/6149] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:54 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:55.576083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:55.576723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:55.584013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:55.585184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:55.585647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:55.586378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:55.586965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:55.587444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:55.719748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:55.727949 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6477f4f5-1564-4a97-83a5-6ef3b152255c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.155807 Sep 14 10:25:55.728578 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4132/6150] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:55 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:56.751095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:56.751708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:56.758677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:56.759154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:56.759584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:56.760305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:56.760754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:56.761180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:56.899131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:56.906881 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-985eabca-78f0-4a54-8373-06ef4ee79320 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.159679 Sep 14 10:25:56.907457 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2019/6151] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:56 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:57.931323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:57.931996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:57.939149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:57.939660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:57.940143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:57.940866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:57.941341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:57.941790 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:58.077063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:58.085480 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f80a1ff7-e27e-472d-95fc-8bdede5d05e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1683 microversion: 2.1 time: 0.159234 Sep 14 10:25:58.086053 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4133/6152] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:57 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:25:59.109485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:25:59.110090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:25:59.118022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:59.118762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:59.119203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:59.119921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:59.120378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:59.120803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:59.157783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "name": "network-vif-unplugged", "status": "completed", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:25:59.171420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:25:59.171953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:25:59.172407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:25:59.186374 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Creating event network-vif-unplugged:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h1-851028-12 Sep 14 10:25:59.192057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] Instance 31498798-5c8b-4970-96fa-e83f5fc698ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:25:59.204341 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a3afe158-1ebd-43f0-8612-ea78f4918fd8 req-f36d22e2-f6aa-4194-8791-885c65c53c3c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050127 Sep 14 10:25:59.204980 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4134/6153] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:25:59.282560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:25:59.291487 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-01407447-78b7-4d2f-af39-a220d2159ce1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1682 microversion: 2.1 time: 0.185920 Sep 14 10:25:59.292103 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2020/6154] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:25:59 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:00.316075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:00.316833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:00.323827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:00.324367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:00.324827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:00.325547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:00.326026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:00.326473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:00.464951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:00.473164 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5a3992b-d197-4166-89c0-beb032e15d6a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1680 microversion: 2.1 time: 0.162270 Sep 14 10:26:00.473751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4135/6155] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:00 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:01.244152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:01.254572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:01.255045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:01.255470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:01.267717 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Creating event network-changed:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h1-851028-12 Sep 14 10:26:01.272949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] Instance 31498798-5c8b-4970-96fa-e83f5fc698ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:26:01.284239 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5f78d178-35e2-45be-b27f-46d2a9a3c7d6 req-c8cc5043-7417-4dac-864c-61f45d2aadf8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044344 Sep 14 10:26:01.284847 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2021/6156] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:01.498119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:01.498761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:01.505802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:01.506305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:01.506936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:01.507662 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:01.508164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:01.508747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:01.702347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:01.713809 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c65c4165-41ad-4113-a716-89eac5732836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1680 microversion: 2.1 time: 0.220072 Sep 14 10:26:01.714961 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4136/6157] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:01 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:02.740092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:02.740798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:02.747418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:02.747912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:02.748362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:02.749048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:02.749500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:02.749926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:02.887708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:02.895495 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ae117e2-bd8b-48b9-8531-7b07ae31006d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1677 microversion: 2.1 time: 0.160572 Sep 14 10:26:02.896110 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2022/6158] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:02 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:02.918737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:02.919405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:02.926556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:02.927060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:02.927520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:02.928274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:02.928757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:02.929200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:02.987900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1a2176bb-20b1-4130-bcd3-2abd88e03ecc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/action" status: 204 len: 0 microversion: 2.1 time: 0.073523 Sep 14 10:26:02.988599 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4137/6159] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:26:02 2022] POST /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:26:02.996817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:02.997526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:03.003643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:03.004213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:03.004606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:03.005311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:03.005763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:03.006296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:03.235313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:03.243132 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-68b71cd9-e827-4ac9-95f4-90b65511c5d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1677 microversion: 2.1 time: 0.250133 Sep 14 10:26:03.243957 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2023/6160] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:02 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:04.269876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:04.270716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:04.278471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.279124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.279846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.280931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.281528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.282138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.427126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:04.436008 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72b7dd78-6efe-45ac-8414-a86764be97e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.171392 Sep 14 10:26:04.437066 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4138/6161] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:04 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:04.463297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:04.463962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:04.471194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.471692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.472169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.472873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.473328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.473754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.611666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:04.619804 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-50c452e8-5b28-4199-ba24-8802e8f00843 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.161411 Sep 14 10:26:04.620432 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2024/6162] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:04 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:04.642773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:04.643415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:04.649366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.650781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.651245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.652019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.652505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.652954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.792152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:04.799924 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d1ce270f-6d59-4dc3-ae82-a326a589f078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1669 microversion: 2.1 time: 0.161077 Sep 14 10:26:04.800506 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4139/6163] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:04 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:04.823260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:04.823760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:04.829784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.830268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.830701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.831417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.831870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.832328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.857356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:26:04.944852 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ff6ce13-f524-4aef-aac4-9d815f345cfc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 204 len: 0 microversion: 2.1 time: 0.125521 Sep 14 10:26:04.945680 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2025/6164] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:26:04 2022] DELETE /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:26:04.955589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:04.956260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:04.962288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.962964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.963416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.964173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:04.964640 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:04.965077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:04.980456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:05.371884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:05.379734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0c9918c-6712-47ab-8f41-7608250ae32f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1675 microversion: 2.1 time: 0.428062 Sep 14 10:26:05.380332 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4140/6165] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:04 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1675 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:06.284680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "name": "network-vif-plugged", "status": "completed", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:06.296888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:06.297374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:06.298002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:06.310449 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] Creating event network-vif-plugged:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h1-851028-12 Sep 14 10:26:06.315540 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-6a492c0b-21dc-4c01-ac5b-f35179c0db84 req-28d318a6-2800-455d-b3c3-94c1e73d60ec service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035164 Sep 14 10:26:06.316207 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2026/6166] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:06.403665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:06.404422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:06.411440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:06.412063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:06.412523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:06.413252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:06.413728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:06.414174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:06.703042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:06.711024 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dd882818-085d-4e3a-ba61-7de81c212d1f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 200 len: 1675 microversion: 2.1 time: 0.312115 Sep 14 10:26:06.711606 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4141/6167] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:06 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:07.185024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31498798-5c8b-4970-96fa-e83f5fc698ad", "name": "network-vif-deleted", "tag": "6b5e2ab0-483e-466a-ad3b-194c5c2651ca"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:07.198527 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:07.199017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:07.199845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:07.211571 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] Creating event network-vif-deleted:6b5e2ab0-483e-466a-ad3b-194c5c2651ca for instance 31498798-5c8b-4970-96fa-e83f5fc698ad on n-h1-851028-12 Sep 14 10:26:07.218036 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5a3a3e9a-b326-4412-9b77-29921a6908c6 req-64b24f71-adac-4f3f-b1a1-742efe82ad2e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Sep 14 10:26:07.218578 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2027/6168] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:26:07.736021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:07.736657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:07.745459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:07.745891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:07.746352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:07.747087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:07.747590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:07.748084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:07.763630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad HTTP/1.1 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '31498798-5c8b-4970-96fa-e83f5fc698ad'} Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:26:07.765376 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-530ac0d3-395f-4959-817a-c18e5e4b7c1c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 404 len: 111 microversion: 2.1 time: 0.034953 Sep 14 10:26:07.770051 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4142/6169] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:07 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:26:07.782085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:07.782789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:07.790013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:07.790530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:07.791125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:07.791838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:07.792322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:07.792752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:07.807456 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad HTTP/1.1 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '31498798-5c8b-4970-96fa-e83f5fc698ad'} Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:26:07.809153 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7751cad4-a956-4408-8693-c2101372b70d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 404 len: 111 microversion: 2.1 time: 0.032853 Sep 14 10:26:07.813104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2028/6170] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:07 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:26:07.860021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1317902337", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "c0acb54b-56df-4c14-b860-5c190fd47f84"}], "security_groups": [{"name": "tempest-securitygroup--1592678454"}], "key_name": "tempest-keypair-297667874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:07.972380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] validate_networks() for [('c0acb54b-56df-4c14-b860-5c190fd47f84', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:26:08.380187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:26:08.380633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:26:08.381155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:26:08.381583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:26:08.382015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:26:08.393569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:08.394069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:08.394522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:08.395277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:08.395975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:08.396422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:08.413795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:26:08.419691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:26:08.432972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:26:08.435348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:26:08.486505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-510cabd4-2ec7-4569-af32-318ffa731ade tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630363 Sep 14 10:26:08.487166 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4143/6171] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:26:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:26:08.499757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-42aa4e17-fb0a-4ac2-933d-0f54368f4faf tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:08.500981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-42aa4e17-fb0a-4ac2-933d-0f54368f4faf tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:08.558567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-42aa4e17-fb0a-4ac2-933d-0f54368f4faf tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:08.566850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-42aa4e17-fb0a-4ac2-933d-0f54368f4faf tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1238 microversion: 2.1 time: 0.071439 Sep 14 10:26:08.567459 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2029/6172] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:08 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:09.595836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:09.597267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:09.604879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:09.605388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:09.605845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:09.606571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:09.607045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:09.607491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:09.672977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:09.681361 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-264c52e2-c557-4608-ad6f-534543bdff4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1296 microversion: 2.1 time: 0.091413 Sep 14 10:26:09.682015 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4144/6173] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:09 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:26:10.705740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:10.706350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:10.715340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:10.715836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:10.716300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:10.716989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:10.717436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:10.717858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:10.722441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:10.933066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:10.944330 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d736832f-e85e-4647-9e1d-99203831a568 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.242010 Sep 14 10:26:10.958375 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2030/6174] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:10 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:10.973537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:10.986870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:10.987643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:10.988278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:11.000854 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] Creating event network-changed:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h2-851028-12 Sep 14 10:26:11.006312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-b272513b-9ae0-4c7b-8860-d2b9f032047c req-496cf0e8-cab8-4f01-bf45-3117ff0439e6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Sep 14 10:26:11.006931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4145/6175] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:11.971439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:11.972022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:11.979992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:11.980473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:11.980908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:11.981593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:11.982373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:11.982476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:12.121850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:12.129666 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-88e22bfa-6676-4d47-97b9-0d36b21fa661 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.162470 Sep 14 10:26:12.130245 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2031/6176] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:11 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:13.155564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:13.156300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:13.163060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:13.163569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:13.164053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:13.164780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:13.166046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:13.166516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:13.299133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:13.308931 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00f66e09-76e0-4ec3-9e92-70548509e284 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.158662 Sep 14 10:26:13.310040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4146/6177] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:13 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:14.335990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:14.336611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:14.339529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:14.344853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:14.345342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:14.346046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:14.346744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:14.347202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:14.347629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:14.483446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:14.491946 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fe12a3de-f0c2-428f-b44b-8ef1907e1e73 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.159775 Sep 14 10:26:14.492543 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2032/6178] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:14 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:15.516318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:15.516954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:15.519873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:15.525706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:15.526302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:15.526939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:15.528220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:15.528732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:15.529532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:15.669046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:15.676850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ddab15d7-8c81-421f-8b11-e239bb0eaee7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.164618 Sep 14 10:26:15.677452 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4147/6179] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:15 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:16.617613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "name": "network-vif-plugged", "status": "completed", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:16.629324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:16.630005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:16.630472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:16.646710 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] Creating event network-vif-plugged:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h2-851028-12 Sep 14 10:26:16.658434 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-0a690a69-a5a2-4644-b237-b91d58968643 req-33a08527-bcc7-475f-ada9-d57eeadd378c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044755 Sep 14 10:26:16.659771 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2033/6180] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:16.701125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:16.701755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:16.709075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:16.709503 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:16.710016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:16.710738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:16.711204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:16.711720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:16.860274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:16.868716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c57a457-37c9-4208-ab32-624958ac21df tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1364 microversion: 2.1 time: 0.171286 Sep 14 10:26:16.869357 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4148/6181] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:16 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:17.894186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:17.894974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:17.902500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:17.903100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:17.903573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:17.904329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:17.904868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:17.905304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:18.044985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:26:18.052799 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-be048d8e-2005-401d-a20d-ac8fe224d9dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1551 microversion: 2.1 time: 0.163786 Sep 14 10:26:18.053387 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2034/6182] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:26:17 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:26:18.076826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:26:18.077443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:26:18.084413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:18.084920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:18.085376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:18.086139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:18.086559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:18.087739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:18.165146 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f1e826c6-806a-471f-9739-3a60f7a0f618 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092244 Sep 14 10:26:18.165772 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4149/6183] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:26:18 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:19.136680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:19.195380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:19.206392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:19.206973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:19.207477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:19.220240 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] Creating event network-changed:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h2-851028-12 Sep 14 10:26:19.226180 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f5c33ed9-cb35-4137-af46-24f460523fe8 req-8e070229-87fb-44d2-b19e-00e25dbefb90 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094711 Sep 14 10:26:19.227055 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2035/6184] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:26:59.946895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:59.947698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:59.949811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:59.950551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=43 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:26:59.955468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:26:59.963932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:26:59.964547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:26:59.965013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:26:59.992164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:27:00.036283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f2f1f6df-3c34-4b3c-8f71-80a280e20d5e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action" status: 202 len: 0 microversion: 2.1 time: 0.090306 Sep 14 10:27:00.036913 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4150/6185] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:26:59 2022] POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:27:00.047199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:00.047934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:00.050291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:00.051120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=26 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:00.052605 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 10:27:00.056028 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:27:00.056209 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e (ip 10.222.0.90) !!! Sep 14 10:27:00.069758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:00.070252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:00.071222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:00.071992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:00.072452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:00.072877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:00.208742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:00.217488 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f8c25bc4-181b-4c62-a31a-cc2e6bdec28a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.175155 Sep 14 10:27:00.218064 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2036/6186] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:00 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:01.242229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:01.243012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:01.249296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:01.249793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:01.250240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:01.250940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:01.251404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:01.251841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:01.384447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:01.392225 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c0c85771-7850-4bad-94c1-507757bc82d3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.155252 Sep 14 10:27:01.392801 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4151/6187] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:01 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:02.418020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:02.418640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:02.426202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:02.426638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:02.427083 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:02.427806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:02.428291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:02.428753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:02.568685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:02.577221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-10c961a4-5640-42d0-92d8-86081e5720bd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.163942 Sep 14 10:27:02.577799 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2037/6188] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:02 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:03.601826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:03.602440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:03.609623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:03.610384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:03.610882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:03.611629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:03.612149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:03.612634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:03.749047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:03.756956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3e8d1dd-635b-4cd6-8ebf-f39b43ce73e9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.159066 Sep 14 10:27:03.757521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4152/6189] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:03 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:04.781006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:04.781628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:04.788581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:04.789084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:04.790183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:04.790897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:04.791354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:04.791786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:04.922559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:04.930577 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b568ad5e-7173-4500-ace1-883b959f08af tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.153550 Sep 14 10:27:04.931189 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2038/6190] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:04 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:05.953485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:05.954200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:05.962238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:05.962753 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:05.963215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:05.963971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:05.964460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:05.964912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:06.098206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:06.107490 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-275833ef-db55-4051-a77f-206531a42881 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.158282 Sep 14 10:27:06.108123 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4153/6191] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:05 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:07.130987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:07.131840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:07.139767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:07.140295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:07.140735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:07.141440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:07.141897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:07.142331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:07.273469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:07.281874 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-60edc4a3-3ef6-4b78-b80b-dc77a27ed484 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.154879 Sep 14 10:27:07.282462 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2039/6192] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:07 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:08.305583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:08.306237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:08.313755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:08.314255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:08.314708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:08.315415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:08.315880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:08.316337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:08.453881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:08.461841 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d06a06e5-3896-4644-893f-a2e533d8e7d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.160245 Sep 14 10:27:08.462981 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4154/6193] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:08 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:09.486751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:09.487369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:09.494269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:09.494754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:09.495190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:09.495880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:09.496358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:09.496786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:09.634158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:09.642414 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e713b9b-ecd3-4444-9650-d1270a31a50a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.159558 Sep 14 10:27:09.642990 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2040/6194] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:09 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:10.667866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:10.668520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:10.675517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:10.676053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:10.676512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:10.677220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:10.677691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:10.678136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:10.811784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:10.819864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4db47ce8-b33a-48b0-bdd4-78466037603a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.156871 Sep 14 10:27:10.820471 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4155/6195] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:10 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:11.844763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:11.845319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:11.852440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:11.852918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:11.853874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:11.854647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:11.855092 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:11.855512 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:11.988450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:11.997291 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b35f9b6c-b4ca-40f9-87e4-2e83b34a8f26 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.156446 Sep 14 10:27:11.997877 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2041/6196] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:11 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:13.021542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:13.022102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:13.029543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:13.030044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:13.030496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:13.031205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:13.031675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:13.032141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:13.167051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:13.175116 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-03246834-951f-4da8-8f86-d636fd4afd2c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.158099 Sep 14 10:27:13.175699 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4156/6197] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:13 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:14.200076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:14.201043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:14.208901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:14.209391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:14.209828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:14.210532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:14.210987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:14.211420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:14.345223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:14.354132 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-367b6db7-d554-4e49-bf41-dba6ce30a96c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.158454 Sep 14 10:27:14.354822 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2042/6198] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:14 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:15.378237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:15.378868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:15.385886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.386386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.386846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.387561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.388072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.388520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.519997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:15.528750 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7bbc7d33-5135-44d2-8ad2-b7f1b66e5b33 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1657 microversion: 2.1 time: 0.154432 Sep 14 10:27:15.529333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4157/6199] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:15 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:15.551161 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:15.553508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:15.559879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.560388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.560819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.561500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.561949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.562364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.592608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:15.598389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:27:15.605152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:27:15.605573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:27:15.606047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:27:15.606458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:27:15.606895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:27:15.679304 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3b76ade8-bd00-4702-84e2-6af122ed1771 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action" status: 202 len: 0 microversion: 2.1 time: 0.131992 Sep 14 10:27:15.680387 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2043/6200] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:27:15 2022] POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:27:15.688512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:15.689155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:15.695551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.696111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.696576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.697305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:15.698350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:15.698965 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:15.835552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:15.844488 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4fae80a1-caa5-4b52-852b-a6cee45bf0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.159914 Sep 14 10:27:15.845260 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4158/6201] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:15 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:16.868842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:16.869371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:16.876953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:16.877445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:16.877889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:16.878583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:16.879039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:16.879466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:17.020423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:17.031208 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c48bc0e-cd94-4e6e-9098-a81ae0c615db tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1680 microversion: 2.1 time: 0.167212 Sep 14 10:27:17.032108 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2044/6202] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:16 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:18.055054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:18.055680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:18.062107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:18.062603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:18.063052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:18.063763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:18.064265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:18.064705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:18.207599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:18.215934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-21b480ab-a248-4bde-bad5-4ee251125c51 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1685 microversion: 2.1 time: 0.164828 Sep 14 10:27:18.216516 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4159/6203] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:18 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:19.240530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:19.241136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:19.248055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:19.248534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:19.248963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:19.249644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:19.250090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:19.250513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:19.381129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:19.389535 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7357b757-1b90-4e45-80a3-4b222f4213ae tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1685 microversion: 2.1 time: 0.152895 Sep 14 10:27:19.390099 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2045/6204] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:19 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:20.312271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "name": "network-vif-unplugged", "status": "completed", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:20.323337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:20.323833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:20.324376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:20.336644 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Creating event network-vif-unplugged:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h1-851028-12 Sep 14 10:27:20.342426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:27:20.355119 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6717bfd6-a091-43b8-be9b-a11fbdd9f8cf req-222ca9fa-ccde-4eac-8c09-1db2a09ca2fa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046721 Sep 14 10:27:20.355868 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4160/6205] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:27:20.414249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:20.414963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:20.422994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:20.423572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:20.424036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:20.424744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:20.425207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:20.425589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:20.570970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:20.579316 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a4dc2de-fce7-474f-b3df-70d0a3551c52 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1684 microversion: 2.1 time: 0.168847 Sep 14 10:27:20.580071 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2046/6206] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:20 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:21.606851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:21.607571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:21.613929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:21.614436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:21.614891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:21.615604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:21.616127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:21.616577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:21.767866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:21.776106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-951bf14d-66be-4ed5-8de1-df456a42479e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1684 microversion: 2.1 time: 0.174963 Sep 14 10:27:21.776691 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4161/6207] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:21 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:22.393065 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:22.403941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:22.404427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:22.404863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:22.416300 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Creating event network-changed:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h1-851028-12 Sep 14 10:27:22.421669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:27:22.432909 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-237a209e-1c4b-43b8-8243-79af072afb46 req-cb757307-d41a-4f18-9a1b-f5dbab20f985 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043352 Sep 14 10:27:22.433492 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2047/6208] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:27:22.799524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:22.800195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:22.812312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:22.812828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:22.813608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:22.814008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:22.814576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:22.814930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:23.063820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:23.071870 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c5c6e058-c02f-42bc-a4df-5b4b5d188e5b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1682 microversion: 2.1 time: 0.276267 Sep 14 10:27:23.072556 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4162/6209] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:22 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:24.101396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:24.102090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:24.109269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.109776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.110208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.110889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.111338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.111758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.243500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:24.252054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c765a252-415e-4195-9856-2ad7dcafface tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1678 microversion: 2.1 time: 0.154849 Sep 14 10:27:24.252630 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2048/6210] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:24 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:24.275414 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:24.275996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:24.282945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.283454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.283929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.284684 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.285163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.285608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.347867 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08c7664a-e790-4a89-ad53-dc04d7e49754 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action" status: 204 len: 0 microversion: 2.1 time: 0.076182 Sep 14 10:27:24.348489 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4163/6211] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:27:24 2022] POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:27:24.357677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:24.358386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:24.364360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.364925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.365430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.366136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:24.366590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:24.367013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:24.588167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:24.597557 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40152ac1-e8aa-498d-bce3-21a07251b836 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1678 microversion: 2.1 time: 0.244627 Sep 14 10:27:24.598299 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2049/6212] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:24 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:27:25.621948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:25.622675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:25.624902 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:27:25.625041 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e (ip 10.222.0.90) !!! Sep 14 10:27:25.634592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:25.635104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:25.636672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:25.637444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:25.637921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:25.638368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:25.780860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:25.783162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:25.795473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9116622-a214-4a5a-9515-6f979cad2a79 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1657 microversion: 2.1 time: 0.178471 Sep 14 10:27:25.796298 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4164/6213] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:25 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1657 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:27:25.819878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:25.820799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:25.829343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:25.829833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:25.830273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:25.830967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:25.831417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:25.831834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:25.966554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:25.974783 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ae4dc18-49f5-4370-8798-471219d04cf1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1657 microversion: 2.1 time: 0.159076 Sep 14 10:27:25.975365 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2050/6214] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:25 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:27:25.999193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:26.005934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:26.006437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:26.006889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:26.029936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Going to try to start instance {{(pid=122444) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:27:26.072098 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f3557eba-af9c-4af4-9c29-68d8e5f7e74d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action" status: 202 len: 0 microversion: 2.1 time: 0.078136 Sep 14 10:27:26.072719 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4165/6215] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:27:25 2022] POST /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:27:26.081075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:26.081690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:26.087569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:26.088086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:26.088671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:26.089471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:26.090143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:26.090573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:26.109833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:26.233946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:26.241776 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b5ba9759-c387-4a05-b767-6449eca7f2e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1666 microversion: 2.1 time: 0.164492 Sep 14 10:27:26.242384 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2051/6216] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:26 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:26.858397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "name": "network-vif-plugged", "status": "completed", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:26.868593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:26.870539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:26.871278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:26.882941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] Creating event network-vif-plugged:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h1-851028-12 Sep 14 10:27:26.888223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a103580f-8855-406c-b401-0d82e10d3964 req-b1ac08ca-727c-4fbc-abf9-c18624d3e51a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036371 Sep 14 10:27:26.889072 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4166/6217] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:27:27.266377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:27.266990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:27.273872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.274355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.274786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.275476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.275965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.276404 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.411402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:27.419922 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5456e466-941e-4274-9bd5-efa50cf9d3ea tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1670 microversion: 2.1 time: 0.157585 Sep 14 10:27:27.420576 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2052/6218] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:27 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:27:27.444100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:27.444772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:27.451832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.452384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.452838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.453562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.454033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.454476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.486522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:27:27.569983 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-27be98b4-882b-4151-b2d1-4f8b18a3146c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 204 len: 0 microversion: 2.1 time: 0.130450 Sep 14 10:27:27.570750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4167/6219] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:27:27 2022] DELETE /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:27:27.579758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:27.580501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:27.586545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.587023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.587453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.588291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:27.589361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:27.589951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:27.721231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:27.729874 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8615ae31-09e2-4ceb-a4ba-4974d63840be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1676 microversion: 2.1 time: 0.153317 Sep 14 10:27:27.730453 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2053/6220] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:27 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:28.754762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:28.755543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:28.763490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:28.764030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:28.764485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:28.765200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:28.765706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:28.766176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:28.936645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:28.944699 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc783f1b-824a-4585-bd6f-4ed5e136e7f2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 200 len: 1676 microversion: 2.1 time: 0.194260 Sep 14 10:27:28.945289 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4168/6221] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:28 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:29.758984 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef4053b3-8d44-48e5-a6b0-70131ad1a27e", "name": "network-vif-deleted", "tag": "68214107-a2d3-4b0e-aabb-35ad288e4f38"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:29.770822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:29.771313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:29.771996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:29.789341 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] Creating event network-vif-deleted:68214107-a2d3-4b0e-aabb-35ad288e4f38 for instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e on n-h1-851028-12 Sep 14 10:27:29.794551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-cd9d69b5-0e19-4f6d-9e9e-1038035b066f req-bb9333f5-5abb-4611-aa52-10a8b1b25094 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039186 Sep 14 10:27:29.795172 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2054/6222] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:27:29.969928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:29.971298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:29.974809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:29.981142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:29.981972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:29.982665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:29.983813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:29.985208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:29.985879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:30.003948 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e HTTP/1.1 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ef4053b3-8d44-48e5-a6b0-70131ad1a27e'} Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:27:30.005747 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:27:30.009833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4757206e-9f42-410d-9340-daac1213b3d0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 404 len: 111 microversion: 2.1 time: 0.041287 Sep 14 10:27:30.012440 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4169/6223] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:29 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:27:30.027390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:30.028261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:30.034495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:30.034979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:30.035422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:30.036166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:30.036622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:30.037056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:30.050784 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e HTTP/1.1 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ef4053b3-8d44-48e5-a6b0-70131ad1a27e'} Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:27:30.052476 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dada4642-9dfb-4d06-af79-6cfaae4e5f0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 404 len: 111 microversion: 2.1 time: 0.033219 Sep 14 10:27:30.056716 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2055/6224] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:30 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:27:30.105806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-649958252", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "c0acb54b-56df-4c14-b860-5c190fd47f84"}], "security_groups": [{"name": "tempest-securitygroup--1592678454"}], "key_name": "tempest-keypair-297667874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:30.219912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] validate_networks() for [('c0acb54b-56df-4c14-b860-5c190fd47f84', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:27:30.624209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:27:30.624658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:27:30.625156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:27:30.625585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:27:30.626018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:27:30.635961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:30.636539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:30.637079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:30.637835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:30.638311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:30.638759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:30.658393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:27:30.663973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:27:30.677607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:27:30.679989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:27:30.729544 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff5e8dbb-d06d-48cf-9a4a-d3e19c9730cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.628134 Sep 14 10:27:30.730202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4170/6225] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:27:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:27:30.742936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e05fa7d5-a55b-42fb-8060-87b02b406739 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:30.744883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e05fa7d5-a55b-42fb-8060-87b02b406739 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:30.747071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=45 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:30.814657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e05fa7d5-a55b-42fb-8060-87b02b406739 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:30.830179 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e05fa7d5-a55b-42fb-8060-87b02b406739 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1237 microversion: 2.1 time: 0.092287 Sep 14 10:27:30.830742 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2056/6226] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:30 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1237 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:27:31.857181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:31.858344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:31.867626 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:31.868512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:31.869077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:31.870384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:31.871193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:31.871725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:31.941125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:31.952001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f24c7f7f-4167-4ad6-b048-095112bc6247 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1307 microversion: 2.1 time: 0.102098 Sep 14 10:27:31.952611 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4171/6227] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:31 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:32.976445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:32.977224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:32.985429 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:32.986147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:32.986697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:32.987467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:32.988096 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:32.988705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:33.232057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:33.240607 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-203cb87d-2261-43e3-99d5-e760892126b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.268884 Sep 14 10:27:33.241615 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2057/6228] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:32 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:33.389782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73de039-1221-407d-811d-136204a66b06", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:33.402469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:33.403151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:33.403599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:33.415664 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] Creating event network-changed:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h2-851028-12 Sep 14 10:27:33.420929 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c63cf2cb-348c-4eb3-8d8c-68097577ace7 req-28402f25-add0-4635-a886-800e445d0785 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036566 Sep 14 10:27:33.422009 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4172/6229] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:27:34.266531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:34.267137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:34.273960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:34.274435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:34.274869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:34.275546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:34.276171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:34.276613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:34.410491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:34.419564 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf7bd073-6869-410d-80fe-a4ddf9a54d48 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.156849 Sep 14 10:27:34.420174 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2058/6230] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:34 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:35.445608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:35.446271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:35.453244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:35.453792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:35.454277 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:35.454997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:35.455471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:35.455950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:35.591990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:35.600165 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80770340-efe1-4464-b9e2-5c47772e113d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.159712 Sep 14 10:27:35.600755 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4173/6231] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:35 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:36.624370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:36.624989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:36.631881 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:36.632392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:36.632829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:36.633517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:36.633972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:36.634396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:36.764339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:36.772042 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c51a36f9-d61e-4af7-b938-5ac9a36b9863 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.151740 Sep 14 10:27:36.772618 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2059/6232] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:36 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:37.796722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:37.797357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:37.804498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:37.805010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:37.805465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:37.806177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:37.806650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:37.807096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:37.950580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:37.958428 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8e63c9e-e4a8-401d-af55-4688c9dd457b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.165937 Sep 14 10:27:37.959022 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4174/6233] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:37 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:38.983709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:38.984231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:38.991702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:38.992234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:38.992681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:38.993386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:38.993844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:38.993968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73de039-1221-407d-811d-136204a66b06", "name": "network-vif-plugged", "status": "completed", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:38.994498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:39.005714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:39.006168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:39.006611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:39.020210 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] Creating event network-vif-plugged:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h2-851028-12 Sep 14 10:27:39.025657 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-69b649d6-269b-49ce-8f9c-b770a3793d5f req-887733fd-5258-49c6-a116-3b74aeacb58c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035824 Sep 14 10:27:39.026562 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4175/6234] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:27:39.184662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:39.192772 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8249fb58-582c-4fbd-95b9-9794ed17c44d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.213464 Sep 14 10:27:39.193516 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2060/6235] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:38 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:40.222106 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:40.222819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:40.229243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:40.229733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:40.231527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:40.231711 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:40.232206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:40.232645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:40.368445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:40.377235 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7eb4508c-fcde-4471-ba5e-040691ccea9a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1363 microversion: 2.1 time: 0.163364 Sep 14 10:27:40.377843 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4176/6236] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:40 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:41.400624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:41.401162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:41.404503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:41.410213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:41.410693 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:41.411125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:41.411812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:41.412284 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:41.412702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:41.553893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:27:41.562380 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-851027e8-dd7b-46c6-a7aa-a09e022ea7bb tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1550 microversion: 2.1 time: 0.165732 Sep 14 10:27:41.562982 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2061/6237] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:27:41 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:27:41.586459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:27:41.587206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:27:41.589608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:41.590466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:27:41.598137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:41.598648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:41.599107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:41.599831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:41.600338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:41.600781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:41.680668 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b6ba8189-1380-439b-8bdc-1d50402b9c1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098459 Sep 14 10:27:41.681298 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4177/6238] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:27:41 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:27:42.950981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73de039-1221-407d-811d-136204a66b06", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:27:42.961571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:27:42.962050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:27:42.962482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:27:42.973861 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] Creating event network-changed:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h2-851028-12 Sep 14 10:27:42.978902 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9ae48759-b32e-45a7-87fe-1adcb7792b53 req-fe91e698-b1f0-497e-9e19-e25e58f3c232 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Sep 14 10:27:42.979915 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2062/6239] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:28:19.003752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:19.004661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:19.008933 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:19.011203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:19.020021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:19.020539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:19.020988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:19.021723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:19.022213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:19.022644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:19.052210 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:19.057543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Old instance type m1.heat2, new instance type m1.heat {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:28:19.064754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:28:19.065187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:28:19.065671 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:28:19.066091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:28:19.066517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:28:19.132745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e8790993-aa93-4173-8d86-0b5e955fa614 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/action" status: 202 len: 0 microversion: 2.1 time: 0.130516 Sep 14 10:28:19.134609 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4178/6240] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:28:19 2022] POST /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:28:19.140762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=15 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:19.142294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=50 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:19.146426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:19.147073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:19.154496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:19.154986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:19.155423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:19.156209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:19.156677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:19.157103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:19.314519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:19.323019 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e88d9f8d-6614-4d61-bda8-bc473a03f013 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1678 microversion: 2.1 time: 0.184663 Sep 14 10:28:19.323634 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2063/6241] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:19 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:20.346635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:20.347565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:20.354773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:20.355287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:20.355750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:20.356510 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:20.356985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:20.357431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:20.495373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:20.503784 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3b0d813b-be66-4fe5-8e66-fc4284e9c1a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1678 microversion: 2.1 time: 0.162009 Sep 14 10:28:20.504393 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4179/6242] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:20 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:21.527410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:21.528081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:21.535163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:21.535653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:21.536126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:21.536823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:21.537278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:21.537703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:21.668470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:21.676724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff02775c-9fdc-451f-9e5c-8a66a27b783a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.153209 Sep 14 10:28:21.677290 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2064/6243] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:21 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:22.701007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:22.701630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:22.709149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:22.709645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:22.710089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:22.710784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:22.711244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:22.711678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:22.848547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:22.856422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1fa6d9a5-4d22-4ee4-862c-8bfc49677e1b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.159350 Sep 14 10:28:22.857008 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4180/6244] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:22 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:28:23.881347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:23.881949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:23.888808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:23.889299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:23.889741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:23.890439 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:23.890897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:23.891327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:24.026909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:24.034726 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-246b19e4-1a1e-4e23-b758-2e9f199e4e38 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.157249 Sep 14 10:28:24.035320 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2065/6245] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:23 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:25.058062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:25.058606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:25.065837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:25.066345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:25.066805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:25.067524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:25.068062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:25.068513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:25.212734 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:25.221232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4465d6a3-70f4-47ff-8da9-118344d7439a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.166550 Sep 14 10:28:25.221830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4181/6246] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:25 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:26.245288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:26.245893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:26.253014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:26.253491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:26.253949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:26.254719 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:26.255103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:26.255524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:26.387562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:26.395576 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3757ed97-df48-4096-bd83-c2eeeb47798b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.154109 Sep 14 10:28:26.396201 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2066/6247] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:26 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:27.420064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:27.420696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:27.428458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:27.428899 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:27.429352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:27.430065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:27.430533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:27.430974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:27.569188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:27.577083 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0ba083aa-2420-4aec-8d23-d18d45fdcab2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.161068 Sep 14 10:28:27.577670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4182/6248] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:27 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:28.600715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:28.601323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:28.608203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:28.608683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:28.609114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:28.609819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:28.610364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:28.610929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:28.750208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:28.758785 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d74eafa5-483a-4927-922b-568a94b107f9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.162198 Sep 14 10:28:28.759380 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2067/6249] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:28 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:29.784232 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:29.784956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:29.791842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:29.792377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:29.792833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:29.793544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:29.794015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:29.794456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:29.927629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:29.935713 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f870bcd5-3f62-4e60-82c7-d3bf65175898 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.156660 Sep 14 10:28:29.936336 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4183/6250] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:29 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:30.959540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:30.960289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:30.967148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:30.967626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:30.968094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:30.968772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:30.969218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:30.969636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:31.103760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:31.112603 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fac4ff5c-94d0-4664-8af5-97eb3a82d149 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.157418 Sep 14 10:28:31.113196 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2068/6251] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:30 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:32.136500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:32.137286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:32.145127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:32.145646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:32.146083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:32.146805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:32.147299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:32.147735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:32.283874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:32.291758 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97da0b30-f0cc-4312-9167-50dc692fa4b1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1683 microversion: 2.1 time: 0.159218 Sep 14 10:28:32.292971 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4184/6252] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:32 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:28:33.316240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:33.316851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:33.323793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:33.324377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:33.324836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:33.325567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:33.326131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:33.326578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:33.463569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:33.473907 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9f1dcb9-0197-4d70-b569-cf02666a3617 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1682 microversion: 2.1 time: 0.161694 Sep 14 10:28:33.474512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2069/6253] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:33 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:33.580860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73de039-1221-407d-811d-136204a66b06", "name": "network-vif-unplugged", "status": "completed", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:33.591778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:33.592254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:33.592716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:33.606368 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Creating event network-vif-unplugged:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h1-851028-12 Sep 14 10:28:33.613243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] Instance e73de039-1221-407d-811d-136204a66b06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:28:33.624703 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d4050bac-25d3-4a01-b4ac-15f6a1b868ad req-1c408141-2ff8-45be-9489-bc5d16ea3735 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048189 Sep 14 10:28:33.625929 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4185/6254] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:28:34.499026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:34.499646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:34.507120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:34.507611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:34.508118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:34.508824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:34.509269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:34.509699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:34.654179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:34.662642 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cad6e4df-ef85-4db3-b129-9dc413265162 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1682 microversion: 2.1 time: 0.167813 Sep 14 10:28:34.663231 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2070/6255] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:34 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:35.665807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73de039-1221-407d-811d-136204a66b06", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:35.675422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:35.676597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:35.676597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:35.686123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:35.686729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:35.688216 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Creating event network-changed:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h1-851028-12 Sep 14 10:28:35.693668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:35.693834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] Instance e73de039-1221-407d-811d-136204a66b06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:28:35.694149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:35.694574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:35.695260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:35.695704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:35.696154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:35.704680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1d3f7017-89bc-4c7b-907b-718f7fdbd5b4 req-9ad19040-e686-40ff-afa0-8d3cc2ed5e15 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043766 Sep 14 10:28:35.705807 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4186/6256] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:28:35.929572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:35.938529 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbc88b6e-0189-4ded-b2cc-d58ce0dc566c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1680 microversion: 2.1 time: 0.256181 Sep 14 10:28:35.939115 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2071/6257] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:35 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:28:36.965178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:36.965893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:36.972764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:36.973281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:36.973803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:36.974523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:36.974996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:36.975439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.108614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:37.117143 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-afe8111e-2de8-49e3-9cdd-0c4b536aba28 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1677 microversion: 2.1 time: 0.157102 Sep 14 10:28:37.117736 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4187/6258] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:36 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:37.140534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:37.141073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:37.150342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.150833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.152164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.152164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.153046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.153046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.194075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.194556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.194995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.195722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.196199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.196620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.218565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:28:37.225251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:28:37.328217 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eeadc332-4245-44d7-8973-b0d0da833ec5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/action" status: 202 len: 0 microversion: 2.1 time: 0.191235 Sep 14 10:28:37.328857 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2072/6259] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:28:37 2022] POST /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:28:37.337608 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:37.338242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:37.344420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.344931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.345390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.346343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:37.346865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:37.347746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:37.555697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:37.565104 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae79e2a7-e2d6-4f82-966a-26847a17f14a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1676 microversion: 2.1 time: 0.230892 Sep 14 10:28:37.575247 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4188/6260] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:37 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:38.591344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:38.592095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:38.604952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:38.605447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:38.605885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:38.606591 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:38.607043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:38.607466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:38.744112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:38.752568 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d3a7e8c1-8048-4229-8167-1f4b3681da0d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1676 microversion: 2.1 time: 0.165637 Sep 14 10:28:38.753420 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2073/6261] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:38 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:39.777511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:39.778163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:39.785904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:39.786473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:39.786928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:39.787660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:39.788164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:39.788628 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:39.933839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:39.942138 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f7a3ea5-a8c3-4755-b26a-508d85afbb5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1676 microversion: 2.1 time: 0.168776 Sep 14 10:28:39.942740 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4189/6262] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:39 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:40.861561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e73de039-1221-407d-811d-136204a66b06", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:40.873090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:40.873573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:40.874010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:40.886630 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Creating event network-changed:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h2-851028-12 Sep 14 10:28:40.893089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] Instance e73de039-1221-407d-811d-136204a66b06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:28:40.904374 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-e189730c-8e8e-4b5b-8d31-03cf24929240 req-8fb542eb-a103-46d0-862f-24d08876a33e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046471 Sep 14 10:28:40.905001 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2074/6263] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:28:40.974535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:40.975178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:40.982760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:40.983752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:40.984411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:40.985364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:40.986039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:40.986688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:41.218229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:41.227554 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4e4ef87-ad5b-40bb-967f-5df8350fb106 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1676 microversion: 2.1 time: 0.259567 Sep 14 10:28:41.228436 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4190/6264] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:40 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:42.254929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:42.255629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:42.261853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:42.262316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:42.262752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:42.263438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:42.263887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:42.264338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:42.396988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:42.404682 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9f5af60-c07f-41e7-9364-9e8e1c87c0c9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1676 microversion: 2.1 time: 0.155881 Sep 14 10:28:42.405255 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2075/6265] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:42 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:43.427925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:43.428501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:43.435361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.435865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.436346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.437055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.437554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.437994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.575730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:43.584381 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-556c38c4-6bd9-4c3f-a9d4-fa806724d87c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1669 microversion: 2.1 time: 0.160878 Sep 14 10:28:43.584970 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4191/6266] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:43 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:43.609883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:43.610491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:43.617281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.617760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.618188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.618871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.619315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.619734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.750625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:43.754738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:43.760049 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d84e3d5-a473-4f34-aa0d-bd4c46834627 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1669 microversion: 2.1 time: 0.153914 Sep 14 10:28:43.760635 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2076/6267] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:43 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:43.782725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:43.783342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:43.789452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.789949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.790396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.791089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.791550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.792013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.922595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:43.931345 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c8e118d4-8ba1-405e-abcc-8baf2ab70542 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1669 microversion: 2.1 time: 0.152577 Sep 14 10:28:43.931952 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4192/6268] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:43 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:43.955054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:43.955482 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:43.962474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.962960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.963392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.964117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:43.964574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:43.965001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:43.991435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:28:44.073506 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-74024e42-19f4-4e73-9207-8d9115fc6ff0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 204 len: 0 microversion: 2.1 time: 0.122917 Sep 14 10:28:44.074165 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2077/6269] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:28:43 2022] DELETE /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:28:44.083769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:44.084480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:44.090498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:44.090999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:44.091448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:44.092221 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:44.092696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:44.093135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:44.235544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:44.240291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:44.245451 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-80db45f2-5e65-49e8-be10-8bd7674f5c5f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1675 microversion: 2.1 time: 0.166443 Sep 14 10:28:44.246040 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4193/6270] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:44 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:28:45.270914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:45.271619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:45.280736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:45.281228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:45.281663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:45.282367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:45.282819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:45.283245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:45.540162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:45.547774 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f4a85d6d-7696-4117-8180-ce1e06fa71cd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1675 microversion: 2.1 time: 0.282354 Sep 14 10:28:45.548959 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2078/6271] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:45 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1675 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:46.223103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e73de039-1221-407d-811d-136204a66b06", "name": "network-vif-deleted", "tag": "9f637406-b832-4494-bf98-ef3596ee838d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:46.234674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:46.235392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:46.235938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:46.250272 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] Creating event network-vif-deleted:9f637406-b832-4494-bf98-ef3596ee838d for instance e73de039-1221-407d-811d-136204a66b06 on n-h2-851028-12 Sep 14 10:28:46.256549 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-254b4746-b09e-49aa-90d9-76fe25eaeb8e req-fa2df0ba-f3e0-48f1-9287-97a2ecefead0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039078 Sep 14 10:28:46.257226 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4194/6272] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:28:46.570983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:46.571613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:46.578680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:46.579165 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:46.579603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:46.580335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:46.580784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:46.581970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:46.618613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:46.619097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:46.619525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:46.619993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lazy-loading 'fault' on Instance uuid e73de039-1221-407d-811d-136204a66b06 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:28:46.665713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:46.674322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9860eadf-65e6-4f60-adda-c5ce28967f23 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 200 len: 1327 microversion: 2.1 time: 0.107161 Sep 14 10:28:46.676444 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2079/6273] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:46 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:47.699352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:47.700109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:47.706966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:47.707461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:47.708024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:47.708742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:47.709212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:47.709655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:47.723913 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 HTTP/1.1 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e73de039-1221-407d-811d-136204a66b06'} Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:28:47.725565 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-05043fe3-38ea-44c5-864a-5a0a111ab001 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 404 len: 111 microversion: 2.1 time: 0.032915 Sep 14 10:28:47.730934 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4195/6274] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:47 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:28:47.742674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:47.743301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:47.745403 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:47.751330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:47.751811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:47.752276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:47.752967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:47.753420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:47.753839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:47.767675 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 HTTP/1.1 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e73de039-1221-407d-811d-136204a66b06'} Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:28:47.769982 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-12442baa-61ba-4c48-b8e4-7e0aa0203ffd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 404 len: 111 microversion: 2.1 time: 0.032512 Sep 14 10:28:47.774513 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2080/6275] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:47 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:28:47.820707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-837794092", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "c0acb54b-56df-4c14-b860-5c190fd47f84"}], "security_groups": [{"name": "tempest-securitygroup--1592678454"}], "key_name": "tempest-keypair-297667874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:47.926667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] validate_networks() for [('c0acb54b-56df-4c14-b860-5c190fd47f84', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:28:48.354552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:28:48.354934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:28:48.355418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:28:48.355840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:28:48.356307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:28:48.365866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:48.366362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:48.366811 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:48.367546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:48.368097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:48.368540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:48.386392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:28:48.391918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:28:48.406180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:28:48.408613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:28:48.456883 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46bd675f-9090-4ccb-9c06-fc20cbdb6c43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639414 Sep 14 10:28:48.457521 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4196/6276] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:28:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:28:48.468847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-01c5d49b-32ce-4fa4-b74b-59a5a1aa36b2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:48.469514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-01c5d49b-32ce-4fa4-b74b-59a5a1aa36b2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:48.524640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-01c5d49b-32ce-4fa4-b74b-59a5a1aa36b2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:48.531626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-01c5d49b-32ce-4fa4-b74b-59a5a1aa36b2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1237 microversion: 2.1 time: 0.066772 Sep 14 10:28:48.532315 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2081/6277] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:48 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:49.557884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:49.558527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:49.565238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:49.570095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:49.570672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:49.571312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:49.572236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:49.572843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:49.573298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:49.641431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:49.649783 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7fb1bdc-6b60-4443-84c2-6dfbe189a84d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1295 microversion: 2.1 time: 0.096993 Sep 14 10:28:49.650382 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4197/6278] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:49 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:50.674071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:50.674710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:50.677721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:50.684241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:50.684734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:50.685167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:50.685867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:50.686315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:50.686733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:51.104246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:51.112358 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c2222e0c-42dd-4c08-98c8-0ca949e9ce1e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.442076 Sep 14 10:28:51.113290 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2082/6279] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:50 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:51.259129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:51.283306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:51.283823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:51.284343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:51.297855 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] Creating event network-changed:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:28:51.303739 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a72ef994-181b-40c9-a7f7-a608029d773b req-a917e936-dbb1-4c2c-a0d0-8f5dfb834c9d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048286 Sep 14 10:28:51.304601 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4198/6280] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:28:52.135442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:52.136061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:52.142897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:52.143381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:52.144362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:52.145152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:52.145601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:52.148055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:52.288577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:52.296304 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d120f9d7-8a92-4d79-933c-94c32bbd904c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.164768 Sep 14 10:28:52.296873 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2083/6281] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:52 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:53.321527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:53.322488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:53.329924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:53.330433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:53.330891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:53.331760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:53.332278 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:53.332725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:53.466547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:53.475392 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4f32217-19e2-44e1-8942-279e0c96ebd3 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.158693 Sep 14 10:28:53.476017 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4199/6282] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:53 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:54.499669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:54.500325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:54.508511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:54.508993 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:54.509426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:54.510115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:54.510559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:54.510976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:54.643490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:54.651371 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28607a65-80d4-497e-b08d-a65c402bec20 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.155656 Sep 14 10:28:54.651976 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2084/6283] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:54 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:55.675522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:55.676233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:55.683250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:55.683760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:55.684247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:55.684974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:55.685451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:55.685959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:55.821293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:55.829170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97f30a08-3091-4bc3-bb19-d57009e3566b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.158383 Sep 14 10:28:55.829774 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4200/6284] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:55 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:56.854004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:56.854654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:56.861641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:56.862625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:56.863449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:56.864258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:56.864710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:56.865133 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:56.995258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:57.003114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a3c0419-5c41-4fc6-975f-a57961c64083 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.153010 Sep 14 10:28:57.003776 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2085/6285] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:56 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:57.445297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "name": "network-vif-plugged", "status": "completed", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:28:57.459236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:57.459739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:57.460219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:57.471370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] Creating event network-vif-plugged:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:28:57.477497 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-dd7735de-0eef-4d24-992f-3a37dd0b8cf1 req-a0c71c20-5a48-4e38-b0ad-4a4f5697d3b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036495 Sep 14 10:28:57.478359 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4201/6286] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:28:58.026239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:58.026848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:58.033765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:58.034254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:58.034688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:58.035383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:58.035833 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:58.036282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:58.166474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:58.174346 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f6c87ef6-297a-4020-93bd-7db4f80cac3b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1363 microversion: 2.1 time: 0.152008 Sep 14 10:28:58.175564 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2086/6287] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:58 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:59.199214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:59.200014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:59.202017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:59.202860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:59.210425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:59.210921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:59.211366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:59.212107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:59.212579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:59.213014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:59.356432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:28:59.364595 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4b22c335-e6fa-4c20-be54-6037cf495a6d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1549 microversion: 2.1 time: 0.169602 Sep 14 10:28:59.365182 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4202/6288] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:28:59 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:28:59.388509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:28:59.389680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:28:59.391596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:28:59.398605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:59.399126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:59.399563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:59.400298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:28:59.400755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:28:59.401182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:28:59.489482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f56e68b-8680-47bb-9978-1a7cc3de9e59 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104863 Sep 14 10:28:59.490105 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2087/6289] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:28:59 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:29:00.454977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:29:00.465799 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:00.466382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:00.466900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:00.479302 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] Creating event network-changed:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:29:00.484440 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6ba6b8e5-5a80-48c8-b6dc-95296fbd0ed3 req-e813ebc7-3111-42c5-b3a8-d73cfb55be27 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034382 Sep 14 10:29:00.485230 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4203/6290] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:29:39.329784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=11 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:39.331124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:39.335213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:39.335826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:39.343371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:39.343801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:39.344264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:39.344961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:39.345415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:39.345842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:39.566436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:39.574447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1047abb6-87f8-4858-ab10-3758a5b5b689 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1668 microversion: 2.1 time: 0.246653 Sep 14 10:29:39.575034 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2088/6291] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:39 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:39.599055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6613510-c07e-4c06-8353-b4571676080b"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:29:39.601485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:39.604758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=13 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:39.605546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=36 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:39.611427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:39.612866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:39.613416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:39.614267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:39.614764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:39.615253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:39.981734 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4823b665-d1cd-4610-82aa-092cec50b090 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388060 Sep 14 10:29:39.982415 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4204/6292] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:29:39 2022] POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:29:51.781669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:29:51.784611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:51.786946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:51.787620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:51.793389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:51.793887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:51.794331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:51.795025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:51.795480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:51.795930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:51.824718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:51.830091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Old instance type m1.heat2, new instance type m1.heat {{(pid=122443) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:29:51.837339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:29:51.837761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:29:51.838235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:29:51.838643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:29:51.839053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:29:51.904066 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51dad45a-50f0-4bdb-9107-27066989f161 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/action" status: 202 len: 0 microversion: 2.1 time: 0.126195 Sep 14 10:29:51.904785 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2089/6293] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:29:51 2022] POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:29:51.911968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:51.912915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:29:51.917083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:51.917839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:51.927726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:51.928394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:51.928720 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:51.929439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:51.929932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:51.930355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:52.073154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:52.081864 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d5c717f4-c231-4333-abcc-881ee70a1c64 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1723 microversion: 2.1 time: 0.172029 Sep 14 10:29:52.082452 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4205/6294] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:51 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:53.153711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:53.154394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:53.162352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:53.162849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:53.163288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:53.164028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:53.164547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:53.164977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:53.300818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:53.309138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cef3779f-a540-4699-a712-84b92e0fdd6c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1723 microversion: 2.1 time: 0.207432 Sep 14 10:29:53.309721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2090/6295] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:53 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:54.334111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:54.334752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:54.342123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:54.342658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:54.343121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:54.343849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:54.344353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:54.344802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:54.478545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:54.489283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60bd165d-350c-429e-b887-91f5a7d1da68 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1723 microversion: 2.1 time: 0.159718 Sep 14 10:29:54.489887 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4206/6296] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:54 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:55.513156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:55.513778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:55.520727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:55.521215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:55.521655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:55.522346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:55.522802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:55.523226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:55.659548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:55.667642 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ca31abe-d3ff-4c0a-b5b5-e43c7c4c3dca tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.158382 Sep 14 10:29:55.668259 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2091/6297] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:55 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:56.692752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:56.693386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:56.700401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:56.700903 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:56.701356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:56.702075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:56.702544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:56.702987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:56.838104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:56.847413 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b81de4c-38b6-44e0-9aac-fc84d589848e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.159154 Sep 14 10:29:56.848327 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4207/6298] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:56 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:57.871260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:57.871813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:57.879143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:57.879618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:57.880085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:57.880769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:57.881218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:57.881637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:58.014673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:58.024092 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-259ae338-c15e-4b3a-a669-cff5773e9271 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.156693 Sep 14 10:29:58.024669 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2092/6299] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:57 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:29:59.047770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:29:59.048419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:29:59.055373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:59.055882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:59.056375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:59.057094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:29:59.057571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:29:59.058012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:29:59.190752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:29:59.198741 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6ec9434-6037-4238-90a7-3b7a66a5d3c6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.154988 Sep 14 10:29:59.199345 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4208/6300] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:29:59 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:00.222737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:00.223365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:00.230707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:00.231190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:00.231621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:00.232350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:00.232855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:00.233276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:00.369708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:00.378150 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b898228a-3e26-44df-8a96-09e556a5e3fc tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.159492 Sep 14 10:30:00.378721 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2093/6301] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:00 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:01.402077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:01.402708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:01.410589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:01.411092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:01.411558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:01.412320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:01.412794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:01.413241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:01.544978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:01.553996 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed6ebe9e-3913-4ba5-bfce-8aa20fbef078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.155887 Sep 14 10:30:01.554586 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4209/6302] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:01 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:02.577789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:02.578406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:02.586000 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:02.586487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:02.586931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:02.587621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:02.588124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:02.588553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:02.724546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:02.732873 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b8278d58-d8db-450f-89fa-4b8ae6c5967f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.158980 Sep 14 10:30:02.733450 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2094/6303] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:02 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:03.757196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:03.757825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:03.765090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:03.765602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:03.766061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:03.766782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:03.767257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:03.768557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:03.905592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:03.915223 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2e7ddeee-f044-41e4-9b0c-c40d391177f6 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.161929 Sep 14 10:30:03.915840 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4210/6304] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:03 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:04.938935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:04.939663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:04.946524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:04.947004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:04.947435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:04.948144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:04.948593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:04.949010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:05.083600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:05.091918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c6ca86ca-d293-4bff-8266-b6fa35552ef1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.156868 Sep 14 10:30:05.092502 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2095/6305] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:04 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:06.116520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:06.117180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:06.124543 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:06.125053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:06.125509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:06.126324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:06.127328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:06.127950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:06.259225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:06.268263 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-85f646b7-93d5-40f8-918c-1f9fef319c4e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.155051 Sep 14 10:30:06.268953 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4211/6306] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:06 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:07.291071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:07.291607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:07.298529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:07.299524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:07.300007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:07.300917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:07.301371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:07.301798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:07.433660 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:07.443135 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5d8c671a-ae64-462c-97c0-cc84c631a6d9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.156090 Sep 14 10:30:07.443732 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2096/6307] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:07 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:08.466915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:08.467474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:08.476079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:08.476585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:08.477032 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:08.477750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:08.478212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:08.478648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:08.625286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:08.636777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-810ce25c-da56-474c-857a-a2970e03b15c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1728 microversion: 2.1 time: 0.173851 Sep 14 10:30:08.637378 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4212/6308] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:08 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:09.539007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "name": "network-vif-unplugged", "status": "completed", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:09.550580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:09.551183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:09.551697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:09.564136 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Creating event network-vif-unplugged:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h1-851028-12 Sep 14 10:30:09.570580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] Instance da162c9b-7390-497c-a874-654effc6ac34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:30:09.582196 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-f460a028-1335-4ac3-b21d-a6fa281727ba req-dee55215-db49-4191-81b3-1f9944a1535c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047277 Sep 14 10:30:09.583425 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2097/6309] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:30:09.661353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:09.662029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:09.669182 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:09.669693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:09.670155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:09.670914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:09.671388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:09.671837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:09.900061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:09.910078 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9ca412a6-f5dc-4f5a-809d-34611818c4f8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1727 microversion: 2.1 time: 0.253542 Sep 14 10:30:09.910732 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4213/6310] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:09 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1727 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:30:10.935285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:10.935914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:10.943742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:10.944576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:10.945009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:10.946858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:10.946858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:10.947300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:11.417202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:11.427082 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6f4cf7b2-26c8-4a5a-a69c-710b6c45886b tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.496048 Sep 14 10:30:11.428054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2098/6311] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:10 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:11.624969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:11.636462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:11.636958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:11.637401 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:11.650369 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Creating event network-changed:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h1-851028-12 Sep 14 10:30:11.656086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] Instance da162c9b-7390-497c-a874-654effc6ac34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:30:11.667431 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-40801231-4225-46ae-a1da-140d42c7b140 req-d82801f1-ef9f-44d7-b801-d1cc4a5b79ff service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046152 Sep 14 10:30:11.668196 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4214/6312] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:30:12.451035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:12.451562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:12.459218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:12.459708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:12.460176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:12.460880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:12.461333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:12.461757 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:12.600300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:12.608797 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-50b97892-5492-400f-9c69-94f293ec05f5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.161736 Sep 14 10:30:12.609391 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2099/6313] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:12 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:13.634950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:13.635675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:13.642130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:13.642631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:13.643618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:13.644380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:13.644864 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:13.645311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:13.785839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:13.794732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c6d0e8de-cde2-47b1-a11b-f2b4122422a2 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.164823 Sep 14 10:30:13.795343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4215/6314] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:13 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:14.818957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:14.819646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:14.826633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:14.828116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:14.828560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:14.829263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:14.829717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:14.830711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:14.972800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:14.981707 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a98ecffb-00e4-4e31-8400-be73646d984f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.167284 Sep 14 10:30:14.982305 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2100/6315] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:14 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:16.005241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:16.005871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:16.012765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:16.013258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:16.013703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:16.014403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:16.014866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:16.015302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:16.154759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:16.164067 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-60054284-2f74-4712-ba86-8494628b40e4 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.162801 Sep 14 10:30:16.164686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4216/6316] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:15 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:17.187423 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:17.188098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:17.194373 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:17.194861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:17.195299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:17.196041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:17.196498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:17.196926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:17.327686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:17.336224 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-63d0f402-db29-460f-add4-8f04159a6439 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.152815 Sep 14 10:30:17.336811 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2101/6317] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:17 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:18.360206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:18.360871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:18.367361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:18.367863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:18.368357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:18.369069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:18.369541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:18.369983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:18.501955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:18.510971 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-612c555f-8457-4f76-b672-1c5c393f14dd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.155068 Sep 14 10:30:18.511557 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4217/6318] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:18 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:19.535816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:19.536455 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:19.543210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:19.543720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:19.544188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:19.544875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:19.545325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:19.545746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:19.682924 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:19.692223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ebe1aaf5-aedb-4d7e-9da2-a348464822a8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.160641 Sep 14 10:30:19.692811 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2102/6319] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:19 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:20.716415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:20.717047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:20.725010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:20.725519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:20.725975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:20.726695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:20.727169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:20.727617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:20.861439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:20.869886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-670e6b7e-2229-434d-9e7f-279b92ca0941 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.157459 Sep 14 10:30:20.870469 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4218/6320] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:20 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:21.892925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:21.893517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:21.896479 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:30:21.896612 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 (ip 10.222.0.90) !!! Sep 14 10:30:21.897864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=33 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:21.906206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:21.906694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:21.907132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:21.907852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:21.908994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:21.909435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:21.912493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:22.043568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:22.052459 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-776f0bb3-a0cb-4e32-9fe9-5e1ad0c1c179 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1725 microversion: 2.1 time: 0.163120 Sep 14 10:30:22.053043 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2103/6321] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:21 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:23.075924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:23.076559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:23.079337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=29 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:23.084974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.085469 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.085955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.086657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.087123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.087557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.090161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=83 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:23.225319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:23.233742 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-40744391-6ced-4077-9c22-8845c77bec43 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1722 microversion: 2.1 time: 0.161747 Sep 14 10:30:23.234430 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4219/6322] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:23 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:23.257168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:23.257711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:23.264637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.265114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.265542 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.266219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.266665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.267082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.305215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.305686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.306112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.306826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.307269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.307683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.327481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:30:23.332617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Getting quotas for user e751feb2abbb4637b7d8ef65f4657d1e and project 140bc8b280284ca6bd8a2f1275c078da. Resources: {'cores', 'ram'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:30:23.433766 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31d6145e-000a-46b4-befd-18064c5ad2ba tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/action" status: 202 len: 0 microversion: 2.1 time: 0.180197 Sep 14 10:30:23.434372 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2104/6323] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:30:23 2022] POST /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:30:23.443039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:23.443672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:23.449814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.450314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.450757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.451466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:23.451963 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:23.452474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:23.655528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:23.665195 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-00dca24a-7cf9-4f9b-b133-df99b2ce8078 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.226377 Sep 14 10:30:23.665795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4220/6324] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:23 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:30:24.691063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:24.691749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:24.698713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:24.699190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:24.699622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:24.700339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:24.700783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:24.701200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:24.842190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:24.851316 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-17e909bd-321a-481d-9571-f62109f1d1a7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.166108 Sep 14 10:30:24.851911 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2105/6325] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:24 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:25.874660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:25.875335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:25.882395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:25.882924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:25.883365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:25.884124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:25.884603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:25.885053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:26.024113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:26.032678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14f2fbd9-99b3-4ad5-9331-08f735059828 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.161911 Sep 14 10:30:26.034016 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4221/6326] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:25 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:27.056764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:27.057489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:27.065901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:27.066411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:27.066844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:27.067592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:27.068076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:27.068499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:27.204813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:27.213450 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6531ba8e-c6a9-4551-b1cf-1e65e4ed3675 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.160510 Sep 14 10:30:27.214036 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2106/6327] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:27 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:28.238457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:28.239099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:28.246274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:28.246789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:28.247280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:28.248085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:28.248561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:28.249007 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:28.387526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:28.396749 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-996622be-5fec-4ebb-9e51-d8c543c38735 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.162509 Sep 14 10:30:28.397343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4222/6328] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:28 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:29.095251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:29.106397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:29.106809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:29.107375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:29.119492 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Creating event network-changed:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:30:29.125212 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] Instance da162c9b-7390-497c-a874-654effc6ac34 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:30:29.136412 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4e094414-b8e7-4079-b2a6-3497843b229a req-bc400895-3955-4d91-af2b-50064ca8f4b3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101500 Sep 14 10:30:29.137042 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2107/6329] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:30:29.420623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:29.421312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:29.428925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:29.429436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:29.429902 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:29.430637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:29.431115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:29.431754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:29.657527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:29.670179 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ad706e60-72a1-4878-8bcf-0ba22a1fc005 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.253035 Sep 14 10:30:29.688198 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4223/6330] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:29 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:30.696538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:30.697155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:30.703387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:30.703878 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:30.704338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:30.705702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:30.706504 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:30.706970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:30.848727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:30.857357 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92956326-0979-448d-9f2a-0b4f069ffbac tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.166153 Sep 14 10:30:30.857941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2108/6331] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:30 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:31.881108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:31.881755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:31.889137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:31.889657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:31.890116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:31.890852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:31.891364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:31.891812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:32.041570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:32.050150 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7cf05a7-76b0-4a33-8db1-13874f93c519 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.173249 Sep 14 10:30:32.050735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4224/6332] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:31 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:33.073509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:33.074297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:33.081717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:33.082210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:33.082702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:33.083401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:33.083855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:33.084302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:33.227396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:33.238062 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-091fe29c-736b-42a8-87bb-6f17655fb83e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.168137 Sep 14 10:30:33.239005 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2109/6333] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:33 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:34.262424 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:34.263219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:34.271411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:34.272029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:34.272488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:34.273255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:34.273757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:34.274197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:34.413993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:34.422565 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f6a91b3-9ad7-45cc-921d-dd826d353797 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.164106 Sep 14 10:30:34.423085 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4225/6334] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:34 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:35.446816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:35.447350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:35.449488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:35.458328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:35.458965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:35.459478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:35.460349 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:35.460807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:35.461237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:35.594972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:35.604082 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-70a58fa0-e67b-404e-a26c-974c182fb0e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.161248 Sep 14 10:30:35.604667 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2110/6335] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:35 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:36.627645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:36.628301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:36.635309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:36.635807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:36.636288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:36.637002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:36.637473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:36.637920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:36.773556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:36.782188 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a14f3ec-ca57-43b9-a4fa-5e41a513bbf0 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.158520 Sep 14 10:30:36.782798 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4226/6336] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:36 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:37.805511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:37.806118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:37.813076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:37.813580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:37.814008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:37.814711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:37.815256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:37.815688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:37.946697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:37.955722 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c3de6c1b-67d2-40b5-83a3-9305068a2100 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.153435 Sep 14 10:30:37.956356 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2111/6337] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:37 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:38.980487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:38.981114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:38.988184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:38.988682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:38.989126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:38.989820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:38.990290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:38.990725 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:39.122945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:39.131852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64b4395d-572c-4398-b5eb-211c0bb5a0be tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.155329 Sep 14 10:30:39.132473 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4227/6338] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:38 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:40.156720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:40.157260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:40.165215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:40.165717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:40.166163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:40.166867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:40.167315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:40.167737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:40.307657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:40.316232 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d48e45e-f53f-4c8e-874c-ae6a94c73141 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.163558 Sep 14 10:30:40.316819 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2112/6339] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:40 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:41.340289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:41.340918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:41.348788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:41.349294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:41.350082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:41.350806 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:41.351284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:41.351796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:41.494530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:41.503615 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1ef9f93e-643f-4f31-b4ab-6eaa2d6c8b37 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1721 microversion: 2.1 time: 0.167203 Sep 14 10:30:41.504220 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4228/6340] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:41 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:42.526629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:42.527239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:42.534093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.534675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.535343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:42.536074 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.536529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.536955 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:42.668813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:42.678118 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b126065e-0d10-4ff3-b682-a46ead54fdd8 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1714 microversion: 2.1 time: 0.155358 Sep 14 10:30:42.678706 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2113/6341] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:42 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:42.700621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:42.701274 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:42.708125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.708618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.709063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:42.709763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.710226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.710659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:42.848846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:42.857449 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed6f9de2-d5ac-4110-874b-275eace9cb9d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1714 microversion: 2.1 time: 0.160688 Sep 14 10:30:42.858036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4229/6342] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:42 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:42.880120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:42.880729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:42.886633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.887108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.887539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:42.888238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:42.888684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:42.889103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:43.024088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:43.032482 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f1238336-c054-46c8-9374-ecebf3db586c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1714 microversion: 2.1 time: 0.156233 Sep 14 10:30:43.033067 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2114/6343] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:42 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:43.055599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:43.056076 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:43.062003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:43.062496 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:43.062940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:43.063637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:43.064223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:43.064883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:43.091143 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:30:43.177622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d44a1ac-1e59-4fc6-81b7-39d58dec4e42 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 204 len: 0 microversion: 2.1 time: 0.125646 Sep 14 10:30:43.178227 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4230/6344] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:30:43 2022] DELETE /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 10:30:43.186480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:43.187117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:43.193428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:43.193914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:43.194351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:43.195043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:43.195498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:43.195949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:43.330376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:43.339257 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79e78b66-0dab-4f51-866a-595a2b84a885 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1720 microversion: 2.1 time: 0.156707 Sep 14 10:30:43.339843 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2115/6345] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:43 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:44.014316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "name": "network-vif-plugged", "status": "completed", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:44.026060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:44.026562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:44.027082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:44.038389 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] Creating event network-vif-plugged:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:30:44.043685 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-027d10e3-7ec9-4b1e-943a-ca7bd2842e83 req-8bddea1f-ab09-462b-a62f-b308e8de9a39 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087210 Sep 14 10:30:44.044760 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4231/6346] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:30:44.364144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:44.364773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:44.371646 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:44.372157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:44.372592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:44.373276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:44.373721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:44.374142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:44.510118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:44.518476 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ff50c482-70e0-4ba7-bac2-b89e3fd2e062 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1720 microversion: 2.1 time: 0.159359 Sep 14 10:30:44.519753 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2116/6347] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:44 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:45.543635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:45.544482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:45.553668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:45.555202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:45.556057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:45.557441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:45.557986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:45.558438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:45.611416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da162c9b-7390-497c-a874-654effc6ac34", "name": "network-vif-deleted", "tag": "da963fad-1814-447e-b68b-4e2ae26e0d65"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:30:45.630469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:45.631311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:45.631826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:45.648330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:45.649490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:45.660918 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] Creating event network-vif-deleted:da963fad-1814-447e-b68b-4e2ae26e0d65 for instance da162c9b-7390-497c-a874-654effc6ac34 on n-h2-851028-12 Sep 14 10:30:45.661765 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ef72804-9478-4cb5-a7ce-8496105bbb40 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1652 microversion: 2.1 time: 0.120738 Sep 14 10:30:45.662759 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4232/6348] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:45 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1652 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:45.678738 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ee46491b-7373-4c9b-a45c-dc27686d8e97 req-75f7ee1b-ee9e-43e6-8b3d-5577ce4ef5c9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070617 Sep 14 10:30:45.683726 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2117/6349] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:30:46.686281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:46.687099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:46.694001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:46.694586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:46.695113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:46.695936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:46.696487 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:46.697000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:46.761268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:46.770345 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1d9bc33c-1ddd-41cc-90f3-1bd5594b76e1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1368 microversion: 2.1 time: 0.088188 Sep 14 10:30:46.771021 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4233/6350] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:46 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:47.795056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:47.795746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:47.804079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:47.804550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:47.804982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:47.805671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:47.806118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:47.806538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:47.872283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:47.881454 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-78d0e466-9800-4a81-a10c-99f4749049a9 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1368 microversion: 2.1 time: 0.090912 Sep 14 10:30:47.882050 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2118/6351] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:47 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:48.904916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:48.905705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:48.913574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:48.913936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:48.914387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:48.915113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:48.915607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:48.916072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:48.983793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:48.986282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:48.995180 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4d8295f8-183c-40e3-8c69-d646161aa93c tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1368 microversion: 2.1 time: 0.094131 Sep 14 10:30:48.996010 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4234/6352] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:48 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:50.019675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:50.020375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:50.027289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:50.027987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:50.028433 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:50.029158 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:50.029616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:50.030042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:50.064122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:50.064593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:50.065026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:50.065473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lazy-loading 'fault' on Instance uuid da162c9b-7390-497c-a874-654effc6ac34 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:30:50.107075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e751feb2abbb4637b7d8ef65f4657d1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140bc8b280284ca6bd8a2f1275c078da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:30:50.116645 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-be71ce4f-f9c4-403b-95ca-12dddaa562f1 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 200 len: 1373 microversion: 2.1 time: 0.101314 Sep 14 10:30:50.117238 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2119/6353] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:50 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 1373 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:30:51.140104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:51.140659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:51.149471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:51.149980 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:51.150438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:51.151158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:51.151634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:51.152125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:51.166013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 HTTP/1.1 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'da162c9b-7390-497c-a874-654effc6ac34'} Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:51.167709 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-04e6e6ca-f889-4322-8aee-c7a790f40004 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 404 len: 111 microversion: 2.1 time: 0.034266 Sep 14 10:30:51.171762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4235/6354] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:51 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:51.232076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:51.234235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:51.242276 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:51.242763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:51.243202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:51.243917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:51.244370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:51.244797 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:51.258124 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-volume_attachments HTTP/1.1 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': 'da162c9b-7390-497c-a874-654effc6ac34'} Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:51.259792 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f09a0afe-65f2-43f8-9929-62d39712c98f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033189 Sep 14 10:30:51.264395 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2120/6355] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:30:51 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.598114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.598712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.601942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:54.607416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.607953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.608411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.609132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.609603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.610044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.628937 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 HTTP/1.1 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'da162c9b-7390-497c-a874-654effc6ac34'} Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.630563 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73c03f97-6a64-4a8b-87e8-263d8437c89d tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 404 len: 111 microversion: 2.1 time: 0.038398 Sep 14 10:30:54.634777 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4236/6356] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:30:54 2022] DELETE /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.640613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.641228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: da162c9b-7390-497c-a874-654effc6ac34] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.644653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:30:54.650815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.651310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.651747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.652477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.652940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.653359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.668460 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 HTTP/1.1 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'da162c9b-7390-497c-a874-654effc6ac34'} Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.670020 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance da162c9b-7390-497c-a874-654effc6ac34 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-32bb0909-97a1-4f3d-86ac-1ed2023b0cdd tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34" status: 404 len: 111 microversion: 2.1 time: 0.034610 Sep 14 10:30:54.674607 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2121/6357] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:54 2022] GET /compute/v2.1/servers/da162c9b-7390-497c-a874-654effc6ac34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.680637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.681174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.687250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.687755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.688243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.688971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.689442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.689879 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.704964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 HTTP/1.1 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'e73de039-1221-407d-811d-136204a66b06'} Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.706603 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cdf20bc7-c832-4b93-a69a-b20756fdaca7 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 404 len: 111 microversion: 2.1 time: 0.031527 Sep 14 10:30:54.714086 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4237/6358] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:30:54 2022] DELETE /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.716935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.717546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: e73de039-1221-407d-811d-136204a66b06] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.726145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.726649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.727072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.727854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.728499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.728926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.744518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 HTTP/1.1 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e73de039-1221-407d-811d-136204a66b06'} Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.745916 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance e73de039-1221-407d-811d-136204a66b06 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc06e767-dbbe-4cfa-b817-67193bcfc64e tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06" status: 404 len: 111 microversion: 2.1 time: 0.034263 Sep 14 10:30:54.750300 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2122/6359] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:54 2022] GET /compute/v2.1/servers/e73de039-1221-407d-811d-136204a66b06 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:30:54.756131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.756643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.763674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.764212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.764859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.765912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.766013 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.766705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.781107 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e HTTP/1.1 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'ef4053b3-8d44-48e5-a6b0-70131ad1a27e'} Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.782800 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e35889c-25b8-46b2-80af-9d87ef392b03 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 404 len: 111 microversion: 2.1 time: 0.032397 Sep 14 10:30:54.791874 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4238/6360] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:30:54 2022] DELETE /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:30:54.794077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.794688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: ef4053b3-8d44-48e5-a6b0-70131ad1a27e] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.801767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.802390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.802828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.803520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.803999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.804705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.819141 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e HTTP/1.1 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'ef4053b3-8d44-48e5-a6b0-70131ad1a27e'} Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.820708 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance ef4053b3-8d44-48e5-a6b0-70131ad1a27e could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ebb97760-0a56-4b67-b93f-c430d331eb4f tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e" status: 404 len: 111 microversion: 2.1 time: 0.032415 Sep 14 10:30:54.826042 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2123/6361] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:54 2022] GET /compute/v2.1/servers/ef4053b3-8d44-48e5-a6b0-70131ad1a27e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.830817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.831447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.837667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.838162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.838611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.839314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.839782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.840246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.854928 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad HTTP/1.1 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '31498798-5c8b-4970-96fa-e83f5fc698ad'} Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.856542 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-add21fc8-fb40-434d-b0f7-b3260d008638 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 404 len: 111 microversion: 2.1 time: 0.031021 Sep 14 10:30:54.861233 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4239/6362] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:30:54 2022] DELETE /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:30:54.866956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.867560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [instance: 31498798-5c8b-4970-96fa-e83f5fc698ad] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:30:54.873718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.874206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.874643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.875338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:30:54.875792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:30:54.876248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:30:54.890830 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] HTTP exception thrown: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Request method failure captured: Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad HTTP/1.1 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIav14SPUmsjbJjts8HUbODbO_v5BAxPwISQVUik3yvta28roYHqSQvlNpLRCfgFJHwipnZyEUcI5UizV3BoVzS2XJ8lLedYtqZgXcArNJmwlnGfYyM7Tml6LVKLyRcdSWZ1-0x7x3Iwb12rfXzqsEjU7HqlcgkLIuIHZkgOfln_AAh8 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_140bc8b280284ca6bd8a2f1275c078da", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/140bc8b280284ca6bd8a2f1275c078da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/140bc8b280284ca6bd8a2f1275c078da"}]}] Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 140bc8b280284ca6bd8a2f1275c078da Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServerActionsTestJSON-1959888367 Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: e751feb2abbb4637b7d8ef65f4657d1e Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServerActionsTestJSON-1959888367-project Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '31498798-5c8b-4970-96fa-e83f5fc698ad'} Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:30:54.892446 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Returning 404 to user: Instance 31498798-5c8b-4970-96fa-e83f5fc698ad could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40d7cb7d-fd2d-484d-a74a-2209ffe4893a tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad" status: 404 len: 111 microversion: 2.1 time: 0.031269 Sep 14 10:30:54.897023 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2124/6363] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:30:54 2022] GET /compute/v2.1/servers/31498798-5c8b-4970-96fa-e83f5fc698ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:30:54.902870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3a74291b-3321-4c52-a577-eca86f6a90e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] Calling method '.version_select at 0x7f693e4ab790>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:30:54.907477 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3a74291b-3321-4c52-a577-eca86f6a90e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [894a88dd-6d39-414d-8114-be0be4da06cf] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:30:55.915690 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [None req-3a74291b-3321-4c52-a577-eca86f6a90e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] [894a88dd-6d39-414d-8114-be0be4da06cf] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 53228. Sep 14 10:30:55.936780 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3a74291b-3321-4c52-a577-eca86f6a90e5 tempest-ServerActionsTestJSON-1959888367 tempest-ServerActionsTestJSON-1959888367-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297667874" status: 202 len: 0 microversion: 2.1 time: 1.037663 Sep 14 10:30:55.937367 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4240/6364] 10.222.0.90 () {58 vars in 1218 bytes} [Wed Sep 14 10:30:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297667874 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:31:05.362625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:05.364140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=25 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:05.485313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1185558985", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "bc131475-c874-4213-b991-03e68c94f714"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:05.541387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] validate_networks() for [('bc131475-c874-4213-b991-03e68c94f714', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:31:05.985932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:31:05.986410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:31:05.986879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:31:05.988017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:31:05.988510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:31:05.997690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:05.998103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:05.998538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:05.999253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:05.999703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:06.000151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:06.017377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Getting quotas for project b79890a8936d4466a0e52e09296010e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:31:06.022537 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Getting quotas for user c95de0d875a049349012522a19bf3852 and project b79890a8936d4466a0e52e09296010e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:31:06.035290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:31:06.037850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:31:06.084323 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-72438cba-9c7a-40fa-974d-f03e063ca109 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727098 Sep 14 10:31:06.085517 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2125/6365] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:31:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 14 10:31:06.094695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=11 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:06.096136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:06.102750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-314d9cb7-17c4-4ea8-a82e-b90dea9b87e3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:06.103395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-314d9cb7-17c4-4ea8-a82e-b90dea9b87e3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:06.169212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-314d9cb7-17c4-4ea8-a82e-b90dea9b87e3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:06.180395 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-314d9cb7-17c4-4ea8-a82e-b90dea9b87e3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1217 microversion: 2.1 time: 0.087353 Sep 14 10:31:06.181025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4241/6366] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:06 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:07.203557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:07.204808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:07.212141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:07.212874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:07.213473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:07.214385 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:07.214992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:07.215579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:07.314631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:07.325429 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae8854b1-31bc-49ae-a0ed-6d252649cb21 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1277 microversion: 2.1 time: 0.126527 Sep 14 10:31:07.326024 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2126/6367] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:07 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:08.348774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:08.349562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:08.358499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:08.359378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:08.359844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:08.360726 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:08.361083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:08.361525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:08.569268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:08.583933 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e64e2038-f6d5-49ee-b296-c215993236d2 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.239052 Sep 14 10:31:08.584603 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4242/6368] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:08 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:08.751362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6fedf3-8850-4791-8f4b-4278371a233d", "tag": "dd397ff2-e894-47b5-99c9-23808ad92606"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:08.763322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:08.764135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:08.764746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:08.779585 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] Creating event network-changed:dd397ff2-e894-47b5-99c9-23808ad92606 for instance 4d6fedf3-8850-4791-8f4b-4278371a233d on n-h2-851028-12 Sep 14 10:31:08.786552 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1ec21bc0-1caa-4346-a234-c841c8f3ef0f req-d04df898-4e1a-4cba-9f28-bc5161e8b623 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038770 Sep 14 10:31:08.787880 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2127/6369] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:31:09.608580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:09.609206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:09.616254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:09.616755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:09.617204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:09.617913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:09.618386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:09.618843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:09.756991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:09.764764 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82ce4910-407d-454a-a32d-afbe00652832 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.160134 Sep 14 10:31:09.765350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4243/6370] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:09 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:10.790865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:10.791566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:10.798981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:10.799470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:10.799998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:10.801278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:10.801809 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:10.802534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:10.995918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:11.004335 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-34dfddaa-e69b-48a4-84c7-a1beeff9d3c3 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.218575 Sep 14 10:31:11.004929 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2128/6371] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:10 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:12.027591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:12.028276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:12.036150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:12.036661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:12.037122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:12.037847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:12.038319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:12.038768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:12.176236 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:12.184873 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82789140-4f7b-4edd-bd16-6b0c542ee441 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.161295 Sep 14 10:31:12.185570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4244/6372] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:12 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:13.208219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:13.208829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:13.215586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:13.216159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:13.216596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:13.217277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:13.217725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:13.218151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:13.351443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:13.359151 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-943900cf-eddb-43f9-ac37-54e8a5f009e1 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.155163 Sep 14 10:31:13.359727 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2129/6373] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:13 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:14.142439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fedf3-8850-4791-8f4b-4278371a233d", "name": "network-vif-plugged", "status": "completed", "tag": "dd397ff2-e894-47b5-99c9-23808ad92606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:14.153955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:14.154624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:14.155095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:14.166692 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] Creating event network-vif-plugged:dd397ff2-e894-47b5-99c9-23808ad92606 for instance 4d6fedf3-8850-4791-8f4b-4278371a233d on n-h2-851028-12 Sep 14 10:31:14.171763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5e534fb6-2df1-4759-9d6e-93ee7c6886e0 req-4fff1c62-eb2e-4fad-91f2-b35f51fdef71 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033093 Sep 14 10:31:14.172605 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4245/6374] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:31:14.385091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:14.385702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:14.392639 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:14.393130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:14.394476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:14.395320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:14.395780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:14.396301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:14.533354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:14.541229 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ef10b4f0-feaf-4d23-86d6-5259608c40fc tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1317 microversion: 2.1 time: 0.160046 Sep 14 10:31:14.541807 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2130/6375] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:14 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:31:15.567162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:15.568409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:15.574632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:15.575126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:15.575573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:15.576298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:15.576783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:15.577219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:15.717814 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:15.726897 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a245229b-b9ec-4d8e-a458-06e0d5738165 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.165916 Sep 14 10:31:15.727460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4246/6376] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:15 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:15.790202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1598002447", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "bc131475-c874-4213-b991-03e68c94f714"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:15.845032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] validate_networks() for [('bc131475-c874-4213-b991-03e68c94f714', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:31:16.007248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:16.029024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:16.228942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:31:16.229299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:31:16.229787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:31:16.230214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:31:16.230619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:31:16.240326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:16.240972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:16.241406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:16.242129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:16.242579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:16.243001 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:16.260285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Getting quotas for project b79890a8936d4466a0e52e09296010e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:31:16.265572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Getting quotas for user c95de0d875a049349012522a19bf3852 and project b79890a8936d4466a0e52e09296010e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:31:16.277859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:31:16.280163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:31:16.326205 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0bdb3777-13f5-42a0-85d5-89375a979b12 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540628 Sep 14 10:31:16.326861 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2131/6377] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:31:16.338211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b6d7cd1-9eba-4dce-8217-ab7e33a7b0a4 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:16.338848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b6d7cd1-9eba-4dce-8217-ab7e33a7b0a4 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:16.341246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:16.395290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b6d7cd1-9eba-4dce-8217-ab7e33a7b0a4 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:16.405491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b6d7cd1-9eba-4dce-8217-ab7e33a7b0a4 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1217 microversion: 2.1 time: 0.071276 Sep 14 10:31:16.406094 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4247/6378] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:16 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:17.433490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:17.434474 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:17.446571 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:17.447070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:17.447536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:17.448267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:17.448715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:17.449142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:17.513899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:17.522354 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6144f9a4-a29b-41eb-af6f-3c3378a3f26d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1275 microversion: 2.1 time: 0.095865 Sep 14 10:31:17.522931 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2132/6379] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:17 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1275 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:18.545457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:18.546010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:18.554764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:18.555281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:18.555738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:18.556505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:18.557171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:18.557622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:18.761171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:18.771911 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cec96dd2-f0f7-44f7-9cbb-6d7450936552 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.230879 Sep 14 10:31:18.772524 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4248/6380] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:18 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:31:19.100411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d7e162d-e223-480d-82ae-9e5ab0957c99", "tag": "f7b13986-a44c-46dd-85a5-c10a213b4323"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:19.111521 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:19.112048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:19.112481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:19.125280 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] Creating event network-changed:f7b13986-a44c-46dd-85a5-c10a213b4323 for instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 on n-h1-851028-12 Sep 14 10:31:19.130226 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5d504462-8e4d-44ac-8c71-112849513dcc req-3a94b89a-3a18-4bac-a383-bad845f3dd69 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035714 Sep 14 10:31:19.130951 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2133/6381] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:31:19.795378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:19.796048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:19.799101 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:31:19.799250 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:31:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 (ip 10.222.0.90) !!! Sep 14 10:31:19.807186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:19.807694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:19.808173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:19.808894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:19.809368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:19.809816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:19.943103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:19.951010 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-215b4e1d-eecf-4608-9b47-808f71c0f309 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.159675 Sep 14 10:31:19.951597 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4249/6382] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:19 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:20.977233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:20.977856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:20.984017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:20.984495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:20.984925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:20.985605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:20.986049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:20.986467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:21.125487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:21.133785 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9cb3f845-1607-469b-851d-9d5fe975c619 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.162729 Sep 14 10:31:21.134354 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2134/6383] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:20 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:22.156692 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:22.157347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:22.165493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:22.166037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:22.166493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:22.167244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:22.167722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:22.168192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:22.301520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:22.309574 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4325c4a6-ac63-4afd-b094-357d0d9ef1f8 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.156837 Sep 14 10:31:22.310363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4250/6384] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:22 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:23.333191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:23.333804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:23.341374 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:23.341848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:23.342273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:23.342952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:23.343395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:23.343811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:23.478794 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:23.486362 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9604c672-b39a-497d-bf78-53041bf93407 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.157041 Sep 14 10:31:23.486950 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2135/6385] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:23 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:24.509778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:24.510416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:24.517430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:24.517927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:24.518373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:24.519084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:24.519549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:24.520012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:24.657006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:24.664991 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70b27144-9f72-4e18-b8c8-bf841dbf3e16 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.159312 Sep 14 10:31:24.665577 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4251/6386] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:24 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:25.688129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:25.688743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:25.696059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:25.696585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:25.697019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:25.697727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:25.698167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:25.698612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:25.812243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7e162d-e223-480d-82ae-9e5ab0957c99", "name": "network-vif-plugged", "status": "completed", "tag": "f7b13986-a44c-46dd-85a5-c10a213b4323"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:25.827574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:25.828344 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:25.828968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:25.837911 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:25.842171 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] Creating event network-vif-plugged:f7b13986-a44c-46dd-85a5-c10a213b4323 for instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 on n-h1-851028-12 Sep 14 10:31:25.848061 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-180f630e-365e-4e8c-a5e7-219ca13ce692 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.163356 Sep 14 10:31:25.848238 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f0de277b-3f67-4b00-ae02-36c97e418e4c req-58c8ff49-b318-4544-b691-dc1d86fa0c2c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039462 Sep 14 10:31:25.848339 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2136/6387] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:25 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:25.848612 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4252/6388] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:31:26.872139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:26.872801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:26.874734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:26.875543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:26.882779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:26.883282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:26.883722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:26.884457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:26.884917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:26.885344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:27.019183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:27.027428 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e134da2d-9f2b-42ef-8697-cf3eccb0183c tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1317 microversion: 2.1 time: 0.159249 Sep 14 10:31:27.028033 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2137/6389] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:26 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:31:28.049739 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:28.055413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:28.056173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:28.062689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.063193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.063648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.064428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.064896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.065339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.207051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:28.214918 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ff661e41-5d03-4318-a6af-8e919aa9bd83 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1507 microversion: 2.1 time: 0.166227 Sep 14 10:31:28.215517 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4253/6390] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:28 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:28.237618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:28.238153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:28.245533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.246021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.246456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.247151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.247607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.248075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.274248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:31:28.353269 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-47df46ca-eef9-42d4-82aa-071b173f5daf tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 204 len: 0 microversion: 2.1 time: 0.119162 Sep 14 10:31:28.353822 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2138/6391] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:31:28 2022] DELETE /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:31:28.362273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:28.362908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:28.369672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.370176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.370632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.371347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:28.371843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:28.372312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:28.509580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:28.518616 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90f9b776-c1f7-4767-bd40-a86866d29e6e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1513 microversion: 2.1 time: 0.160279 Sep 14 10:31:28.519209 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4254/6392] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:28 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:29.543026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:29.543755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:29.550678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:29.551164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:29.551603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:29.552316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:29.552772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:29.553194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:29.687959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:29.696635 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8b082bb4-b8b0-47b0-a999-6a7a05c3c51e tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 200 len: 1513 microversion: 2.1 time: 0.158076 Sep 14 10:31:29.697425 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2139/6393] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:29 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:30.296455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d7e162d-e223-480d-82ae-9e5ab0957c99", "name": "network-vif-deleted", "tag": "f7b13986-a44c-46dd-85a5-c10a213b4323"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:30.307800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.308390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.308831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.323473 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] Creating event network-vif-deleted:f7b13986-a44c-46dd-85a5-c10a213b4323 for instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 on n-h1-851028-12 Sep 14 10:31:30.329014 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8684fd78-6632-4876-b412-34c3910a4c59 req-df34e530-8f49-4b54-bd90-6d8a14d4c7a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204060 Sep 14 10:31:30.329650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4255/6394] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:31:30.720895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:30.721538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:30.729493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.729977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.730410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.731097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.731548 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.731999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.745620 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 HTTP/1.1 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4d7e162d-e223-480d-82ae-9e5ab0957c99'} Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:30.747258 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 404 to user: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1a02985c-f50a-46c3-996c-24f3ea8c41d7 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 404 len: 111 microversion: 2.1 time: 0.031857 Sep 14 10:31:30.752760 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2140/6395] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:30 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:31:30.759140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:30.759872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:30.766196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.766697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.767159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.767876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.768378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.768830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.905240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:30.913281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-81299a97-a4d0-4372-810f-705788e49382 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.159140 Sep 14 10:31:30.913871 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4256/6396] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:30 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:30.936156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:30.938486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 63179e6b-4e24-4db2-9aae-d019f83b4cac] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:30.944139 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/63179e6b-4e24-4db2-9aae-d019f83b4cac/action HTTP/1.1 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 32 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: {"resize": {"flavorRef": "452"}} Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '63179e6b-4e24-4db2-9aae-d019f83b4cac', 'body': {'resize': {'flavorRef': '452'}}} Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:31:30.945678 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 404 to user: Instance 63179e6b-4e24-4db2-9aae-d019f83b4cac could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-64308620-88bf-4950-af83-bd1394322f1d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "POST /compute/v2.1/servers/63179e6b-4e24-4db2-9aae-d019f83b4cac/action" status: 404 len: 111 microversion: 2.1 time: 0.014949 Sep 14 10:31:30.950335 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2141/6397] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:31:30 2022] POST /compute/v2.1/servers/63179e6b-4e24-4db2-9aae-d019f83b4cac/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:31:30.955555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:30.956259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:30.962782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.963286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.963744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:30.964522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:30.964999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:30.965448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.105891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.113824 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5bea5745-864e-4f2a-8b2d-0898b5011814 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.162155 Sep 14 10:31:31.114410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4257/6398] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:30 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:31.137117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.137723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.144547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.145031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.145466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.146152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.146604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.147027 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.293595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.301393 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb96f250-1dda-497e-8eb9-5d92ae4d3a7d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.168065 Sep 14 10:31:31.301982 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2142/6399] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:31 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:31.323923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9da2601e-2396-4855-ae82-97c7bbe5b12f"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:31.326246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.333071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.333563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.334009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.334707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.335172 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.335609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.365034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.370266 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: request: POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action HTTP/1.1 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 65 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: {"resize": {"flavorRef": "9da2601e-2396-4855-ae82-97c7bbe5b12f"}} Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: exception: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4d6fedf3-8850-4791-8f4b-4278371a233d', 'body': {'resize': {'flavorRef': '9da2601e-2396-4855-ae82-97c7bbe5b12f'}}} Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:31.372205 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 400 to user: Flavor 9da2601e-2396-4855-ae82-97c7bbe5b12f could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7991e6d7-439a-42f1-9463-d00e9598863d tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action" status: 400 len: 107 microversion: 2.1 time: 0.053771 Sep 14 10:31:31.376925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4258/6400] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:31:31 2022] POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 10:31:31.382347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.383104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.389110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.389600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.390039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.390730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.391188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.391631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.532316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.545046 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7180513a-d585-4b67-bd30-6a8449145356 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.166491 Sep 14 10:31:31.545644 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2143/6401] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:31 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:31.568298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.568929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.575020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.575522 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.575997 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.576705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.577174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.577615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.709265 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.717573 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7195147-bc7d-4061-8234-aae22f9c54b6 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.153166 Sep 14 10:31:31.718148 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4259/6402] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:31 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:31.741171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80ddd893-019e-4805-a82a-8c3e03a6ad08 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80ddd893-019e-4805-a82a-8c3e03a6ad08 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: request: POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action HTTP/1.1 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 29 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: {"resize": {"flavorRef": ""}} Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4d6fedf3-8850-4791-8f4b-4278371a233d', 'body': {'resize': {'flavorRef': ''}}} Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise error Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi '' Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.745004 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80ddd893-019e-4805-a82a-8c3e03a6ad08 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80ddd893-019e-4805-a82a-8c3e03a6ad08 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action" status: 400 len: 113 microversion: 2.1 time: 0.009290 Sep 14 10:31:31.750182 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2144/6403] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:31:31 2022] POST /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 14 10:31:31.754825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.755453 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.761584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.762078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.762521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.763222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.763686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.764149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.897992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:31.907097 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-edbdbf1d-145c-4472-b18a-8d1a4c4f52fb tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1506 microversion: 2.1 time: 0.156031 Sep 14 10:31:31.907604 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4260/6404] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:31 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:31.933921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.934411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.941356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.941834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.942273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.942954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.943402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.943823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.948041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:31.957752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 HTTP/1.1 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '4d7e162d-e223-480d-82ae-9e5ab0957c99'} Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:31:31.959345 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 404 to user: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9655e24d-bce4-4427-a670-a06328457bfe tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 404 len: 111 microversion: 2.1 time: 0.031680 Sep 14 10:31:31.964796 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2145/6405] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:31:31 2022] DELETE /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:31:31.969857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:31.970491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d7e162d-e223-480d-82ae-9e5ab0957c99] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:31.977416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.977946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.978705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.979434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:31.979958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:31.980224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:31.993528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 HTTP/1.1 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4d7e162d-e223-480d-82ae-9e5ab0957c99'} Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:31.995057 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 404 to user: Instance 4d7e162d-e223-480d-82ae-9e5ab0957c99 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-659f60a3-ef2b-41dc-9eb8-efdbf796635a tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99" status: 404 len: 111 microversion: 2.1 time: 0.030521 Sep 14 10:31:31.999659 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4261/6406] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:31 2022] GET /compute/v2.1/servers/4d7e162d-e223-480d-82ae-9e5ab0957c99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:31:32.005463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:32.005962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:32.015217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:32.015711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:32.016176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:32.016872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:32.017327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:32.017750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:32.044534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:31:32.128184 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-df2ffd54-8ba1-414d-bf7d-b1e1744cfa78 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "DELETE /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 204 len: 0 microversion: 2.1 time: 0.126661 Sep 14 10:31:32.128760 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2146/6407] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:31:32 2022] DELETE /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:31:32.137954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:32.138577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:32.144637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:32.145134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:32.145581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:32.146282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:32.146742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:32.147178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:32.168881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=100 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:31:32.295029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:32.303136 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb339a0c-8ef6-4e83-831a-b56caed75268 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1512 microversion: 2.1 time: 0.170122 Sep 14 10:31:32.303802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4262/6408] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:32 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:33.327865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:33.328579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:33.335545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:33.336186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:33.336753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:33.337533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:33.338022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:33.338456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:33.469063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:33.477769 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dba1da6e-f310-4295-ac63-efd543ac355f tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1512 microversion: 2.1 time: 0.154067 Sep 14 10:31:33.478343 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2147/6409] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:33 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:34.134714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6fedf3-8850-4791-8f4b-4278371a233d", "name": "network-vif-deleted", "tag": "dd397ff2-e894-47b5-99c9-23808ad92606"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:31:34.146178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:34.146975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:34.147429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:34.161341 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] Creating event network-vif-deleted:dd397ff2-e894-47b5-99c9-23808ad92606 for instance 4d6fedf3-8850-4791-8f4b-4278371a233d on n-h2-851028-12 Sep 14 10:31:34.168632 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a74053c9-b23d-4564-8d9d-f2e4e17d2cf5 req-01de8965-8e70-4fb1-9f41-ac59de988a5a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Sep 14 10:31:34.169320 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4263/6410] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:31:34.500497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:34.501106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:34.508728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:34.509396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:34.509914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:34.510535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:34.510990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:34.511416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:34.543120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:34.543607 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:34.544079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:34.544532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lazy-loading 'fault' on Instance uuid 4d6fedf3-8850-4791-8f4b-4278371a233d {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:31:34.590345 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c95de0d875a049349012522a19bf3852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b79890a8936d4466a0e52e09296010e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:31:34.598906 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9b770498-1450-4034-9203-e0e7fd0d8f75 tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 200 len: 1307 microversion: 2.1 time: 0.102325 Sep 14 10:31:34.599601 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2148/6411] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:34 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:31:35.628678 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:31:35.629432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] [instance: 4d6fedf3-8850-4791-8f4b-4278371a233d] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:31:35.636104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:35.636600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:35.637052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:35.637760 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:31:35.638231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:31:35.638669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:31:35.652895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] HTTP exception thrown: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Request method failure captured: Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d HTTP/1.1 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa1pHi2zCTdRp0fE1jbBwpU-SATukSP7YjCYzWCe16_8_pJhXEM13W5pXsgrNyq0bsW2cVtP8ICQH1Wy8VeEz-pUC2K5NwS_tpmSKInPvkh1hs2HgWLcZFf0iEJbzowc5VkP9mnHzEeB_MGMgQsZtPJD5zClNjNE3ASXV4L5sZ241cY Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b79890a8936d4466a0e52e09296010e1", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b79890a8936d4466a0e52e09296010e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b79890a8936d4466a0e52e09296010e1"}]}] Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b79890a8936d4466a0e52e09296010e1 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-ServersNegativeTestJSON-359828658 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: c95de0d875a049349012522a19bf3852 Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-ServersNegativeTestJSON-359828658-project Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '4d6fedf3-8850-4791-8f4b-4278371a233d'} Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:31:35.654526 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] Returning 404 to user: Instance 4d6fedf3-8850-4791-8f4b-4278371a233d could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fa64d85-4efc-4a46-99d8-d5f550c364ca tempest-ServersNegativeTestJSON-359828658 tempest-ServersNegativeTestJSON-359828658-project] 10.222.0.90 "GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d" status: 404 len: 111 microversion: 2.1 time: 0.032559 Sep 14 10:31:35.659281 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4264/6412] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:31:35 2022] GET /compute/v2.1/servers/4d6fedf3-8850-4791-8f4b-4278371a233d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:32:09.932443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:09.934650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:10.154616 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fa3227e4-9c84-4942-bf65-3248bd739b8c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: .version_select at 0x7f693f9624c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-252746507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiUTrMX4fkNKWz9aZW1VjfvPYwKQmYkekuNvKvbf1Oxq1VFnIMPKorrg2tuegphpxdOTj/k5Yg5JSg4FkKSuQSuWdEImN5bluPzQQl0irnE0RtXjjpzpFHNiT30D9ufjA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:10.170768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-fa3227e4-9c84-4942-bf65-3248bd739b8c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:32:10.176294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-fa3227e4-9c84-4942-bf65-3248bd739b8c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:32:10.206677 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fa3227e4-9c84-4942-bf65-3248bd739b8c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.280376 Sep 14 10:32:10.207287 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2149/6413] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:32:09 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:32:10.260641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1308036557", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-252746507", "networks": [{"uuid": "c3420c22-ab55-4bdf-a0bf-78858fd9b08a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:10.269718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=54 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:10.270400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:10.321183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] validate_networks() for [('c3420c22-ab55-4bdf-a0bf-78858fd9b08a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:32:10.743777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:32:10.744238 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:32:10.744724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:32:10.745176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:32:10.745598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:32:10.754454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:10.754948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:10.755396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:10.756173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:10.756641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:10.757080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:10.774865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:32:10.780326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:32:10.793728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:32:10.796116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:32:10.844945 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1dc2544d-9e13-4862-8e12-277256224a5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588509 Sep 14 10:32:10.845531 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4265/6414] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:32:10.857709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d0c11759-0a40-49c6-8b20-390d9482acfb tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:10.858325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d0c11759-0a40-49c6-8b20-390d9482acfb tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:10.915249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d0c11759-0a40-49c6-8b20-390d9482acfb tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:10.923438 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d0c11759-0a40-49c6-8b20-390d9482acfb tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1262 microversion: 2.1 time: 0.069205 Sep 14 10:32:10.924261 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2150/6415] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:10 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:11.948473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:11.949140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:11.956520 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:11.957861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:11.958531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:11.959338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:11.960064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:11.960731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:12.045651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:12.053803 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f86be9fe-6b4d-4696-b393-2690177c869b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1322 microversion: 2.1 time: 0.110911 Sep 14 10:32:12.055156 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4266/6416] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:11 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1322 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:13.077478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:13.078106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:13.090928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:13.091478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:13.092363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:13.092665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:13.093123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:13.093554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:13.357106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:13.372936 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aec83be5-0874-4656-a9e8-3bb872de732e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.298241 Sep 14 10:32:13.373796 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2151/6417] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:13 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:13.493573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94201113-9831-46c5-811a-14dd1cd14bf1", "tag": "d9d27a32-eb43-4e6d-a81b-a0b97563a6e8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:13.505709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:13.506171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:13.506562 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:13.533592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] Creating event network-changed:d9d27a32-eb43-4e6d-a81b-a0b97563a6e8 for instance 94201113-9831-46c5-811a-14dd1cd14bf1 on n-h2-851028-12 Sep 14 10:32:13.543861 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-37548af2-534c-45fc-b640-45aabea83756 req-7dcf1a2c-cb03-4614-98e3-97f4b588d5fd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054685 Sep 14 10:32:13.545482 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4267/6418] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:14.402191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:14.402714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:14.409650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:14.410132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:14.410567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:14.411254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:14.411701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:14.412147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:14.549304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:14.557838 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b092e6e6-2acc-4488-b84a-7ba8a2561604 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.160851 Sep 14 10:32:14.558406 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2152/6419] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:14 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:15.583043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:15.583697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:15.590675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:15.591164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:15.591612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:15.592338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:15.592801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:15.593234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:15.738214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:15.746332 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-997ffaf9-46c6-4f80-b2df-63d499d82961 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.168566 Sep 14 10:32:15.746906 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4268/6420] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:15 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:16.770449 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:16.771146 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:16.777323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:16.777826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:16.778239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:16.778923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:16.779431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:16.779856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:16.913979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:16.921457 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-425a9a98-e756-4633-a90f-f6641c696bd1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.155388 Sep 14 10:32:16.922042 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2153/6421] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:16 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:17.946982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:17.947774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:17.954040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:17.954539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:17.954987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:17.955691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:17.956185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:17.956625 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:18.091054 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:18.099013 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6d28f4fa-4d1f-402f-ad70-f34e3a7d1e35 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.157468 Sep 14 10:32:18.099592 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4269/6422] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:17 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:18.487688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94201113-9831-46c5-811a-14dd1cd14bf1", "name": "network-vif-plugged", "status": "completed", "tag": "d9d27a32-eb43-4e6d-a81b-a0b97563a6e8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:18.500049 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:18.500686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:18.501225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:18.512908 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] Creating event network-vif-plugged:d9d27a32-eb43-4e6d-a81b-a0b97563a6e8 for instance 94201113-9831-46c5-811a-14dd1cd14bf1 on n-h2-851028-12 Sep 14 10:32:18.518078 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-db5e2143-118b-406c-84a0-0fea4006c7e4 req-480d35e5-86db-436f-b8db-bb5546a58aca service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034019 Sep 14 10:32:18.518682 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2154/6423] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:19.122427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:19.123081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:19.130545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:19.131055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:19.131536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:19.132300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:19.132796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:19.133823 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:19.265769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:19.274466 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ddf32467-4d08-4053-9685-8a472a4a3e5b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1362 microversion: 2.1 time: 0.155326 Sep 14 10:32:19.275070 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4270/6424] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:19 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:20.299208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:20.299628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:20.306058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:20.306544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:20.306991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:20.307692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:20.308182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:20.308613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:20.442977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:20.451579 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc303315-8777-4c57-98d7-6e54a84f4ced tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1555 microversion: 2.1 time: 0.157945 Sep 14 10:32:20.452262 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2155/6425] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:20 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:20.475391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:20.476308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:20.483986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:20.484493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:20.484951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:20.485666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:20.486140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:20.486619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:20.629273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:20.637312 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a49aab4d-91b0-44f5-8c1e-6a4651322889 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1555 microversion: 2.1 time: 0.165935 Sep 14 10:32:20.637903 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4271/6426] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:20 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:22.253011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba724b00-6a69-4c94-9b30-4f17d54a67e2"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:22.255399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:22.257366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:22.263233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:22.263710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:22.264168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:22.264847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:22.265285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:22.265699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:22.513444 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d92d0b6b-5fa8-444e-9a30-860de914573d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264588 Sep 14 10:32:22.516999 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2156/6427] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:32:22 2022] POST /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:32:33.260107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:33.260648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:33.262638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.263328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.265164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.265921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=34 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.273701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:33.274207 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:33.274666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:33.275458 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:33.275865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:33.276338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:33.358403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'services' on Instance uuid 94201113-9831-46c5-811a-14dd1cd14bf1 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:32:33.438498 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d05e9071-2a70-48ac-a081-2972ff51de2e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments/ba724b00-6a69-4c94-9b30-4f17d54a67e2" status: 202 len: 0 microversion: 2.1 time: 0.182945 Sep 14 10:32:33.439098 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4272/6428] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:32:33 2022] DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments/ba724b00-6a69-4c94-9b30-4f17d54a67e2 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:32:33.445451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.447837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:33.452249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:33.454594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:33.462712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:33.463309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:33.463746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:33.464541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:33.464999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:33.465416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:33.501513 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a6d3f524-d66a-42e2-8c31-f38b7b603497 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057879 Sep 14 10:32:33.502104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2157/6429] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:33 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:34.515196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:34.517733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:34.525312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:34.525922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:34.526449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:34.527234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:34.527773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:34.528316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:34.560458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2170047-306b-446b-91f4-a606392e0696 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049654 Sep 14 10:32:34.561052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4273/6430] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:34 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:35.574025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:35.576226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:35.583315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:35.583796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:35.584255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:35.584952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:35.585399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:35.585817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:35.617640 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aacf2934-14b3-46bc-9dc0-54eb4b0a08ec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047556 Sep 14 10:32:35.618273 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2158/6431] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:35 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:36.629996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:36.632237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:36.640447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:36.640953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:36.641411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:36.642130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:36.642599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:36.643042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:36.674083 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5eceff69-f532-482f-a1d2-255850ccad6c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Sep 14 10:32:36.674670 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4274/6432] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:36 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:37.687230 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:37.689603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:37.698738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:37.699326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:37.699849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:37.700770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:37.701305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:37.701697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:37.736079 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a4bde261-54a1-49c2-88f4-f446ecd7230a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052702 Sep 14 10:32:37.741052 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2159/6433] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:37 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:38.749343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:38.751533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:38.758555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:38.759055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:38.759501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:38.760242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:38.760699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:38.761130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:38.793772 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4396ee3d-c987-48f5-a832-f694ace9201d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048549 Sep 14 10:32:38.794349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4275/6434] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:32:38 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:32:38.804904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:38.805382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:38.812758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:38.813231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:38.813661 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:38.814338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:38.814782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:38.815200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:38.892419 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 is not attached to volume ba724b00-6a69-4c94-9b30-4f17d54a67e2 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments/ba724b00-6a69-4c94-9b30-4f17d54a67e2 HTTP/1.1 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 is not attached to volume ba724b00-6a69-4c94-9b30-4f17d54a67e2 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': '94201113-9831-46c5-811a-14dd1cd14bf1', 'id': 'ba724b00-6a69-4c94-9b30-4f17d54a67e2'} Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ba724b00-6a69-4c94-9b30-4f17d54a67e2. Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 is not attached to volume ba724b00-6a69-4c94-9b30-4f17d54a67e2 Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:32:38.899054 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 is not attached to volume ba724b00-6a69-4c94-9b30-4f17d54a67e2 Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 is not attached to volume ba724b00-6a69-4c94-9b30-4f17d54a67e2 {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2158d489-66ff-4b1c-b6d0-6f17ff036304 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments/ba724b00-6a69-4c94-9b30-4f17d54a67e2" status: 404 len: 154 microversion: 2.1 time: 0.099703 Sep 14 10:32:38.904665 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2160/6435] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:32:38 2022] DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1/os-volume_attachments/ba724b00-6a69-4c94-9b30-4f17d54a67e2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:32:42.270190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:42.270928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:42.278750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:42.279332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:42.279850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:42.280791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:42.281442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:42.281887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:42.309959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:32:42.392221 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-31d781ef-01da-46ca-a44c-611d1524af43 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 204 len: 0 microversion: 2.1 time: 0.125520 Sep 14 10:32:42.392916 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4276/6436] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:32:42 2022] DELETE /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:32:42.402063 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:42.402686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:42.410971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:42.411462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:42.411925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:42.412636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:42.413093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:42.413546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:42.548880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:42.557527 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3a09e65f-7e95-42b5-b258-6d0e5d4c1ae3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1561 microversion: 2.1 time: 0.159992 Sep 14 10:32:42.572085 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2161/6437] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:42 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:43.581539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:43.582267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:43.589697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:43.590197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:43.590650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:43.591369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:43.591840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:43.592317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:43.724154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:43.732451 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4bf8b76e-6b8d-4dc5-a4a8-7126b3697cf5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1561 microversion: 2.1 time: 0.155217 Sep 14 10:32:43.733028 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4277/6438] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:43 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:44.561431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94201113-9831-46c5-811a-14dd1cd14bf1", "name": "network-vif-deleted", "tag": "d9d27a32-eb43-4e6d-a81b-a0b97563a6e8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:44.573286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:44.573764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:44.574189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:44.586518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] Creating event network-vif-deleted:d9d27a32-eb43-4e6d-a81b-a0b97563a6e8 for instance 94201113-9831-46c5-811a-14dd1cd14bf1 on n-h2-851028-12 Sep 14 10:32:44.594273 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-695732f2-52d1-46cb-8aa9-1124d605a323 req-795d33a9-5e8a-4111-a76c-cf7a672315f5 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036561 Sep 14 10:32:44.594898 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2162/6439] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:44.755939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:44.756580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:44.764595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:44.765096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:44.765554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:44.766260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:44.766728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:44.767170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:44.799571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:44.800029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:44.800480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:44.800941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'fault' on Instance uuid 94201113-9831-46c5-811a-14dd1cd14bf1 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:32:44.847070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:44.855298 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ce0030dd-6016-4b68-af33-021fdfa2ff48 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 200 len: 1352 microversion: 2.1 time: 0.103332 Sep 14 10:32:44.855881 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4278/6440] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:44 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:45.879119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:45.879834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: 94201113-9831-46c5-811a-14dd1cd14bf1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:45.886978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:45.887464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:45.887916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:45.888618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:45.889066 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:45.889489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:45.904458 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 HTTP/1.1 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '94201113-9831-46c5-811a-14dd1cd14bf1'} Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:45.906140 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance 94201113-9831-46c5-811a-14dd1cd14bf1 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c84cd7a-a014-44b8-b050-5ef2daa89a89 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1" status: 404 len: 111 microversion: 2.1 time: 0.032751 Sep 14 10:32:45.910956 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2163/6441] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:45 2022] GET /compute/v2.1/servers/94201113-9831-46c5-811a-14dd1cd14bf1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:32:45.919102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0258931-eff3-44c5-a1c0-137aec7713f9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '.version_select at 0x7f693e143b80>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:45.941928 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0258931-eff3-44c5-a1c0-137aec7713f9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-252746507" status: 202 len: 0 microversion: 2.1 time: 0.027352 Sep 14 10:32:45.942536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4279/6442] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-252746507 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:32:45.960851 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6612ac5d-aab5-4543-9e5b-da91b2240ace tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: .version_select at 0x7f693f735700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-735792607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvzydi+ZoTS77K9J5i79yN3J+KmkTw1kc4qM/+Km/vTd1qb6LkOibsr1l9/AshJn0Qw9xKQqnSVWI6rRtVR80rppJP2mCxoFzIn1/wb1t9bl0vEUmwGfL3wXR23ubeNTA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:45.977478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6612ac5d-aab5-4543-9e5b-da91b2240ace tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:32:45.984708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-6612ac5d-aab5-4543-9e5b-da91b2240ace tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:32:46.011655 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6612ac5d-aab5-4543-9e5b-da91b2240ace tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054363 Sep 14 10:32:46.012791 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2164/6443] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:32:45 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:46.065024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-190932059", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-735792607", "networks": [{"uuid": "c3420c22-ab55-4bdf-a0bf-78858fd9b08a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:46.120648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] validate_networks() for [('c3420c22-ab55-4bdf-a0bf-78858fd9b08a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:32:46.505844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:32:46.506280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:32:46.506765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:32:46.507187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:32:46.507613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:32:46.516607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:46.517104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:46.517577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:46.518317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:46.518780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:46.519214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:46.536809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:32:46.542575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:32:46.554840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:32:46.557209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:32:46.604860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90689108-7cc1-46c5-a560-9e0cf15dfd8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543194 Sep 14 10:32:46.605520 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4280/6444] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:32:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:32:46.616611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cccd6a35-9596-4463-92a1-53eee4b3ffb1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:46.617213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cccd6a35-9596-4463-92a1-53eee4b3ffb1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:46.672167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cccd6a35-9596-4463-92a1-53eee4b3ffb1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:46.679457 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cccd6a35-9596-4463-92a1-53eee4b3ffb1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1261 microversion: 2.1 time: 0.066669 Sep 14 10:32:46.680080 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2165/6445] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:46 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1261 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:47.704856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:47.706214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:47.713197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:47.713698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:47.714189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:47.714953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:47.715417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:47.715884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:47.782889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:47.791759 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b09182c-d4da-40f5-8308-44c287080055 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1313 microversion: 2.1 time: 0.092396 Sep 14 10:32:47.793043 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4281/6446] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:47 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1313 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:48.814615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:48.815223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:48.822180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:48.822728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:48.823173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:48.823975 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:48.824436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:48.824864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:49.083579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:49.092027 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-75a00f13-6a85-42d7-ae75-425d443076f3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.281223 Sep 14 10:32:49.092857 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2166/6447] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:48 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:49.264215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9fdc400-3d61-47f8-97d0-d4b2d2f583e5", "tag": "009c3167-0a11-46e8-9659-3eff1f8f0f4f"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:49.278323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:49.279021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:49.279479 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:49.296642 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] Creating event network-changed:009c3167-0a11-46e8-9659-3eff1f8f0f4f for instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 on n-h2-851028-12 Sep 14 10:32:49.301698 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1c6c24a2-3ba9-493d-8547-fbd5955be1ef req-550c460f-418b-4a41-af44-ce2ef52b0dec service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041757 Sep 14 10:32:49.302563 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4282/6448] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:50.115990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:50.116585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:50.124182 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:50.124663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:50.125091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:50.125773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:50.126221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:50.126640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:50.261227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:50.269343 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-265f16ee-507e-4eb2-aea5-9540fc814eec tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.157433 Sep 14 10:32:50.269934 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2167/6449] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:50 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:51.292990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:51.294166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:51.301267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:51.301769 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:51.302223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:51.302940 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:51.303417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:51.303861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:51.438386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:51.446213 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-633fe651-19c7-47fa-970a-cf249c641c21 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.157596 Sep 14 10:32:51.446791 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4283/6450] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:51 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:52.471370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:52.472205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:52.479722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:52.480940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:52.481335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:52.482056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:52.482519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:52.482953 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:52.616338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:52.624221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-271a04dc-419b-48af-bcf3-5a19d826eebd tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.157631 Sep 14 10:32:52.625125 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2168/6451] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:52 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:53.647721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:53.648378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:53.655697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:53.656263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:53.656702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:53.657420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:53.657888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:53.658330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:53.838394 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:53.853280 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-502445d3-b290-430b-b07c-e43697c32a4d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.209702 Sep 14 10:32:53.854100 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4284/6452] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:53 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:54.677583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fdc400-3d61-47f8-97d0-d4b2d2f583e5", "name": "network-vif-plugged", "status": "completed", "tag": "009c3167-0a11-46e8-9659-3eff1f8f0f4f"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:54.689970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:54.690462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:54.690903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:54.702584 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] Creating event network-vif-plugged:009c3167-0a11-46e8-9659-3eff1f8f0f4f for instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 on n-h2-851028-12 Sep 14 10:32:54.707675 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1752df1f-7477-4d65-9b54-ae732aa71a4a req-b005a268-94f1-4757-9b68-cdf2eca000a9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Sep 14 10:32:54.708479 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2169/6453] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:32:54.880931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:54.881565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:54.889183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:54.889683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:54.890130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:54.890843 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:54.891315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:54.891758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:55.024519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:55.032626 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e62bdd39-0d5f-473a-8c38-6b119d15f9df tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1361 microversion: 2.1 time: 0.155570 Sep 14 10:32:55.033213 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4285/6454] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:54 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:56.055889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:56.056617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:56.063943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:56.064514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:56.064954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:56.065656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:56.066112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:56.066544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:56.528073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:56.535734 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3ef35fc1-1173-4c30-b5c7-01819b8b0a0b tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1553 microversion: 2.1 time: 0.484128 Sep 14 10:32:56.536342 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2170/6455] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:56 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1553 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:56.558738 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:32:56.559366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:56.562219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:56.562897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:56.568504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:56.569001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:56.569448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:56.570151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:56.570616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:56.571055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:56.702217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:32:56.710055 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2756b5d6-f176-43ef-831a-6a4855152574 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1553 microversion: 2.1 time: 0.155787 Sep 14 10:32:56.710641 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4286/6456] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:32:56 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:32:58.222815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45eabacb-e134-47a1-b6fc-84ad6a63d652"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:32:58.225192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:32:58.227436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:32:58.234198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:58.234782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:58.235228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:58.235956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:32:58.236447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:32:58.236902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:32:58.475055 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06e4ca90-83d5-4d86-8cb0-47d19a96ae5d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255958 Sep 14 10:32:58.475734 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2171/6457] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:32:58 2022] POST /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:09.202957 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:09.203564 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:09.206667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:09.207484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:09.213441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:09.213938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:09.214384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:09.215094 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:09.216101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:09.216541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:09.301429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'services' on Instance uuid e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:33:09.376050 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b5d45a9-c885-4927-817d-9920d6724c67 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments/45eabacb-e134-47a1-b6fc-84ad6a63d652" status: 202 len: 0 microversion: 2.1 time: 0.176946 Sep 14 10:33:09.376867 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4287/6458] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:33:09 2022] DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments/45eabacb-e134-47a1-b6fc-84ad6a63d652 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:33:09.384176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:09.385085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:09.390213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:09.392820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:09.402193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:09.402749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:09.403836 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:09.404637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:09.405099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:09.405531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:09.444570 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-49fb608d-b3a2-4997-a40a-e06db4a385d1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063122 Sep 14 10:33:09.445195 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2172/6459] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:09 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:33:10.458016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:10.460361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:10.468558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:10.469063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:10.470028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:10.470384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:10.470893 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:10.471417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:10.505915 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3024c148-02f0-44b9-b26a-2f9e0bf8cdba tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052277 Sep 14 10:33:10.506500 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4288/6460] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:10 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:11.519606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:11.521854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:11.529926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:11.530075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:11.530399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:11.531097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:11.531631 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:11.532089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:11.563940 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f8944bf7-5c46-48ef-81f7-8ed60b7e3640 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048425 Sep 14 10:33:11.564777 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2173/6461] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:11 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:12.579674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:12.581882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:12.588793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:12.589290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:12.589745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:12.591040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:12.591529 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:12.592163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:12.628390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c47bbd63-9e02-45f9-a770-a7e335e76202 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053549 Sep 14 10:33:12.628984 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4289/6462] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:12 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:13.641602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:13.643768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:13.650664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:13.651151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:13.651583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:13.652298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:13.652746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:13.653209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:13.683965 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2da2e63c-6512-4b5b-8d70-4f8ec77c98c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046998 Sep 14 10:33:13.685160 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2174/6463] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:13 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:14.698107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:14.704745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:14.708505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:14.709011 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:14.709575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:14.710300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:14.710774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:14.711218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:14.746128 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6dda2ff8-fb42-4134-9a52-9512550a03c4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052122 Sep 14 10:33:14.746712 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4290/6464] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:14 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:33:14.757552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:14.758116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:14.765795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:14.766283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:14.766738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:14.767419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:14.767874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:14.768324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:14.845310 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 is not attached to volume 45eabacb-e134-47a1-b6fc-84ad6a63d652 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments/45eabacb-e134-47a1-b6fc-84ad6a63d652 HTTP/1.1 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 is not attached to volume 45eabacb-e134-47a1-b6fc-84ad6a63d652 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': 'e9fdc400-3d61-47f8-97d0-d4b2d2f583e5', 'id': '45eabacb-e134-47a1-b6fc-84ad6a63d652'} Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 45eabacb-e134-47a1-b6fc-84ad6a63d652. Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 is not attached to volume 45eabacb-e134-47a1-b6fc-84ad6a63d652 Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:14.846963 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 is not attached to volume 45eabacb-e134-47a1-b6fc-84ad6a63d652 Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 is not attached to volume 45eabacb-e134-47a1-b6fc-84ad6a63d652 {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab29326b-73e5-402a-8adc-48fa46069c37 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments/45eabacb-e134-47a1-b6fc-84ad6a63d652" status: 404 len: 154 microversion: 2.1 time: 0.094981 Sep 14 10:33:14.852242 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2175/6465] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:33:14 2022] DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5/os-volume_attachments/45eabacb-e134-47a1-b6fc-84ad6a63d652 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:33:18.218516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:18.219194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:18.225609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:18.226119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:18.226580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:18.227567 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:18.228078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:18.228526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:18.254958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:33:18.336985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be04ff93-092e-43ca-bfc2-7f1ac660311a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 204 len: 0 microversion: 2.1 time: 0.123013 Sep 14 10:33:18.337964 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4291/6466] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:33:18 2022] DELETE /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:33:18.348453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:18.349279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:18.356279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:18.356835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:18.357437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:18.358194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:18.358733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:18.359254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:18.508677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:18.518372 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2ae8f870-47bf-4f69-a12d-a79ba9b2969d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1559 microversion: 2.1 time: 0.173735 Sep 14 10:33:18.519628 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2176/6467] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:18 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:19.543369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:19.544193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:19.551356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:19.551912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:19.552369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:19.553119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:19.553599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:19.554048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:19.695128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:19.704153 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8eef8fd9-1b1f-4ddc-90aa-cc07c1fa7e72 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1559 microversion: 2.1 time: 0.164971 Sep 14 10:33:19.704745 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4292/6468] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:19 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:20.496144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9fdc400-3d61-47f8-97d0-d4b2d2f583e5", "name": "network-vif-deleted", "tag": "009c3167-0a11-46e8-9659-3eff1f8f0f4f"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:20.510272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:20.510763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:20.511725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:20.525583 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] Creating event network-vif-deleted:009c3167-0a11-46e8-9659-3eff1f8f0f4f for instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 on n-h2-851028-12 Sep 14 10:33:20.532971 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-293320c8-1fa4-4dcd-82fc-4a434b2a5c1d req-2c65acfe-febc-4f4b-ad25-d8b483c03a41 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040495 Sep 14 10:33:20.533784 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2177/6469] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:20.726858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:20.727693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:20.735086 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:20.735575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:20.736091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:20.736751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:20.737215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:20.737649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:20.770025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:20.770518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:20.770960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:20.771415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'fault' on Instance uuid e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:33:20.813343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:20.821110 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac98c900-3970-44aa-8344-09045f25bdf3 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 200 len: 1351 microversion: 2.1 time: 0.098195 Sep 14 10:33:20.821686 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4293/6470] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:20 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:21.845698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:21.846426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: e9fdc400-3d61-47f8-97d0-d4b2d2f583e5] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:21.853673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:21.854149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:21.854577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:21.855260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:21.855710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:21.856249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:21.871876 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 HTTP/1.1 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'e9fdc400-3d61-47f8-97d0-d4b2d2f583e5'} Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:21.873615 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b13f14a5-eb12-41bd-a352-f26423078ab7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5" status: 404 len: 111 microversion: 2.1 time: 0.034188 Sep 14 10:33:21.878189 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2178/6471] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:21 2022] GET /compute/v2.1/servers/e9fdc400-3d61-47f8-97d0-d4b2d2f583e5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:33:21.884194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-be23a21b-4b4b-472d-a056-3bb744f2196c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '.version_select at 0x7f693e99d940>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:21.905510 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-be23a21b-4b4b-472d-a056-3bb744f2196c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-735792607" status: 202 len: 0 microversion: 2.1 time: 0.025068 Sep 14 10:33:21.906108 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4294/6472] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:33:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-735792607 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:33:21.924368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3e590988-00e2-4744-a137-b2c4f3bbb2e4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: .version_select at 0x7f693f741700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-849230733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG419ndMyHy0AyCfZoDMtJZt5GuG6BM7zQm5WpjftW+3R5ZwmJgtUZqEIKZth6mb5vFqcFld+/9n0YSmXvWzUN1+hrdMwAoRvhI+VSmTHPYNSRmlvPPlEI6LTWZ15eszTw=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:21.940705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3e590988-00e2-4744-a137-b2c4f3bbb2e4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:33:21.946718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-3e590988-00e2-4744-a137-b2c4f3bbb2e4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:33:21.971386 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3e590988-00e2-4744-a137-b2c4f3bbb2e4 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050873 Sep 14 10:33:21.972016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2179/6473] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:33:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:22.022501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1311121179", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-849230733", "networks": [{"uuid": "c3420c22-ab55-4bdf-a0bf-78858fd9b08a"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:22.088710 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] validate_networks() for [('c3420c22-ab55-4bdf-a0bf-78858fd9b08a', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:33:22.470666 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:33:22.471114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:33:22.471637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:33:22.472141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:33:22.472638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:33:22.481834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:22.482335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:22.482791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:22.483539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:22.484037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:22.484495 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:22.515703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:33:22.521034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Getting quotas for user 4fb7d11e87384b6ba295829bd0e4a88f and project 0c64d730b928407594c423571277cefa. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:33:22.533521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:33:22.535876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:33:22.584297 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a07915d3-aec4-4462-94cb-54d5f486157f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565673 Sep 14 10:33:22.585292 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4295/6474] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:33:22.596359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0e333b9e-0bcd-4963-b9d0-ddfedd54296e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:22.596958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0e333b9e-0bcd-4963-b9d0-ddfedd54296e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:22.654427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0e333b9e-0bcd-4963-b9d0-ddfedd54296e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:22.662559 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0e333b9e-0bcd-4963-b9d0-ddfedd54296e tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1262 microversion: 2.1 time: 0.070004 Sep 14 10:33:22.663181 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2180/6475] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:22 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:23.688797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:23.690078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:23.696220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:23.697002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:23.697672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:23.698463 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:23.698999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:23.699502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:23.770220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:23.779071 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0bdd3ebc-188b-4269-a31b-b01028654126 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1322 microversion: 2.1 time: 0.096104 Sep 14 10:33:23.780076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4296/6476] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:23 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1322 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:24.802707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:24.803397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:24.810713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:24.811205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:24.811640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:24.812480 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:24.812941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:24.813376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:25.049839 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:25.058287 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da72213a-25eb-4587-9e46-ec74c4413724 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.259389 Sep 14 10:33:25.059080 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2181/6477] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:24 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:25.137042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49de84f-4222-4f52-ba30-da21a44d2cbb", "tag": "6da4fa13-8b1c-4021-be17-a2b9d2e28561"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:25.151417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:25.151946 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:25.152408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:25.167018 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] Creating event network-changed:6da4fa13-8b1c-4021-be17-a2b9d2e28561 for instance b49de84f-4222-4f52-ba30-da21a44d2cbb on n-h2-851028-12 Sep 14 10:33:25.176120 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a06f1c9a-6ff0-46ef-8523-152d07338b12 req-5f41abac-e825-44f4-8b74-88cda041486b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042554 Sep 14 10:33:25.176822 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4297/6478] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:26.081529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:26.082136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:26.088951 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:26.089434 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:26.090053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:26.090871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:26.091400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:26.091835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:26.228562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:26.237340 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2ee1330a-75aa-4328-abbe-44737e1b3eab tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.159721 Sep 14 10:33:26.237925 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2182/6479] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:26 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:27.262137 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:27.263239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:27.270262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:27.270757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:27.271206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:27.271948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:27.272423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:27.272866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:27.410288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:27.418048 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44f7ba1f-4b71-4255-a155-eecfcb10a264 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.161029 Sep 14 10:33:27.418692 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4298/6480] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:27 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:28.443317 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:28.443973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:28.453700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:28.454192 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:28.454638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:28.455329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:28.455784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:28.456241 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:28.598783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:28.607058 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-32351b4f-3c31-42d0-96c4-8ffc1f3b6e8d tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.168460 Sep 14 10:33:28.607632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2183/6481] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:28 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:29.630918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:29.631538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:29.639665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:29.640187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:29.641245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:29.642187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:29.642712 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:29.643161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:29.775341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:29.784667 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cc30b77e-1481-45b4-be24-e0b2aa022cb0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.157869 Sep 14 10:33:29.785242 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4299/6482] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:29 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:30.793154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49de84f-4222-4f52-ba30-da21a44d2cbb", "name": "network-vif-plugged", "status": "completed", "tag": "6da4fa13-8b1c-4021-be17-a2b9d2e28561"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:30.805270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:30.805752 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:30.806184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:30.810891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:30.811629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:30.818575 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] Creating event network-vif-plugged:6da4fa13-8b1c-4021-be17-a2b9d2e28561 for instance b49de84f-4222-4f52-ba30-da21a44d2cbb on n-h2-851028-12 Sep 14 10:33:30.819017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:30.819601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:30.820217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:30.821019 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:30.822364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:30.822895 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:30.823563 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-97b12386-9b4f-44b4-a831-dd8e62cf63b4 req-08168597-066d-4a18-ae9d-f0a9b5d99b03 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Sep 14 10:33:30.824266 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2184/6483] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:30.969575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:30.977674 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e3bc39c4-8869-4ddc-983e-36c482aa60cf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1362 microversion: 2.1 time: 0.172565 Sep 14 10:33:30.978344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4300/6484] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:30 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:32.004728 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:32.005443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:32.011702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:32.013245 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:32.013691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:32.014398 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:32.014853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:32.015279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:32.162246 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:32.171072 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8ae03098-da33-4e2e-94d5-c940391da41f tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1555 microversion: 2.1 time: 0.173199 Sep 14 10:33:32.171655 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2185/6485] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:31 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:32.193908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:32.194656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:32.202573 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:32.203279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:32.203735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:32.204480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:32.204942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:32.205380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:32.341721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:32.349590 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-44c326dc-639d-474b-9b86-b60addf539d5 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1555 microversion: 2.1 time: 0.159618 Sep 14 10:33:32.350184 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4301/6486] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:32 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:33.879088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9227deef-7469-4501-9757-3685e5a66dc6"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:33.881456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:33.883446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:33.890061 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:33.890594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:33.891029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:33.891713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:33.892184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:33.892603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:34.144386 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c134268e-5180-470b-8af9-2d5ad7398edf tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "POST /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269082 Sep 14 10:33:34.150978 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2186/6487] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:33:33 2022] POST /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:44.872606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:44.873158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:44.876235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:44.877006 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:44.878660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:44.879386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:44.884648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:44.885155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:44.885612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:44.886329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:44.886803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:44.887250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:44.980383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'services' on Instance uuid b49de84f-4222-4f52-ba30-da21a44d2cbb {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:33:45.050960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-79e5d2c0-a5d9-4e9a-ad38-c1bfe6781eaa tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments/9227deef-7469-4501-9757-3685e5a66dc6" status: 202 len: 0 microversion: 2.1 time: 0.182226 Sep 14 10:33:45.051578 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4302/6488] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:33:44 2022] DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments/9227deef-7469-4501-9757-3685e5a66dc6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:33:45.061314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:45.063724 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:45.066309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:45.067047 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:33:45.073459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:45.073977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:45.074405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:45.075834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:45.076484 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:45.076915 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:45.109643 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c1bc2599-a6ee-464b-aade-ec5b60fd8bd7 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053496 Sep 14 10:33:45.110278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2187/6489] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:45 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:46.123112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:46.125568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:46.132876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:46.133387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:46.133846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:46.134576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:46.135049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:46.135494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:46.171335 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e9fa2ff5-ac3b-4d3d-bc1c-d56320909926 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052568 Sep 14 10:33:46.172179 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4303/6490] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:46 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:47.184098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:47.186923 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:47.193976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:47.194458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:47.194890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:47.195587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:47.196261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:47.196481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:47.229899 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7f5021cb-738b-4931-abae-c3fcc59b1af1 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049726 Sep 14 10:33:47.230384 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2188/6491] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:47 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:48.243198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:48.245599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:48.252432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:48.252979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:48.253566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:48.254326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:48.254793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:48.255262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:48.287025 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-94a4919d-2d1e-4199-a5c8-2f22616b69e0 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Sep 14 10:33:48.287617 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4304/6492] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:48 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:49.299428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:49.301676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:49.308522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:49.309004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:49.310094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:49.310807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:49.311261 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:49.311681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:49.343724 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-200a2672-77a6-4b9c-a12f-2ff40698da05 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048189 Sep 14 10:33:49.344339 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2189/6493] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:49 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:33:50.356189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:50.358388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:50.365235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:50.365732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:50.366177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:50.366871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:50.367336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:50.367764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:50.398459 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8551d4d1-4c8f-4e58-813e-82a976efa546 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046533 Sep 14 10:33:50.399025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4305/6494] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:33:50 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:33:50.410979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:50.411555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:50.420515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:50.421036 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:50.421473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:50.422277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:50.422674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:50.423098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:50.501415 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb is not attached to volume 9227deef-7469-4501-9757-3685e5a66dc6 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments/9227deef-7469-4501-9757-3685e5a66dc6 HTTP/1.1 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb is not attached to volume 9227deef-7469-4501-9757-3685e5a66dc6 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': 'b49de84f-4222-4f52-ba30-da21a44d2cbb', 'id': '9227deef-7469-4501-9757-3685e5a66dc6'} Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9227deef-7469-4501-9757-3685e5a66dc6. Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb is not attached to volume 9227deef-7469-4501-9757-3685e5a66dc6 Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:50.503031 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb is not attached to volume 9227deef-7469-4501-9757-3685e5a66dc6 Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb is not attached to volume 9227deef-7469-4501-9757-3685e5a66dc6 {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ffd909c0-b06c-4bf4-8991-e5025bda0d2c tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments/9227deef-7469-4501-9757-3685e5a66dc6" status: 404 len: 154 microversion: 2.1 time: 0.098657 Sep 14 10:33:50.507725 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2190/6495] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:33:50 2022] DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb/os-volume_attachments/9227deef-7469-4501-9757-3685e5a66dc6 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:33:53.865162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:53.865764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:53.872916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:53.873492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:53.874014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:53.874791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:53.875324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:53.875830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:53.902714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:33:53.988678 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-24197c19-fc74-4f02-900a-fe4f2f11cfbe tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 204 len: 0 microversion: 2.1 time: 0.127070 Sep 14 10:33:53.989337 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4306/6496] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:33:53 2022] DELETE /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:33:53.999273 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:54.000573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:54.007341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:54.007830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:54.008289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:54.008982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:54.009609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:54.010056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:54.171642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:54.179627 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80e826da-067d-4bfa-8e08-1adae06007c9 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1561 microversion: 2.1 time: 0.185293 Sep 14 10:33:54.180234 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2191/6497] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:53 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:55.204862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:55.205609 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:55.212856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:55.213349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:55.213796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:55.214526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:55.214986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:55.215421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:55.348934 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:55.358018 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-762504e9-85da-4185-a1b6-e21cc0cafd58 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1561 microversion: 2.1 time: 0.157330 Sep 14 10:33:55.358620 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4307/6498] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:55 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:56.155365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49de84f-4222-4f52-ba30-da21a44d2cbb", "name": "network-vif-deleted", "tag": "6da4fa13-8b1c-4021-be17-a2b9d2e28561"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:33:56.171674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:56.172442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:56.179206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:56.193881 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] Creating event network-vif-deleted:6da4fa13-8b1c-4021-be17-a2b9d2e28561 for instance b49de84f-4222-4f52-ba30-da21a44d2cbb on n-h2-851028-12 Sep 14 10:33:56.201090 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8464f812-877a-4897-854f-9f839d0097dd req-b4698101-3576-4bc2-8333-5ce4267d8d0f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049931 Sep 14 10:33:56.201829 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2192/6499] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:33:56.382190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:56.382913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:56.390801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:56.391447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:56.391983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:56.392736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:56.393199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:56.393638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:56.428366 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:56.428904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:56.429422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:56.429897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lazy-loading 'fault' on Instance uuid b49de84f-4222-4f52-ba30-da21a44d2cbb {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:33:56.480596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb7d11e87384b6ba295829bd0e4a88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64d730b928407594c423571277cefa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:33:56.488649 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-76b0a9e5-143c-4c47-92db-8231b740cbb2 tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 200 len: 1352 microversion: 2.1 time: 0.110326 Sep 14 10:33:56.489235 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4308/6500] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:56 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:33:57.514561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:57.515252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] [instance: b49de84f-4222-4f52-ba30-da21a44d2cbb] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:33:57.521565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:57.522052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:57.522490 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:57.523211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:33:57.523735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:33:57.524255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:33:57.538648 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] HTTP exception thrown: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Request method failure captured: Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb HTTP/1.1 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa2k2dlI5FwYXgfj_6vTc8IUkWtRss7Eu2gCcqXHmEM1QRuuPdyD9HXTNKJGnHY3HbGl8FGHHyQmxLgpoxYOdGPR0K_PoM4OS0Q5ffguxGQZKTkWBaBuPRbGPICDWTqIjWcqW9hXulrYNCy_g8wt4tBNRrWay_gZ6TzQ4Pn-83fiZWg Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_0c64d730b928407594c423571277cefa", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/0c64d730b928407594c423571277cefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/0c64d730b928407594c423571277cefa"}]}] Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 0c64d730b928407594c423571277cefa Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1043326092 Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4fb7d11e87384b6ba295829bd0e4a88f Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestEncryptedCinderVolumes-1043326092-project Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'b49de84f-4222-4f52-ba30-da21a44d2cbb'} Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:57.540350 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Returning 404 to user: Instance b49de84f-4222-4f52-ba30-da21a44d2cbb could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a23a44a0-7886-4a19-9730-f1fd8ebfb7ae tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb" status: 404 len: 111 microversion: 2.1 time: 0.032986 Sep 14 10:33:57.546226 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2193/6501] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:33:57 2022] GET /compute/v2.1/servers/b49de84f-4222-4f52-ba30-da21a44d2cbb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:33:57.550827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8bdc0df3-e2f8-4f6a-9336-92f0409dc41a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] Calling method '.version_select at 0x7f693e946d30>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:33:57.571096 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8bdc0df3-e2f8-4f6a-9336-92f0409dc41a tempest-TestEncryptedCinderVolumes-1043326092 tempest-TestEncryptedCinderVolumes-1043326092-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-849230733" status: 202 len: 0 microversion: 2.1 time: 0.024037 Sep 14 10:33:57.571697 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4309/6502] 10.222.0.90 () {58 vars in 1275 bytes} [Wed Sep 14 10:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-849230733 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:34:24.968367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4ab24bed-b883-4418-a3e2-84413d9b9123 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: .version_select at 0x7f69479aeee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-117132544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlbu548uy2o7b+TYBskUnpD7FxvwI22+YXeHT4saWB1MGObUgvwErCRGIBFPSElASci+cCSpRGkivMAAsqahdepBF0CyUtcC1sxAzTJrIz3XoVrgfjnkGp6wqqBboOgag=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:34:24.973899 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=14 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:24.974563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:24.986987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-4ab24bed-b883-4418-a3e2-84413d9b9123 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for project b934e23760b94ae9ad91d4b319300d62. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:34:24.992252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-4ab24bed-b883-4418-a3e2-84413d9b9123 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for user 4a727a33733b4615968bd1bb3534e099 and project b934e23760b94ae9ad91d4b319300d62. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:34:25.017920 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4ab24bed-b883-4418-a3e2-84413d9b9123 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054359 Sep 14 10:34:25.018525 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2194/6503] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:34:24 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:34:25.075531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:25.076492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:25.080774 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-78850066", "imageRef": "e0f2aac1-e60d-47ab-b8eb-ba725f9de59d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-117132544", "networks": [{"uuid": "2b11c003-687b-48d3-95ae-d524bd743305"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:34:25.137819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] validate_networks() for [('2b11c003-687b-48d3-95ae-d524bd743305', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:34:25.622530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:34:25.622969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:34:25.623507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:34:25.623959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:34:25.624385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:34:25.634356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:25.634959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:25.635412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:25.636180 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:25.636649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:25.637219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:25.655829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for project b934e23760b94ae9ad91d4b319300d62. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:34:25.661321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for user 4a727a33733b4615968bd1bb3534e099 and project b934e23760b94ae9ad91d4b319300d62. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:34:25.674290 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:34:25.676556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e0f2aac1-e60d-47ab-b8eb-ba725f9de59d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:34:25.722625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e90ba00b-8bf8-4ce1-be3a-bf7f5135ba75 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649887 Sep 14 10:34:25.723439 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4310/6504] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:34:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:34:25.735832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c84bebc-dd38-4398-9846-bf63b617348e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:25.736479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2c84bebc-dd38-4398-9846-bf63b617348e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:25.796917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2c84bebc-dd38-4398-9846-bf63b617348e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:25.804056 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c84bebc-dd38-4398-9846-bf63b617348e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1256 microversion: 2.1 time: 0.073181 Sep 14 10:34:25.804824 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2195/6505] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:25 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1256 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:26.829703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:26.830545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:26.838173 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:26.838683 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:26.839136 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:26.840103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:26.840577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:26.842629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:26.912541 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:26.920680 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9b3e222f-fa49-44a8-894f-2ba188a887e9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1326 microversion: 2.1 time: 0.097148 Sep 14 10:34:26.921274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4311/6506] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:26 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:27.945444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:27.946004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:27.955610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:27.956413 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:27.956850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:27.957558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:27.958007 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:27.958425 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:28.106363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:28.120367 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cd177cd1-5dfa-48e3-a75e-6a3eb8cf0a50 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.178503 Sep 14 10:34:28.121511 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2196/6507] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:27 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:29.144482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:29.145175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:29.152468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:29.152971 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:29.153427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:29.154150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:29.154622 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:29.155067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:29.324736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:29.333253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4796c553-222c-4e65-beed-0dffe3dbbe3f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.192636 Sep 14 10:34:29.333859 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4312/6508] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:29 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:30.357297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:30.357902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:30.366364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:30.366843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:30.367277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:30.368009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:30.368464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:30.368885 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:30.516796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:30.526311 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-abe350f0-cdb3-47fe-8164-5810ef333c2c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.173147 Sep 14 10:34:30.527264 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2197/6509] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:30 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:31.551353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:31.552158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:31.559492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:31.560029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:31.560476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:31.561193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:31.561655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:31.562092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:31.731118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:31.741059 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-59a44232-f1ff-4182-8800-7820f4628aed tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.194742 Sep 14 10:34:31.741712 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4313/6510] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:31 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:32.782163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:32.782163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:32.788536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:32.789222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:32.789667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:32.790375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:32.790829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:32.791258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:32.968226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:32.973599 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1f4bac1d-9c76-4ff9-a130-8ae55ab56289 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.204384 Sep 14 10:34:32.974591 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2198/6511] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:32 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:34.000504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:34.001870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:34.009603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:34.010112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:34.010616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:34.011310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:34.011780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:34.012282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:34.170480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:34.182714 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-900b20f2-3117-4163-9d09-33df3aac9f9c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.186269 Sep 14 10:34:34.183518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4314/6512] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:33 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:35.206278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:35.207022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:35.214617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:35.215196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:35.215635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:35.216369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:35.216826 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:35.217255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:35.416420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:35.425559 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-afffb9ea-ea08-4be3-a9c6-759f268a407d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.223368 Sep 14 10:34:35.426460 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2199/6513] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:35 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:35.717718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:34:35.727356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:35.729488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:35.737617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:35.738119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:35.738775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:35.754370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] Creating event network-changed:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:34:35.760039 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8515ce83-e892-4a02-aee3-526a9ee28763 req-ac06413c-bc97-45e3-bcf5-d20d55d16a04 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045691 Sep 14 10:34:35.760668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4315/6514] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:34:36.449852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:36.450492 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:36.453103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:36.459738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:36.460248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:36.460678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:36.461366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:36.461814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:36.462231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:36.592340 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:36.608714 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-199fbacf-a97d-4115-94c4-ed9d655b395d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.156441 Sep 14 10:34:36.608714 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2200/6515] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:36 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:37.626771 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:37.627527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:37.634694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:37.635196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:37.635667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:37.636388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:37.636860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:37.637302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:37.777356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:37.786154 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90335f2a-c65e-4d78-826b-039f00bc795d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.164115 Sep 14 10:34:37.786741 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4316/6516] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:37 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:38.809787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:38.810390 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:38.817895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:38.818379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:38.818817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:38.819511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:38.819995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:38.820424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:38.956689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:38.965777 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9f60af17-162d-4a2b-8bf8-b39f121bf97e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.159799 Sep 14 10:34:38.966366 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2201/6517] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:38 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:39.991572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:39.992234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:39.999122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:39.999833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:40.000189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:40.000896 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:40.001359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:40.001792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:40.245048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:40.252747 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6cff0c2d-fa79-4980-b5a9-a73e1ae9f79c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.265357 Sep 14 10:34:40.253332 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4317/6518] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:39 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:41.255089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "name": "network-vif-plugged", "status": "completed", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:34:41.266323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:41.266937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:41.267370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:41.276533 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:41.277169 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:41.279402 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] Creating event network-vif-plugged:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:34:41.285367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:41.285911 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-de3cbbea-4b7f-48d8-8281-0030f7b67a53 req-46ba650e-9e4f-40e6-95fb-bd1757d985c0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034125 Sep 14 10:34:41.286042 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:41.286729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:41.287374 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2202/6519] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:34:41.287505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:41.287915 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:41.288360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:41.452857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:41.460769 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fb7b4310-6121-409f-9149-c8f99c6a209c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.188513 Sep 14 10:34:41.461533 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4318/6520] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:41 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:34:42.485814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:42.486522 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:42.492897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:42.493387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:42.493831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:42.494525 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:42.494980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:42.495409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:42.690318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:42.699756 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a506c0da-070a-46cf-bd40-b8038d1d741c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1356 microversion: 2.1 time: 0.219042 Sep 14 10:34:42.700403 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2203/6521] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:42 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:43.723423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:43.724097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:43.731398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:43.731922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:43.732376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:43.733095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:43.734332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:43.734825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:43.869398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:43.878073 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5f0759c1-dd51-4e83-9abe-a6f5c9dbf410 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1544 microversion: 2.1 time: 0.158594 Sep 14 10:34:43.878650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4319/6522] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:43 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1544 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:43.901175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:43.901789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:43.909239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:43.909725 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:43.910166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:43.910859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:43.911311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:43.911736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:44.043277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:44.051223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3074ee18-edd5-459c-99f3-03a62f0ab860 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1544 microversion: 2.1 time: 0.153879 Sep 14 10:34:44.051800 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2204/6523] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:43 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1544 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:44.072928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:44.078311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:44.079098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Searching by: {'deleted': False, 'project_id': 'b934e23760b94ae9ad91d4b319300d62'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 10:34:44.084575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:44.085074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:44.085526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:44.086270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:44.086743 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:44.087188 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:44.112332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 10:34:44.139114 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-940a09fa-58ba-4b8d-92c4-c51e8a878afd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.069944 Sep 14 10:34:44.140274 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4320/6524] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 10:34:44 2022] GET /compute/v2.1/servers => generated 341 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:34:44.152288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:44.152814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:44.160203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:44.160686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:44.161117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:44.161804 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:44.162249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:44.162666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:44.294135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:44.301935 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc5dc223-6f0f-4993-aef2-46d91ea738ff tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1544 microversion: 2.1 time: 0.153655 Sep 14 10:34:44.302512 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2205/6525] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:44 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1544 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:34:45.859413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c741e7-f172-464d-9d97-2090b64a2aa2"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:34:45.861792 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:45.868717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:45.869224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:45.869680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:45.870391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:45.870863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:45.871306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:46.118722 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0c4ef398-6491-453d-b281-7861ac2857bb tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263721 Sep 14 10:34:46.119397 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4321/6526] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:34:45 2022] POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:34:59.187424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:34:59.188052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:34:59.190263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:59.190930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=56 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:34:59.196532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:59.197021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:59.197462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:59.198156 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:34:59.198612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:34:59.199043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:34:59.336272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:34:59.344659 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb79ea1f-a057-4e8b-97bb-df88301ec2b9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1590 microversion: 2.1 time: 0.162350 Sep 14 10:34:59.345232 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2206/6527] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:34:59 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1590 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:35:01.306883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:35:01.307789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:35:01.308436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:35:01.313702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:35:01.338593 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:01.339026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:01.339468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:01.353716 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] Creating event network-changed:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:35:01.359960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6f908555-c43b-4c63-aba4-f953ceeb5db1 req-b4d2c9c5-b687-4600-82ce-5bb76e30d3d8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054961 Sep 14 10:35:01.361169 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4322/6528] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:35:02.465236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1800374295"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:35:02.465860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:35:02.473380 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:02.473860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:02.474291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:02.475171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:02.475622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:02.476079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:02.603555 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Adding security group 249c51c8-e092-4343-a016-d1a690bdf8d5 to port 9f0db374-54f9-4e42-837a-82de052739bd Sep 14 10:35:02.931314 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d086d09b-f252-4fc2-ac03-5da6c9b549f6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action" status: 202 len: 0 microversion: 2.1 time: 0.469764 Sep 14 10:35:02.932894 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2207/6529] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:35:02 2022] POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:35:02.942131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:35:02.943046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:35:02.950509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:02.951087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:02.951610 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:02.953147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:02.953905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:02.954561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:03.106166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:35:03.115232 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7c11fd79-caef-453f-bfcd-52e8b5d56870 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1755 microversion: 2.1 time: 0.177342 Sep 14 10:35:03.115955 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4323/6530] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:35:02 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:35:03.376384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:35:03.385795 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:35:03.386274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:35:03.386708 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:35:03.398131 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] Creating event network-changed:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:35:03.403169 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1bf718c3-ec3e-4fbc-934b-ad5c9312630a req-593769db-6a79-4e73-8c12-3897b074607d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031197 Sep 14 10:35:03.403848 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2208/6531] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:36:47.215226 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:36:47.216033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:36:47.221158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:36:47.223370 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:36:47.231374 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:47.231871 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:47.232347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:47.233049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:47.233511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:47.233947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:47.308390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7377b1c4-9781-4ca1-9a1b-f95d28dcc443 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action" status: 202 len: 0 microversion: 2.1 time: 0.094948 Sep 14 10:36:47.310474 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4324/6532] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:36:47 2022] POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:36:47.317082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:36:47.318902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:36:47.320068 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:36:47.320218 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:36:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 (ip 10.222.0.90) !!! Sep 14 10:36:47.329653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:36:47.330944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:36:47.342447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:47.342932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:47.343360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:47.344102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:47.344547 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:47.344966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:47.681042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:36:47.689611 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d201ffa7-0206-41cd-98e0-74a6757bca41 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1757 microversion: 2.1 time: 0.375587 Sep 14 10:36:47.690202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2209/6533] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:36:47 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1757 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:36:48.715100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:36:48.715826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:36:48.723301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:48.723803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:48.724285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:48.725629 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:36:48.726104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:36:48.726550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:36:48.878849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:36:48.888137 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5f5cdfa-96a6-46f6-a952-3e152575a1b5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1755 microversion: 2.1 time: 0.177326 Sep 14 10:36:48.888716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4325/6534] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:36:48 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:05.252811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:05.253921 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:05.258249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1800374295"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:05.258805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:05.266005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:05.266483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:05.266912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:05.267593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:05.268085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:05.268503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:05.397392 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Removing security group 249c51c8-e092-4343-a016-d1a690bdf8d5 from port 9f0db374-54f9-4e42-837a-82de052739bd Sep 14 10:38:05.705403 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dcdec958-6e66-401f-a337-af42acd3d2d6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action" status: 202 len: 0 microversion: 2.1 time: 0.454516 Sep 14 10:38:05.709465 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2210/6535] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:38:05 2022] POST /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:38:05.715043 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:05.716752 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:05.801535 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:05.812570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:05.813382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:05.813839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:05.826524 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] Creating event network-changed:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:38:05.832733 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cf1eab64-a4c3-4d83-9d58-60694e265070 req-79fda11b-dfd6-4c45-945f-9e760a966a93 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119438 Sep 14 10:38:05.833598 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4326/6536] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:07.504015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:07.504536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:07.510677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:07.511169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:07.511604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:07.512328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:07.512784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:07.513206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:07.598576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lazy-loading 'services' on Instance uuid 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:38:07.678766 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [a131329f-6fc5-41b3-a330-5ca2acd9e3ab] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:38:07.850040 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:07.861212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:07.861818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:07.862361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:07.874133 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] Creating event network-changed:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:38:07.879541 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-57e14e83-8645-4357-8892-698dddfbc977 req-5097ef40-3a9d-424a-87de-f8514e873329 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034814 Sep 14 10:38:07.880406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4327/6537] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:38:08.688038 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [a131329f-6fc5-41b3-a330-5ca2acd9e3ab] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 54558. Sep 14 10:38:08.691310 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ea31799-aa6f-43b2-a9c9-c9fafb8a20a5 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments/81c741e7-f172-464d-9d97-2090b64a2aa2" status: 202 len: 0 microversion: 2.1 time: 1.192951 Sep 14 10:38:08.692000 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2211/6538] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:38:07 2022] DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments/81c741e7-f172-464d-9d97-2090b64a2aa2 => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:38:08.700936 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:08.703930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:08.710600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:08.711133 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:08.711565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:08.712312 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:08.712775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:08.713212 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:08.747567 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f9d4561f-0582-437f-b9a5-d4633521fe3d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050908 Sep 14 10:38:08.748395 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4328/6539] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:08 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:09.762841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:09.765806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:09.772208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:09.772696 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:09.773137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:09.773840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:09.774296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:09.774741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:09.807924 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cad08174-92f4-4092-a43e-eeb111c67de3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050359 Sep 14 10:38:09.808713 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2212/6540] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:09 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:10.820672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:10.822951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:10.830854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:10.831363 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:10.831820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:10.832583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:10.833058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:10.833501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:10.865117 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8851cddf-f5f0-4273-8778-0575e4e989a1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048719 Sep 14 10:38:10.865718 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4329/6541] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:10 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:11.877604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:11.879715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:11.887567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:11.888179 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:11.888627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:11.889858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:11.890386 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:11.890817 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:11.923693 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ec9c2192-0103-4743-9915-cb558de2fee3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050169 Sep 14 10:38:11.924314 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2213/6542] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:11 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:12.937271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:12.939559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:12.946583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:12.947079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:12.947525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:12.948279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:12.948723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:12.949159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:12.980869 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e7272892-fdc3-4193-bd28-bacf96f19e90 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Sep 14 10:38:12.981652 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4330/6543] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:12 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:13.993582 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:13.995835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:14.002908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:14.003408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:14.003845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:14.004564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:14.005019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:14.005443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:14.035086 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ccdd652a-973e-4f95-b39c-f0ece9576e21 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045405 Sep 14 10:38:14.035583 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2214/6544] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:38:13 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 14 10:38:14.047047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:14.047571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:14.054447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:14.054947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:14.055399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:14.056145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:14.056618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:14.057063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:14.132817 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] HTTP exception thrown: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 is not attached to volume 81c741e7-f172-464d-9d97-2090b64a2aa2 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Request method failure captured: Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: request: DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments/81c741e7-f172-464d-9d97-2090b64a2aa2 HTTP/1.1 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa4il47pERHODONDE-XYHe4CRGQcHYWt_CfJmPqI0KDBwfeNsLJs1yrev_5ak1IRDuU3ZFfZq3Zliq-va8h_1-njQh7b7tIbqQdTeRtBZ4GaV0gj9zzwMd--mN7jeegmTTbkRiAYrOPLNAuR4OPO9eZhEdW5oEZZJiI12Y1Cfq-yuZk Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b934e23760b94ae9ad91d4b319300d62", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b934e23760b94ae9ad91d4b319300d62"}]}] Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4a727a33733b4615968bd1bb3534e099 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 is not attached to volume 81c741e7-f172-464d-9d97-2090b64a2aa2 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'server_id': '0bf0d54c-36ca-4a90-8b18-c9eca11025f1', 'id': '81c741e7-f172-464d-9d97-2090b64a2aa2'} Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 81c741e7-f172-464d-9d97-2090b64a2aa2. Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 is not attached to volume 81c741e7-f172-464d-9d97-2090b64a2aa2 Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:38:14.134878 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 is not attached to volume 81c741e7-f172-464d-9d97-2090b64a2aa2 Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Returning 404 to user: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 is not attached to volume 81c741e7-f172-464d-9d97-2090b64a2aa2 {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a66e00b9-8a7b-4cce-86ed-c66adc1ae7ba tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments/81c741e7-f172-464d-9d97-2090b64a2aa2" status: 404 len: 154 microversion: 2.1 time: 0.094109 Sep 14 10:38:14.145049 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4331/6545] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:38:14 2022] DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1/os-volume_attachments/81c741e7-f172-464d-9d97-2090b64a2aa2 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:38:17.444636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:17.445233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:17.451574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:17.452453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:17.452974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:17.453789 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:17.454256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:17.454685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:17.483468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:38:17.570221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2f2085f8-b0ef-46c2-8c15-fa733b893552 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 204 len: 0 microversion: 2.1 time: 0.129421 Sep 14 10:38:17.570824 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2215/6546] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:38:17 2022] DELETE /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:38:17.583730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:17.584384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:17.591068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:17.591576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:17.592058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:17.593302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:17.593784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:17.594225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:17.741732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:17.750155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5385395-32b9-4019-872f-af8dc264a048 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1550 microversion: 2.1 time: 0.170624 Sep 14 10:38:17.750763 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4332/6547] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:17 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1550 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:18.775456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:18.776194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:18.784499 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:18.784995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:18.785459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:18.786157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:18.786612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:18.787041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:18.919520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:18.928091 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8e47e832-ac34-47b3-8171-fdaa01b2afa1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1550 microversion: 2.1 time: 0.156898 Sep 14 10:38:18.928676 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2216/6548] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:18 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:19.666800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf0d54c-36ca-4a90-8b18-c9eca11025f1", "name": "network-vif-deleted", "tag": "9f0db374-54f9-4e42-837a-82de052739bd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:19.679287 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:19.679866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:19.680736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:19.696448 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] Creating event network-vif-deleted:9f0db374-54f9-4e42-837a-82de052739bd for instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 on n-h2-851028-12 Sep 14 10:38:19.702305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-f53cc712-b856-449c-8cbf-d33d0de1415a req-da46b2c9-e502-4024-84ab-ce142c22285f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039430 Sep 14 10:38:19.703236 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4333/6549] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:19.953632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:19.954457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:19.962627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:19.963125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:19.964332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:19.965277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:19.965907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:19.966334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:20.007207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:20.008220 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:20.008679 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:20.009140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lazy-loading 'fault' on Instance uuid 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:38:20.058238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:20.068101 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e91364f0-42d7-482e-982a-5c13e230dd6d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 200 len: 1346 microversion: 2.1 time: 0.119087 Sep 14 10:38:20.069227 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2217/6550] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:19 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:21.095001 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:21.095721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 0bf0d54c-36ca-4a90-8b18-c9eca11025f1] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:21.102125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:21.102670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:21.103150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:21.103865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:21.104624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:21.105068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:21.119016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] HTTP exception thrown: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Request method failure captured: Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 HTTP/1.1 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa4il47pERHODONDE-XYHe4CRGQcHYWt_CfJmPqI0KDBwfeNsLJs1yrev_5ak1IRDuU3ZFfZq3Zliq-va8h_1-njQh7b7tIbqQdTeRtBZ4GaV0gj9zzwMd--mN7jeegmTTbkRiAYrOPLNAuR4OPO9eZhEdW5oEZZJiI12Y1Cfq-yuZk Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b934e23760b94ae9ad91d4b319300d62", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b934e23760b94ae9ad91d4b319300d62"}]}] Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: 4a727a33733b4615968bd1bb3534e099 Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '0bf0d54c-36ca-4a90-8b18-c9eca11025f1'} Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:38:21.120703 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Returning 404 to user: Instance 0bf0d54c-36ca-4a90-8b18-c9eca11025f1 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20f1a9bc-f0bf-4928-a90d-d6e295d12398 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1" status: 404 len: 111 microversion: 2.1 time: 0.032389 Sep 14 10:38:21.125456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4334/6551] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:21 2022] GET /compute/v2.1/servers/0bf0d54c-36ca-4a90-8b18-c9eca11025f1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:38:21.131814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-89ad4e4e-b507-4233-8cfc-216f393f032d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '.version_select at 0x7f693f880e50>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:21.136378 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89ad4e4e-b507-4233-8cfc-216f393f032d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:38:22.143708 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-89ad4e4e-b507-4233-8cfc-216f393f032d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [5fd1200a-d768-46ee-b8d4-741a6d85fc48] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 54602. Sep 14 10:38:22.165975 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-89ad4e4e-b507-4233-8cfc-216f393f032d tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117132544" status: 202 len: 0 microversion: 2.1 time: 1.037843 Sep 14 10:38:22.166571 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2218/6552] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 10:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-117132544 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:38:31.492196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-405e7434-ae4c-4d50-8cdb-4889bd320f51 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: .version_select at 0x7f693e1e3040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-522505853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjaiMuxYAb7bgt+wZ7769G8NBX5cFqYa7WJdD/t4cLWoyW03EeFfsRS2MlmWWKgz9ZrpPBOp07IE4WD/eG6blmSvexWxdLwoNbj9AdGmja86g+3ISTiSmhPVwtL+ApRVQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:31.500829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=18 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:31.501735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=38 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:31.514614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-405e7434-ae4c-4d50-8cdb-4889bd320f51 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for project b934e23760b94ae9ad91d4b319300d62. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:38:31.519737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-405e7434-ae4c-4d50-8cdb-4889bd320f51 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for user 4a727a33733b4615968bd1bb3534e099 and project b934e23760b94ae9ad91d4b319300d62. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:38:31.542941 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-405e7434-ae4c-4d50-8cdb-4889bd320f51 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054715 Sep 14 10:38:31.543549 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4335/6553] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:38:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:31.594155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:31.598447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1011104622", "imageRef": "d72b9723-41de-47fe-b03c-5173e67360b0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-522505853", "networks": [{"uuid": "2b11c003-687b-48d3-95ae-d524bd743305"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:31.653463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] validate_networks() for [('2b11c003-687b-48d3-95ae-d524bd743305', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:38:32.091029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:38:32.091454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:38:32.092498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:38:32.092935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:38:32.093538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:38:32.102744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:32.103270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:32.103713 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:32.104745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:32.105202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:32.105629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:32.123173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for project b934e23760b94ae9ad91d4b319300d62. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:38:32.128551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Getting quotas for user 4a727a33733b4615968bd1bb3534e099 and project b934e23760b94ae9ad91d4b319300d62. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:38:32.141532 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:38:32.143791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d72b9723-41de-47fe-b03c-5173e67360b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:38:32.193515 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-37378439-5113-4425-b194-2e576e21c073 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602049 Sep 14 10:38:32.194485 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2219/6554] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:38:32.206583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a4c9ee37-103e-49a8-a16f-825fe3b70f56 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:32.207488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a4c9ee37-103e-49a8-a16f-825fe3b70f56 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:32.278429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a4c9ee37-103e-49a8-a16f-825fe3b70f56 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:32.293102 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a4c9ee37-103e-49a8-a16f-825fe3b70f56 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1258 microversion: 2.1 time: 0.091581 Sep 14 10:38:32.293690 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4336/6555] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:32 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:33.321763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9ff4589-3b67-436b-8660-8303d425304e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:33.322293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9ff4589-3b67-436b-8660-8303d425304e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:33.381332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9ff4589-3b67-436b-8660-8303d425304e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:33.388288 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9ff4589-3b67-436b-8660-8303d425304e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1258 microversion: 2.1 time: 0.071357 Sep 14 10:38:33.389590 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2220/6556] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:33 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:34.412115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3551ed71-162a-42f6-b60c-4f2906e066a6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:34.412754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3551ed71-162a-42f6-b60c-4f2906e066a6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:34.470948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3551ed71-162a-42f6-b60c-4f2906e066a6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:34.478786 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3551ed71-162a-42f6-b60c-4f2906e066a6 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1258 microversion: 2.1 time: 0.070634 Sep 14 10:38:34.479630 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4337/6557] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:34 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:35.503919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:35.504566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:35.507298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:35.513099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:35.514014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:35.514763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:35.515632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:35.516126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:35.516555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:35.594178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:35.603002 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ea097181-d000-4cb2-921a-ce025739d5d9 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1316 microversion: 2.1 time: 0.103732 Sep 14 10:38:35.603813 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2221/6558] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:35 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:36.627481 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:36.628445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:36.636183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:36.636695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:36.637152 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:36.637918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:36.638583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:36.639840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:36.792833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:36.802338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-338feb0c-d733-4919-9349-9235000f635a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.179391 Sep 14 10:38:36.803191 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4338/6559] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:36 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:37.829417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:37.830029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:37.836909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:37.837394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:37.837825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:37.838520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:37.838969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:37.839394 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:37.998462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:38.007087 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02788f60-af2b-4285-b9c9-c348cd925377 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.183480 Sep 14 10:38:38.007778 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2222/6560] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:37 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:39.031775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:39.032455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:39.039501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:39.040509 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:39.041383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:39.045400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:39.046356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:39.047004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:39.205347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:39.215085 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e4c1be4c-61c8-4205-9006-9ba2bae22378 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.187810 Sep 14 10:38:39.215693 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4339/6561] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:39 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:40.239623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:40.240272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:40.248493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:40.249509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:40.250025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:40.250828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:40.251344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:40.252020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:40.451746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:40.465179 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-97c4f81f-f87a-4155-8b05-46d544a64383 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.229300 Sep 14 10:38:40.466135 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2223/6562] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:40 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:41.489122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:41.489758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:41.509947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:41.510466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:41.510924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:41.511703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:41.512218 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:41.512682 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:41.662421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:41.672418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ecab28cf-69e8-4d76-8958-5f24c49b2b71 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.187271 Sep 14 10:38:41.673202 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4340/6563] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:41 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:42.699153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:42.699801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:42.702529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:42.708587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:42.709076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:42.709509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:42.710200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:42.710649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:42.711077 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:42.847301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:42.856505 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-07ad99be-c590-401e-b249-299ef4826dd1 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.161056 Sep 14 10:38:42.866016 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2224/6564] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:42 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:43.880440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:43.881104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:43.888096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:43.888634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:43.889089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:43.889801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:43.890272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:43.890715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:44.023242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:44.032542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e5bafd6-38ce-4280-b032-ee09bb2b9fc8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.155849 Sep 14 10:38:44.033403 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4341/6565] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:43 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:44.788444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:44.855029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:44.864927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:44.865414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:44.865845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:44.880497 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] Creating event network-changed:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:38:44.885539 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-4ed0ea18-0ba1-49d5-99d1-f66bf41ea146 req-20fe1680-a30f-470b-83ce-7dbec1066872 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102368 Sep 14 10:38:44.886167 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2225/6566] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:45.057250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:45.057885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:45.059817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:38:45.067577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:45.068115 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:45.068577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:45.069298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:45.069770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:45.070211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:45.576960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:45.584860 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac893ca5-d3ea-4033-a275-270e4ab7e36c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.532139 Sep 14 10:38:45.585458 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4342/6567] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:45 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:46.610372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:46.611346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:46.617937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:46.618424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:46.618856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:46.619558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:46.620032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:46.620459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:46.756574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:46.766124 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-21c3fe98-1896-44a0-a8ab-032e28fa45e4 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.160434 Sep 14 10:38:46.766718 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2226/6568] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:46 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:47.789405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:47.790061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:47.797761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:47.798275 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:47.798729 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:47.799447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:47.800177 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:47.800624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:47.938973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:47.946796 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-99971d03-bcab-4ff6-a700-859eef248430 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.161744 Sep 14 10:38:47.947364 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4343/6569] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:47 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:38:48.970988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:48.971624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:48.978479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:48.979231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:48.979663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:48.980377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:48.980821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:48.981237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:49.119157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:49.126977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d3d7b2fe-d3b7-4da7-a574-417260450844 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.160787 Sep 14 10:38:49.127564 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2227/6570] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:48 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:49.885200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "name": "network-vif-plugged", "status": "completed", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:49.895590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:49.896134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:49.896583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:49.908527 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] Creating event network-vif-plugged:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:38:49.913956 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-72c93839-cf64-45a0-ae41-64104c7280fb req-011ffd3b-9263-42cd-86c4-21904e5f3040 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091156 Sep 14 10:38:49.914494 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4344/6571] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:50.150567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:50.151166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:50.158464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:50.158954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:50.159395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:50.160128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:50.160581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:50.161003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:50.292193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:50.300007 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0316c824-71ac-41ff-90ef-279230159109 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1358 microversion: 2.1 time: 0.153262 Sep 14 10:38:50.300587 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2228/6572] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:50 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:51.324179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:51.324905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:51.332167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.332672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.333129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.333875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.334350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.334797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.473268 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:51.481442 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ab938d78-b92b-449b-b1e0-d9a7b8c202fa tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1546 microversion: 2.1 time: 0.162436 Sep 14 10:38:51.482684 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4345/6573] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:51 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:51.504791 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:51.505405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:51.512243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.512727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.513224 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.513965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.514414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.514837 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.648842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:51.656957 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a971d9d-9ab3-440e-bc83-a52d4a2b8b95 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1546 microversion: 2.1 time: 0.155993 Sep 14 10:38:51.657542 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2229/6574] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:51 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:51.679055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:51.684008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:51.684791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Searching by: {'deleted': False, 'project_id': 'b934e23760b94ae9ad91d4b319300d62'} {{(pid=122444) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 14 10:38:51.690845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.691340 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.691787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.692566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.693051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.693472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.717179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.multi_cell_list [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 14 10:38:51.745416 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-649d0ff4-eee1-4e4a-89e2-a2df81b0c62f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070099 Sep 14 10:38:51.746018 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4346/6575] 10.222.0.90 () {58 vars in 1125 bytes} [Wed Sep 14 10:38:51 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:38:51.759021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:38:51.759638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:51.766236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.766842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.767528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.768663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:51.769402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:51.770050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:51.900562 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:38:51.908512 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cb893ca6-b3d7-4eba-ad9c-31ced4ce7e88 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1546 microversion: 2.1 time: 0.153296 Sep 14 10:38:51.909117 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2230/6576] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:38:51 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:38:53.430837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d824747-b60c-4faf-9af8-6c492a486f85"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:38:53.433280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:38:53.440515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:53.441010 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:53.441457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:53.442156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:38:53.442615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:38:53.443047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:38:53.681724 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2c95cf2a-84ce-4813-a677-9afd90bd0b5e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254664 Sep 14 10:38:53.682376 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4347/6577] 10.222.0.90 () {60 vars in 1323 bytes} [Wed Sep 14 10:38:53 2022] POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:39:04.474864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:04.475479 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:04.478550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=19 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:04.479478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=58 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:04.486093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:04.486578 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:04.487013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:04.487702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:04.488176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:04.488597 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:04.629278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:04.638148 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-434efbb7-18ad-4300-966c-4b461cf8c1dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1592 microversion: 2.1 time: 0.166674 Sep 14 10:39:04.639065 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2231/6578] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:04 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1592 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:06.252786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:39:06.258846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:06.259669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:06.260369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:06.267664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:06.268285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:06.268951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:06.283408 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] Creating event network-changed:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:39:06.289379 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3b0ba65b-b734-41bc-a2a4-0da1169bf985 req-bd33aea9-fe3f-4336-9341-02b9f4bcb7fa service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040447 Sep 14 10:39:06.290243 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4348/6579] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:39:07.724416 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-256745032"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:39:07.724954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:07.733119 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:07.733686 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:07.734122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:07.734813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:07.735258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:07.735677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:07.862781 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Adding security group ae8f46e9-6257-4140-bc15-da3dd0c09870 to port bd50cd60-4055-4486-8a82-54ab44c154c1 Sep 14 10:39:08.185403 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf756485-ccf8-470a-ae31-b654771c1b6c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action" status: 202 len: 0 microversion: 2.1 time: 0.464452 Sep 14 10:39:08.187770 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2232/6580] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:39:07 2022] POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:39:08.195377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:08.196153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:08.203839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:08.204373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:08.204819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:08.205532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:08.205991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:08.206421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:08.304368 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:39:08.314496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:08.314987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:08.315424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:08.328190 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] Creating event network-changed:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:39:08.333810 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d460afa2-71d0-48ee-8da2-93a0a9e5b48e req-1a947dd9-56f3-4809-baa8-ffacfb4148c8 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032956 Sep 14 10:39:08.334783 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2233/6581] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:39:08.382337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:08.391782 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-144a4459-d716-4b31-8697-0eeda6c36857 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1757 microversion: 2.1 time: 0.201417 Sep 14 10:39:08.392455 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4349/6582] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:08 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:25.581946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:25.582823 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:25.632821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:39:25.635098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:25.641359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:25.641830 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:25.642295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:25.642985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:25.643422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:25.643841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:25.717221 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fd81a805-22e6-4fde-9c95-787f292d79ae tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action" status: 202 len: 0 microversion: 2.1 time: 0.137043 Sep 14 10:39:25.718786 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2234/6583] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:39:25 2022] POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:39:25.727139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:25.728473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:25.731470 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:25.732333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=8 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:39:25.739089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:25.739568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:25.740062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:25.740785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:25.741350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:25.741776 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:25.984699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:25.992984 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f6733747-e85c-4b1c-baf7-3ad6c676534a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1749 microversion: 2.1 time: 0.269713 Sep 14 10:39:25.993580 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4350/6584] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:25 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1749 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:27.016894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:27.017604 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:27.024662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:27.025151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:27.025590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:27.026285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:27.026744 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:27.027170 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:27.179649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:27.188782 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-703f9bf0-1013-4715-a031-cdd89c20dcbd tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.176168 Sep 14 10:39:27.189357 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2235/6585] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:27 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:28.213155 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:28.213817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:28.221447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:28.221951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:28.222406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:28.223114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:28.223584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:28.224074 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:28.385848 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:28.394267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d59996e5-a84e-4358-832b-2d5255363d42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.185177 Sep 14 10:39:28.394847 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4351/6586] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:28 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:29.419101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:29.419711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:29.427870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:29.428331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:29.428768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:29.429456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:29.429908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:29.430331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:29.575457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:29.584834 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-961c4d32-f4fc-4019-beed-e0c37ba0e056 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.170480 Sep 14 10:39:29.585427 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2236/6587] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:29 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:30.608635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:30.610214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:30.617377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:30.617860 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:30.618305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:30.619002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:30.619464 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:30.619917 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:30.769964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:30.778370 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2070f6be-0c6b-461d-aca8-7a808aca6f3c tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.173583 Sep 14 10:39:30.779133 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4352/6588] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:30 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:31.802553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:31.803205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:31.810130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:31.810615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:31.811062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:31.811753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:31.813035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:31.813252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:31.956315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:31.964748 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1e20fde8-2a63-4784-b3da-67fda5f7dba8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.166018 Sep 14 10:39:31.965362 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2237/6589] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:31 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:32.989959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:32.990612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:32.997730 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:32.998242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:32.998698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:32.999436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:32.999938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:33.000389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:33.155114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:33.164670 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-97d0c01f-0c11-4c88-8f2b-1ad8becbc3d3 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.178668 Sep 14 10:39:33.179769 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4353/6590] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:32 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:34.190987 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:34.191596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:34.198589 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:34.199098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:34.199546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:34.200264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:34.200717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:34.201137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:34.355214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:34.362590 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6c5e6822-e639-48d1-8383-b18203111cc7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.175710 Sep 14 10:39:34.363173 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2238/6591] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:34 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:35.386462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:35.387096 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:35.394969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:35.395472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:35.395949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:35.396664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:35.397146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:35.397637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:35.551690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:35.560204 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29a024ec-7d78-43ab-a76b-6b25d8427537 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.177729 Sep 14 10:39:35.560785 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4354/6592] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:35 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:36.583318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:36.584037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:36.590990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:36.591469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:36.591914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:36.592619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:36.593071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:36.593493 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:36.743807 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:36.752709 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ecf11b7b-f6cc-4869-9a2c-226052bceb10 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1754 microversion: 2.1 time: 0.173330 Sep 14 10:39:36.753289 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2239/6593] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:36 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:39:37.776217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:39:37.776851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:39:37.783988 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:37.784517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:37.784993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:37.785700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:39:37.786162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:39:37.786600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:39:37.929887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:39:37.938878 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5ba74cc2-6ca1-418f-9661-75fa777df2a2 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1757 microversion: 2.1 time: 0.166549 Sep 14 10:39:37.939447 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4355/6594] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:39:37 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:10.227695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-256745032"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:10.228307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:10.230560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=12 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:10.231214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:10.238596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:10.239136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:10.239566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:10.240275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:10.240722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:10.241143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:10.377693 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.network.security_group_api [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Removing security group ae8f46e9-6257-4140-bc15-da3dd0c09870 from port bd50cd60-4055-4486-8a82-54ab44c154c1 Sep 14 10:40:10.698581 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fa13354e-f6f6-49b8-995e-968e1f42d9ec tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action" status: 202 len: 0 microversion: 2.1 time: 0.475149 Sep 14 10:40:10.699202 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2240/6595] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:40:10 2022] POST /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:40:10.730478 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:10.741882 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:10.742835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=36 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:10.748460 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:10.749223 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:10.749838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:10.764369 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] Creating event network-changed:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:40:10.770035 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cda17afb-ec82-44bb-970a-0b7d2c695c9f req-1bd7cddf-b595-44ae-b32f-c55ec085b4ae service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043414 Sep 14 10:40:10.771000 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4356/6596] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:11.832552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:11.833354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:11.840028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:11.840510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:11.840935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:11.841624 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:11.842067 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:11.842481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:11.924916 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lazy-loading 'services' on Instance uuid 66fdfd6d-e3ce-439a-9223-8086bd4d2990 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:40:11.998913 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cbdec2f2-9a2d-498c-b0e0-18d78735af42 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments/4d824747-b60c-4faf-9af8-6c492a486f85" status: 202 len: 0 microversion: 2.1 time: 0.172350 Sep 14 10:40:11.999597 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2241/6597] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:40:11 2022] DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments/4d824747-b60c-4faf-9af8-6c492a486f85 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:40:12.006634 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:40:12.007164 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments (ip 10.222.0.90) !!! Sep 14 10:40:12.013521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:12.015861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:12.025055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:12.025644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:12.026184 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:12.026976 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:12.027592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:12.028058 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:12.066476 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d0b46c7-1209-47bf-852a-6836055f582f tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062020 Sep 14 10:40:12.067075 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4357/6598] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:12 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:12.789339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:12.800546 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:12.801108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:12.801650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:12.814502 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] Creating event network-changed:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:40:12.819926 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-494611fe-f95a-4228-ad47-be15b591a29a req-32e3c0f8-b801-4079-957d-d92c22a4b9de service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034615 Sep 14 10:40:12.823580 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2242/6599] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:13.079941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:13.082294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:13.089467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:13.090071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:13.090589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:13.091386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:13.091958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:13.092466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:13.132121 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1f660fb7-3289-4f98-8a57-35ac70e795f0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056981 Sep 14 10:40:13.137076 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4358/6600] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:13 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:14.146988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:14.149278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:14.156406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:14.158131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:14.158615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:14.164194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:14.164649 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:14.169704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:14.201278 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-92a83a1a-3365-4f47-9f38-2a07f16d140e tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060144 Sep 14 10:40:14.202169 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2243/6601] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:14 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:15.218343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:15.221186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:15.228337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:15.229110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:15.229589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:15.230309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:15.230785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:15.231234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:15.262207 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a5980b85-61a0-4606-8814-4f58bc1483a7 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047893 Sep 14 10:40:15.262790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4359/6602] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:15 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:16.275097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:16.277294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:16.284180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:16.284664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:16.285100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:16.285790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:16.286240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:16.286658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:16.316688 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d6b7086-90c1-46e6-b8db-a55a71624196 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045759 Sep 14 10:40:16.317270 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2244/6603] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:16 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:17.330892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:17.333123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:17.339611 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:17.340158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:17.340621 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:17.341708 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:17.342187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:17.342635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:17.372354 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-26e95b62-c99c-427a-8497-0b784ca39145 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046693 Sep 14 10:40:17.372931 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4360/6604] 10.222.0.90 () {58 vars in 1302 bytes} [Wed Sep 14 10:40:17 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 14 10:40:17.385831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:17.386720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:17.399290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:17.400199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:17.400888 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:17.401905 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:17.402344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:17.402774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:17.479097 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] HTTP exception thrown: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 is not attached to volume 4d824747-b60c-4faf-9af8-6c492a486f85 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Request method failure captured: Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: request: DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments/4d824747-b60c-4faf-9af8-6c492a486f85 HTTP/1.1 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa4il47pERHODONDE-XYHe4CRGQcHYWt_CfJmPqI0KDBwfeNsLJs1yrev_5ak1IRDuU3ZFfZq3Zliq-va8h_1-njQh7b7tIbqQdTeRtBZ4GaV0gj9zzwMd--mN7jeegmTTbkRiAYrOPLNAuR4OPO9eZhEdW5oEZZJiI12Y1Cfq-yuZk Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b934e23760b94ae9ad91d4b319300d62", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b934e23760b94ae9ad91d4b319300d62"}]}] Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4a727a33733b4615968bd1bb3534e099 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 is not attached to volume 4d824747-b60c-4faf-9af8-6c492a486f85 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'server_id': '66fdfd6d-e3ce-439a-9223-8086bd4d2990', 'id': '4d824747-b60c-4faf-9af8-6c492a486f85'} Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4d824747-b60c-4faf-9af8-6c492a486f85. Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 is not attached to volume 4d824747-b60c-4faf-9af8-6c492a486f85 Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:40:17.480714 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 is not attached to volume 4d824747-b60c-4faf-9af8-6c492a486f85 Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Returning 404 to user: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 is not attached to volume 4d824747-b60c-4faf-9af8-6c492a486f85 {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a5e8aeb4-08cc-472c-9a03-a2165eb42cf8 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments/4d824747-b60c-4faf-9af8-6c492a486f85" status: 404 len: 154 microversion: 2.1 time: 0.101606 Sep 14 10:40:17.486144 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2245/6605] 10.222.0.90 () {58 vars in 1416 bytes} [Wed Sep 14 10:40:17 2022] DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990/os-volume_attachments/4d824747-b60c-4faf-9af8-6c492a486f85 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 14 10:40:20.745380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:20.745888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:20.754052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:20.754566 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:20.755014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:20.755736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:20.756244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:20.756686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:20.785167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:40:20.869481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3f41e883-ad91-4a32-afe2-8d3672ee0c19 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 204 len: 0 microversion: 2.1 time: 0.127645 Sep 14 10:40:20.870222 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4361/6606] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:40:20 2022] DELETE /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:40:20.880391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:20.881238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:20.888897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:20.889470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:20.889982 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:20.890751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:20.891406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:20.891929 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:21.032117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:21.040345 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9ccb2eb7-b9fd-433b-9c26-20183e5d615a tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1552 microversion: 2.1 time: 0.165500 Sep 14 10:40:21.040941 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2246/6607] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:20 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:22.066087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:22.066727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:22.073658 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:22.074160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:22.074615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:22.075325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:22.075794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:22.076260 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:22.277979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:22.285998 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c9108500-6a91-4d9d-beba-c9a8f1ba78e0 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1552 microversion: 2.1 time: 0.225140 Sep 14 10:40:22.286595 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4362/6608] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:22 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:23.060665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66fdfd6d-e3ce-439a-9223-8086bd4d2990", "name": "network-vif-deleted", "tag": "bd50cd60-4055-4486-8a82-54ab44c154c1"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:23.075470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:23.076252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:23.076677 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:23.090299 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] Creating event network-vif-deleted:bd50cd60-4055-4486-8a82-54ab44c154c1 for instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 on n-h1-851028-12 Sep 14 10:40:23.095661 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d94e4315-65e4-44f0-a077-874b9b840d41 req-6a02b93c-3049-45de-bf4e-50c2d9a64bcd service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038613 Sep 14 10:40:23.096320 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2247/6609] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:23.309779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:23.310445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:23.318552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:23.319647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:23.320128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:23.320841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:23.321307 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:23.321747 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:23.355955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:23.356461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:23.356907 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:23.357367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lazy-loading 'fault' on Instance uuid 66fdfd6d-e3ce-439a-9223-8086bd4d2990 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:40:23.402195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a727a33733b4615968bd1bb3534e099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b934e23760b94ae9ad91d4b319300d62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:23.410576 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0a3244d0-cd5e-4169-8879-15cfb1e0c129 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 200 len: 1348 microversion: 2.1 time: 0.104684 Sep 14 10:40:23.411348 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4363/6610] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:23 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:24.435848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:24.436501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] [instance: 66fdfd6d-e3ce-439a-9223-8086bd4d2990] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:24.444528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:24.445042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:24.445475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:24.446168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:24.446615 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:24.447057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:24.461278 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] HTTP exception thrown: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Request method failure captured: Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 HTTP/1.1 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa4il47pERHODONDE-XYHe4CRGQcHYWt_CfJmPqI0KDBwfeNsLJs1yrev_5ak1IRDuU3ZFfZq3Zliq-va8h_1-njQh7b7tIbqQdTeRtBZ4GaV0gj9zzwMd--mN7jeegmTTbkRiAYrOPLNAuR4OPO9eZhEdW5oEZZJiI12Y1Cfq-yuZk Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_b934e23760b94ae9ad91d4b319300d62", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/b934e23760b94ae9ad91d4b319300d62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/b934e23760b94ae9ad91d4b319300d62"}]}] Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: b934e23760b94ae9ad91d4b319300d62 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestMinimumBasicScenario-247171932 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 4a727a33733b4615968bd1bb3534e099 Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestMinimumBasicScenario-247171932-project Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '66fdfd6d-e3ce-439a-9223-8086bd4d2990'} Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:40:24.462900 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Returning 404 to user: Instance 66fdfd6d-e3ce-439a-9223-8086bd4d2990 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-22494dfe-6c5b-4bc4-a3c1-a95b205940dc tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990" status: 404 len: 111 microversion: 2.1 time: 0.032886 Sep 14 10:40:24.468164 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2248/6611] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:24 2022] GET /compute/v2.1/servers/66fdfd6d-e3ce-439a-9223-8086bd4d2990 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:40:24.474116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6e80cae9-fbd9-428b-9817-d9ce7bb88175 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] Calling method '.version_select at 0x7f693df5e1f0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:24.495761 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6e80cae9-fbd9-428b-9817-d9ce7bb88175 tempest-TestMinimumBasicScenario-247171932 tempest-TestMinimumBasicScenario-247171932-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-522505853" status: 202 len: 0 microversion: 2.1 time: 0.026345 Sep 14 10:40:24.496465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4364/6612] 10.222.0.90 () {58 vars in 1269 bytes} [Wed Sep 14 10:40:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-522505853 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:40:33.708050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1c945f28-fec7-4323-8a94-c7294468be92 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: .version_select at 0x7f693f3fdd30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-790984164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjuAlNIATI/4xf7UJjN8yCgj8+ErdTeB6xngRebR4EG/T8B+LmbQwzK9ylJEkG1yPtqj+FscNk+0pSTAqcws+QhJZ7R3F4f5zSq8WfdDhYbh1pPeEuCDpeOVGaA7ADZvg=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:33.723811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1c945f28-fec7-4323-8a94-c7294468be92 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:40:33.730197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-1c945f28-fec7-4323-8a94-c7294468be92 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:40:33.756586 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1c945f28-fec7-4323-8a94-c7294468be92 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.231889 Sep 14 10:40:33.757200 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2249/6613] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:40:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:39.865125 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:39.866144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:39.871519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-837606772", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "f2b1bd6f-e618-449a-9607-cd8eb7d2a9d8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-790984164", "security_groups": [{"name": "tempest-secgroup-smoke-1417916050"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:40.007389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] validate_networks() for [('f2b1bd6f-e618-449a-9607-cd8eb7d2a9d8', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:40:40.505353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:40:40.505798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:40:40.506294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:40:40.506724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:40:40.507154 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:40:40.517553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:40.518578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:40.519446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:40.520379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:40.520966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:40.521540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:40.542179 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:40:40.549163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:40:40.565072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:40:40.567551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:40:40.621219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cb9eab9d-51ac-4d5d-bf72-68a3d764670c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759261 Sep 14 10:40:40.628921 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4365/6614] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:40:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:40:40.634903 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7a057c14-2a56-41c2-9d2c-f2aaf9b202a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:40.635539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7a057c14-2a56-41c2-9d2c-f2aaf9b202a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:40.642539 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:40.644662 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:40.707346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7a057c14-2a56-41c2-9d2c-f2aaf9b202a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:40.714398 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7a057c14-2a56-41c2-9d2c-f2aaf9b202a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1265 microversion: 2.1 time: 0.084139 Sep 14 10:40:40.715003 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2250/6615] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:40 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:40:41.741336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9988dd9c-00c2-4674-b07f-1c6fc0c6846d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:41.743318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9988dd9c-00c2-4674-b07f-1c6fc0c6846d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:41.839754 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9988dd9c-00c2-4674-b07f-1c6fc0c6846d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:41.852722 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9988dd9c-00c2-4674-b07f-1c6fc0c6846d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1265 microversion: 2.1 time: 0.118382 Sep 14 10:40:41.870333 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4366/6616] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:41 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:42.878087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee17daea-4b09-4c55-b510-b5c963c1a853 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:42.879015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee17daea-4b09-4c55-b510-b5c963c1a853 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:42.932460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ee17daea-4b09-4c55-b510-b5c963c1a853 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:42.939789 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee17daea-4b09-4c55-b510-b5c963c1a853 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1265 microversion: 2.1 time: 0.065916 Sep 14 10:40:42.940724 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2251/6617] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:42 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:43.963297 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-fd797fc0-20af-4274-953a-dadf671b910d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:43.963951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-fd797fc0-20af-4274-953a-dadf671b910d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:44.018514 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-fd797fc0-20af-4274-953a-dadf671b910d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:44.026022 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-fd797fc0-20af-4274-953a-dadf671b910d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1265 microversion: 2.1 time: 0.066773 Sep 14 10:40:44.026602 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4367/6618] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:43 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:45.050352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:45.051011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:45.057105 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:45.057587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:45.058060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:45.058748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:45.059203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:45.059632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:45.122228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:45.130059 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-920dfeae-8f2b-41d7-992d-6a91a60408c2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1269 microversion: 2.1 time: 0.085029 Sep 14 10:40:45.130631 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2252/6619] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:45 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:46.152841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:46.153472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:46.161420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:46.161924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:46.162377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:46.163095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:46.163707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:46.164033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:46.235426 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:46.243568 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a446ead9-d913-4e46-9994-6d4f61daf19d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1323 microversion: 2.1 time: 0.094618 Sep 14 10:40:46.244410 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4368/6620] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:46 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1323 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:47.267675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:47.268333 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:47.275341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:47.275829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:47.276312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:47.277005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:47.277458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:47.277883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:47.522417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:47.530540 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e666cb8d-8f3f-416d-af32-d4a2a3255d51 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.267761 Sep 14 10:40:47.531963 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2253/6621] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:47 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:47.732442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8ebcaf-1480-4188-9c65-50cdd679f541", "tag": "249f0533-8ddd-459a-a2be-9a8c36f27e33"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:47.744361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:47.745461 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:47.745910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:47.758454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] Creating event network-changed:249f0533-8ddd-459a-a2be-9a8c36f27e33 for instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 on n-h2-851028-12 Sep 14 10:40:47.763422 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a4e38bbb-0a9f-4162-87ff-5fefc11a1edc req-ee3c5845-cd78-48a6-b1b6-7cae21e6c327 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Sep 14 10:40:47.764054 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4369/6622] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:48.555961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:48.556581 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:48.564171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:48.564653 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:48.565085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:48.565786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:48.566243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:48.566669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:48.711617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:48.720223 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b0f1038-c539-4815-8fca-ea6b0e841931 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.168064 Sep 14 10:40:48.720808 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2254/6623] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:48 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:49.746255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:49.746974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:49.754332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:49.754849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:49.755309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:49.756073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:49.756538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:49.756985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:49.901800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:49.909850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43034dd5-2db9-492e-87a6-8975650e9a23 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.168881 Sep 14 10:40:49.910446 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4370/6624] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:49 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:50.934015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:50.934813 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:50.941879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:50.942452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:50.942895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:50.943601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:50.944085 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:50.944515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:51.087766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:51.096520 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6dbe6621-d54e-4527-8af0-ea5903f9c063 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.166515 Sep 14 10:40:51.097105 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2255/6625] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:50 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:52.120258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:52.120793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:52.122796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:52.129095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:52.129603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:52.130059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:52.130773 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:52.131241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:52.131681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:52.263530 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:52.271832 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8848093-db0a-4045-9d77-02392400f82c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.155831 Sep 14 10:40:52.272450 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4371/6626] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:52 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:52.942485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8ebcaf-1480-4188-9c65-50cdd679f541", "name": "network-vif-plugged", "status": "completed", "tag": "249f0533-8ddd-459a-a2be-9a8c36f27e33"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:52.948240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:52.956114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:52.957658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:52.958347 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:52.979652 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] Creating event network-vif-plugged:249f0533-8ddd-459a-a2be-9a8c36f27e33 for instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 on n-h2-851028-12 Sep 14 10:40:52.986936 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-667d71a0-9618-44ae-9c7f-43e0f9c703d2 req-53e22113-d599-4c68-8e3d-7723af40ce82 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047469 Sep 14 10:40:52.987583 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2256/6627] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:53.295888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:53.297927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:53.304383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:53.304822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:53.305310 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:53.306020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:53.306490 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:53.306931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:53.447484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:53.455209 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-64a78886-d035-4735-9b4a-a67fb06c34c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1391 microversion: 2.1 time: 0.163218 Sep 14 10:40:53.455788 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4372/6628] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:53 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:54.479164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:54.479774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:54.487470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:54.487979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:54.488421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:54.489111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:54.489564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:54.489990 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:54.630378 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:54.638162 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5ac4f3d7-41ba-4701-bba4-2c0973322302 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1564 microversion: 2.1 time: 0.163626 Sep 14 10:40:54.638723 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2257/6629] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:54 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:54.660425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:54.661051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:54.662928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:40:54.669027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:54.669523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:54.669984 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:54.670664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:54.671675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:54.672706 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:54.815197 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:54.823118 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-077119ae-52cb-46c8-8351-f5630df210bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1564 microversion: 2.1 time: 0.166883 Sep 14 10:40:54.823707 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4373/6630] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:54 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:40:56.428305 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:40:56.428922 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:40:56.436055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:56.436556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:56.437064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:56.437845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8ebcaf-1480-4188-9c65-50cdd679f541", "tag": "249f0533-8ddd-459a-a2be-9a8c36f27e33"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:40:56.438322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:56.438774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:56.439279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:56.448527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:40:56.449020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:40:56.449486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:40:56.464208 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] Creating event network-changed:249f0533-8ddd-459a-a2be-9a8c36f27e33 for instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 on n-h2-851028-12 Sep 14 10:40:56.470507 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6e68346b-cd06-4de8-8713-f6e2e0ad395e req-079d75df-1303-4281-a91e-5563787dcf4e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036492 Sep 14 10:40:56.471126 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4374/6631] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:40:56.672130 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:40:56.680401 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab6f6b37-2a05-403b-80df-e3ce1dddacce tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1564 microversion: 2.1 time: 0.255762 Sep 14 10:40:56.681002 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2258/6632] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:40:56 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:20.051923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:20.053390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=36 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:20.058110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:20.060444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:20.068494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:20.069015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:20.069450 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:20.070183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:20.070656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:20.071103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:20.130893 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a9b1eba9-b1b0-4325-a1c3-317d7e86499f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action" status: 200 len: 24572 microversion: 2.1 time: 0.080971 Sep 14 10:41:20.137406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4375/6633] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:41:20 2022] POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action => generated 24572 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:41:31.109069 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:31.109648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:31.111722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=21 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:31.112409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=38 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:31.118764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:31.119239 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:31.119678 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:31.120410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:31.120867 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:31.121295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:31.187159 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b694561-b3be-4ee3-9878-c8f956c10f67 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action" status: 202 len: 0 microversion: 2.1 time: 0.082097 Sep 14 10:41:31.187885 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2259/6634] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:41:31 2022] POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:41:31.197642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:31.198376 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:31.201337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:31.202165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=4 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:31.209069 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:31.209589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:31.210067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:31.210791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:31.211267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:31.211721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:31.356451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:31.364694 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7887ebb8-256f-4196-afa2-48d30df36d80 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1687 microversion: 2.1 time: 0.172142 Sep 14 10:41:31.365251 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4376/6635] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:31 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:32.390657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:32.391260 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:32.398685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:32.399171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:32.399608 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:32.400338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:32.400792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:32.401221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:32.538963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:32.547000 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-eb800bf8-f439-4c17-a832-d3f17fecb483 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1667 microversion: 2.1 time: 0.161540 Sep 14 10:41:32.547571 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2260/6636] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:32 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:33.651735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:33.653870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:33.661606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.662804 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.663279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.664097 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.664575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.665025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.724517 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-70723592-43b3-48f8-b340-867d631eebe4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action" status: 200 len: 32577 microversion: 2.1 time: 0.076699 Sep 14 10:41:33.725310 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4377/6637] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:41:33 2022] POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action => generated 32577 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:41:33.737223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:33.737760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:33.744917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.745406 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.745840 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.746526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.746979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.747402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.813779 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2e4d44bb-8af9-4f44-946a-1a4cf8ee4bfc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action" status: 202 len: 0 microversion: 2.1 time: 0.080249 Sep 14 10:41:33.814428 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2261/6638] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:41:33 2022] POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:41:33.824435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:33.825161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:33.832614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.833127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.833584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.835276 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:33.836252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:33.836705 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:33.975536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:33.984283 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8e9371b8-39da-4274-a1c3-d08d4eeaed43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1674 microversion: 2.1 time: 0.164315 Sep 14 10:41:33.984880 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4378/6639] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:33 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:35.013012 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:35.013739 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:35.024102 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:35.024592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:35.025026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:35.025773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:35.026223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:35.026638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:35.166343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:35.174236 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-512305f7-820a-4845-a63a-4817befcddb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1682 microversion: 2.1 time: 0.168518 Sep 14 10:41:35.174817 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2262/6640] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:35 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:35.275167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:35.277434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:35.285135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:35.285636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:35.286089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:35.286797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:35.287397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:35.288067 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:35.347068 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-66c7a346-8520-4eca-82f2-3043ee14c811 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action" status: 200 len: 38336 microversion: 2.1 time: 0.076743 Sep 14 10:41:35.348052 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4379/6641] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:41:35 2022] POST /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541/action => generated 38336 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:41:36.347734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:36.348295 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:36.352398 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c8ebcaf-1480-4188-9c65-50cdd679f541", "tag": "249f0533-8ddd-459a-a2be-9a8c36f27e33"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:36.357818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:36.357818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:36.357818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:36.358502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:36.359645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:36.359645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:36.366292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:36.366789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:36.367235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:36.379026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] Creating event network-changed:249f0533-8ddd-459a-a2be-9a8c36f27e33 for instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 on n-h2-851028-12 Sep 14 10:41:36.384593 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1061860e-6f3d-4bfd-a9d8-a4862fd41661 req-289626cc-a27f-4a7f-abbc-e8419237ce16 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037299 Sep 14 10:41:36.385622 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4380/6642] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:41:36.387237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:41:36.473138 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-651e4d1e-77fe-41bd-8908-0015e6639024 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 204 len: 0 microversion: 2.1 time: 0.128742 Sep 14 10:41:36.478086 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2263/6643] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:41:36 2022] DELETE /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:41:36.485787 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:36.486620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:36.494101 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:36.494696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:36.495208 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:36.496041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:36.496576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:36.497103 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:36.648545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:36.656555 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aaddab3b-f42c-4d5b-9b36-5d8dd512107c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1688 microversion: 2.1 time: 0.176822 Sep 14 10:41:36.657153 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4381/6644] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:36 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:37.681853 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:37.682519 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:37.690044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:37.690585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:37.690980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:37.691681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:37.692166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:37.692961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:37.825270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:37.832942 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-80218e94-4e71-4e4e-ada1-364ac6d833eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1688 microversion: 2.1 time: 0.155967 Sep 14 10:41:37.833530 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2264/6645] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:37 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:38.727434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c8ebcaf-1480-4188-9c65-50cdd679f541", "name": "network-vif-deleted", "tag": "249f0533-8ddd-459a-a2be-9a8c36f27e33"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:38.738818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:38.739471 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:38.739938 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:38.752085 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] Creating event network-vif-deleted:249f0533-8ddd-459a-a2be-9a8c36f27e33 for instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 on n-h2-851028-12 Sep 14 10:41:38.757676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-5cae2bb0-c121-4f51-b7ea-2ae058ed009e req-37705f29-bf7c-4a71-af9e-8d8909afc711 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 Sep 14 10:41:38.758499 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4382/6646] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:41:38.858382 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:38.858995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:38.866669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:38.867115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:38.867555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:38.868290 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:38.868751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:38.869181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:38.901868 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:38.902371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:38.902805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:38.903257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lazy-loading 'fault' on Instance uuid 6c8ebcaf-1480-4188-9c65-50cdd679f541 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:41:38.945792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:38.953623 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-28417845-0486-49f9-9767-760905271f3f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 200 len: 1355 microversion: 2.1 time: 0.099382 Sep 14 10:41:38.954199 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2265/6647] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:38 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:39.979383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:39.980141 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6c8ebcaf-1480-4188-9c65-50cdd679f541] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:39.986447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:39.986954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:39.987646 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:39.988581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:39.989059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:39.989502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:40.003105 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] HTTP exception thrown: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Request method failure captured: Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 HTTP/1.1 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa-g3AKQQ_zlQ4ClomJ5EAiFHMty9vFIFmS1j-KiCqczx8HbwEmFzcM4jSFa3BP0e3OfRsDoqdZE1aIUR-I85cjQaVfxLTF48x8zdFM02XzbhdlCI-UwAjqszGtJ-6CxQ6gAor6ocDu5rNFOB2DmoeRJTdd4iList8NqhheODQxDiY0 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4710865cab4841e291ac02e1b9e23506", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4710865cab4841e291ac02e1b9e23506"}]}] Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ecca4d696f924555a5af00d9b2e08da7 Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': '6c8ebcaf-1480-4188-9c65-50cdd679f541'} Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:41:40.004818 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Returning 404 to user: Instance 6c8ebcaf-1480-4188-9c65-50cdd679f541 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-30a9f43f-37bc-474f-880d-a7bc88213386 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541" status: 404 len: 111 microversion: 2.1 time: 0.032893 Sep 14 10:41:40.010404 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4383/6648] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:39 2022] GET /compute/v2.1/servers/6c8ebcaf-1480-4188-9c65-50cdd679f541 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:41:43.347947 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-67297672-a6ab-4a8d-88df-0b312b2d380f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '.version_select at 0x7f693f855820>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:43.375481 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-67297672-a6ab-4a8d-88df-0b312b2d380f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790984164" status: 202 len: 0 microversion: 2.1 time: 0.032990 Sep 14 10:41:43.379566 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2266/6649] 10.222.0.90 () {58 vars in 1281 bytes} [Wed Sep 14 10:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-790984164 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:41:43.408168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-08a41bd8-44bf-42b5-85c0-c4513a62957d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: .version_select at 0x7f693ddafc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-35436582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg/pu/Nm7K3vPbHmjX780KcWs8YUjHzVLxohCFjeSi3rysgeqmBAGAB81fJHJ+s+azSrJUeHD2vhzSGA0vsTsOJP83R0WiGLQQ4DfAMEe21pnbh2q5EyTzY/Gke9qbhUQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:43.431869 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-08a41bd8-44bf-42b5-85c0-c4513a62957d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:41:43.438993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-08a41bd8-44bf-42b5-85c0-c4513a62957d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:41:43.464581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-08a41bd8-44bf-42b5-85c0-c4513a62957d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.060361 Sep 14 10:41:43.465200 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4384/6650] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:41:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:41:49.062762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:49.067447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-692428918", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "58e475cc-06cb-4ce2-9b87-e54a7dbf4269"}], "key_name": "tempest-TestNetworkAdvancedServerOps-35436582", "security_groups": [{"name": "tempest-secgroup-smoke-31851489"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:49.389024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] validate_networks() for [('58e475cc-06cb-4ce2-9b87-e54a7dbf4269', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:41:49.828963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:41:49.829529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:41:49.830028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:41:49.830503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:41:49.831264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:41:49.840384 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:49.840873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:49.841327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:49.842053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:49.842511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:49.842936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:49.861154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:41:49.867110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:41:49.879756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:41:49.882588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:41:49.932240 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [be59cc52-97ae-4966-8931-cdc730e22819] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:41:50.940303 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [be59cc52-97ae-4966-8931-cdc730e22819] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 55322. Sep 14 10:41:50.945781 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a0b9e38e-d1d7-48b5-b417-857122a9738a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.884842 Sep 14 10:41:50.946445 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2267/6651] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:41:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:41:50.957590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:41:50.963104 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-95d3a1d6-5608-4573-a720-32526cb6b874 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:50.963735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-95d3a1d6-5608-4573-a720-32526cb6b874 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:51.030358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-95d3a1d6-5608-4573-a720-32526cb6b874 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:51.039888 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-95d3a1d6-5608-4573-a720-32526cb6b874 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1264 microversion: 2.1 time: 0.084527 Sep 14 10:41:51.041104 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4385/6652] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:50 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1264 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:52.066671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:52.067392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:52.080481 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:52.080985 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:52.081421 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:52.082330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:52.082788 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:52.083213 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:52.163109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:52.172099 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-da5dfcc4-f1d5-4b26-a5e6-7fa69e1c3501 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1316 microversion: 2.1 time: 0.111279 Sep 14 10:41:52.173158 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2268/6653] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:52 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:53.197176 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:53.197912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:53.206627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:53.207139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:53.207596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:53.208748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:53.209288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:53.209733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:53.574480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:53.582985 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c98f2eb-be6f-4743-a941-fdf6018068e3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.390003 Sep 14 10:41:53.584275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4386/6654] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:53 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:53.973711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ced833-6735-48b8-aee9-edadc58f8ee4", "tag": "395e855c-c54b-4d44-9a71-abd9b419bdcd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:53.986044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:53.986843 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:53.987520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:54.003067 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] Creating event network-changed:395e855c-c54b-4d44-9a71-abd9b419bdcd for instance a3ced833-6735-48b8-aee9-edadc58f8ee4 on n-h1-851028-12 Sep 14 10:41:54.009185 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7680729a-fbb9-470b-89a8-6c6412fe0ec0 req-ca332841-81f6-4c1b-80d9-e1ed5c5add61 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039449 Sep 14 10:41:54.009820 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2269/6655] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:41:54.611135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:54.612305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:54.624333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:54.625178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:54.625637 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:54.626423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:54.626900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:54.627343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:54.769488 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:54.778676 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b5a07588-1874-4145-bb55-94b64c5eadbb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.173380 Sep 14 10:41:54.779287 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4387/6656] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:54 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:55.804478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:55.805177 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:55.811420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:55.811920 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:55.812389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:55.813082 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:55.813538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:55.813966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:56.180293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:56.188084 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e9bbb531-33db-4f48-af3e-f40bcc58c74e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.389551 Sep 14 10:41:56.188661 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2270/6657] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:55 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:57.211972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:57.212594 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:57.219528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:57.220068 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:57.220511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:57.221217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:57.221677 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:57.222112 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:57.357078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:57.365569 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db5ccbb8-4cae-49ec-8d59-cb56f44353a9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.157557 Sep 14 10:41:57.365785 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4388/6658] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:57 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:58.387692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:58.388332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:58.395612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:58.396635 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:58.397072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:58.397762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:58.398216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:58.398643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:58.532181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:58.540018 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c6d5f715-7c03-4c25-98b0-11b27607a3d2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.156169 Sep 14 10:41:58.540596 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2271/6659] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:58 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:41:58.694961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ced833-6735-48b8-aee9-edadc58f8ee4", "name": "network-vif-plugged", "status": "completed", "tag": "395e855c-c54b-4d44-9a71-abd9b419bdcd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:41:58.709602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:58.710102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:58.710801 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:58.724029 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] Creating event network-vif-plugged:395e855c-c54b-4d44-9a71-abd9b419bdcd for instance a3ced833-6735-48b8-aee9-edadc58f8ee4 on n-h1-851028-12 Sep 14 10:41:58.729647 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-d4e9ad13-7b8b-4ff1-b097-aa9f1551b59c req-3e95f868-9f7c-4f32-a4dc-024a6ac37b08 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039441 Sep 14 10:41:58.730347 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4389/6660] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:41:59.562477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:41:59.563089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:41:59.570324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:59.571516 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:59.571991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:59.572689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:41:59.573144 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:41:59.573569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:41:59.719690 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:41:59.728068 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9582bd73-0409-4647-891b-d97ea94f93f3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1388 microversion: 2.1 time: 0.169456 Sep 14 10:41:59.728894 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2272/6661] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:41:59 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1388 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:00.752633 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:00.753350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:00.760563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:00.761088 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:00.761537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:00.762239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:00.762703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:00.763160 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:00.908065 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:00.916390 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-16cef4e6-cbe0-478f-858e-422cd00a92b0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1560 microversion: 2.1 time: 0.168943 Sep 14 10:42:00.916994 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4390/6662] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:00 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:00.938818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:00.939414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:00.941369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:00.942053 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:00.949321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:00.949803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:00.950232 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:00.950918 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:00.951362 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:00.951780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:01.084648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:01.092470 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fc261250-b16d-4c28-9209-2fa9d30c0093 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1560 microversion: 2.1 time: 0.157463 Sep 14 10:42:01.093048 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2273/6663] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:00 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:02.712507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ced833-6735-48b8-aee9-edadc58f8ee4", "tag": "395e855c-c54b-4d44-9a71-abd9b419bdcd"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:42:02.716330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:02.716964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:02.719124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:02.726381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:02.729929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:02.734576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:02.734859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:02.735412 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:02.737703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:02.738161 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:02.738715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:02.740185 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:02.740891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:02.741576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:02.752054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] Creating event network-changed:395e855c-c54b-4d44-9a71-abd9b419bdcd for instance a3ced833-6735-48b8-aee9-edadc58f8ee4 on n-h1-851028-12 Sep 14 10:42:02.758214 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-372751f5-fc24-4813-90a2-b16fb9f53f5c req-ea6cd095-32c1-4aa9-b12c-7815799dc8b0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049250 Sep 14 10:42:02.758924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2274/6664] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:42:02.967863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:02.976601 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-93cc033e-afc5-4f0d-8d3d-1e26a61b9c85 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1560 microversion: 2.1 time: 0.270284 Sep 14 10:42:02.987916 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4391/6665] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:02 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1560 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:42:26.231051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:42:26.233359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:26.235465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=36 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:26.242054 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:26.242541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:26.242978 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:26.243673 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:26.244147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:26.244576 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:26.297415 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0fcc05a6-10f8-44d4-b5ed-d05889f958b3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action" status: 200 len: 24574 microversion: 2.1 time: 0.071381 Sep 14 10:42:26.298083 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2275/6666] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:42:26 2022] POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:42:32.712267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:42:32.714498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:32.718023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:32.718797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:42:32.723105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:32.723745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:32.724308 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:32.725024 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:32.725491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:32.725930 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:32.803542 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-67d92bed-8abb-4df5-a1dd-a64d8a13cdbe tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action" status: 202 len: 0 microversion: 2.1 time: 0.095129 Sep 14 10:42:32.804414 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4392/6667] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:42:32 2022] POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:42:32.814076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:32.814930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:32.822015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:32.822577 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:32.823031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:32.823820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:32.824308 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:32.825859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:32.969904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:32.979432 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f82ae433-efa7-4b02-9607-9cda14a4e4a1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1670 microversion: 2.1 time: 0.170356 Sep 14 10:42:32.980253 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2276/6668] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:32 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:34.006591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:34.007352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:34.017100 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:34.017619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:34.018107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:34.018832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:34.019311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:34.019759 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:34.160922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:34.169750 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-06e98926-ddf0-4474-9904-48267f92abe7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.169168 Sep 14 10:42:34.170338 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4393/6669] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:33 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:35.194995 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:35.195612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:35.202517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:35.203008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:35.203451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:35.204206 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:35.204666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:35.205093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:35.345075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:35.353932 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ac7c13b-c1b8-4ce4-84bc-ae8b6c03c878 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.162839 Sep 14 10:42:35.354519 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2277/6670] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:35 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:36.380968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:36.381599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:36.388685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:36.389190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:36.389644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:36.390355 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:36.390827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:36.391271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:36.528737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:36.537146 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33d1c875-44b3-45e5-b121-ad3664e1147d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.160293 Sep 14 10:42:36.537725 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4394/6671] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:36 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:37.561605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:37.562221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:37.569299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:37.569776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:37.570209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:37.570897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:37.571339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:37.571760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:37.705337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:37.714014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-945ce799-1e25-4acf-ab6c-2d21d260999a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.156390 Sep 14 10:42:37.714603 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2278/6672] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:37 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:38.737999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:38.738664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:38.746269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:38.746778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:38.747234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:38.747989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:38.748507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:38.749214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:38.887031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:38.895007 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d3372a12-311c-4dad-b0c2-e54d4ed68bac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.161005 Sep 14 10:42:38.896759 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4395/6673] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:38 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:39.920857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:39.921456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:39.928672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:39.929169 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:39.929609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:39.930313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:39.930767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:39.931197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:40.073832 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:40.081695 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-721c0c3f-3748-4dd2-9cc5-6b312c279fc8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.164885 Sep 14 10:42:40.082278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2279/6674] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:39 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:41.109309 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:41.109948 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:41.118620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:41.119132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:41.119590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:41.120350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:41.120821 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:41.121261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:41.262445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:41.271545 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d589275e-18df-4fe7-9bdf-2b0d9a188d0a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.167749 Sep 14 10:42:41.272198 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4396/6675] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:41 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:42.295592 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:42.296240 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:42.303938 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:42.304431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:42.304872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:42.305586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:42.306045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:42.306476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:42.441200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:42.449708 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2d6529cf-f55c-4d4c-8724-261f62ad268a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.158032 Sep 14 10:42:42.450298 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2280/6676] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:42 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:43.475696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:43.476296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:43.483466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:43.483989 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:43.484433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:43.485128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:43.485591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:43.486023 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:43.623877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:43.631840 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c2138596-b3bb-4fe5-89fb-724e22a67088 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1675 microversion: 2.1 time: 0.161009 Sep 14 10:42:43.632458 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4397/6677] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:43 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:42:44.655648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:42:44.656318 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:42:44.663964 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:44.664462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:44.664908 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:44.665619 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:42:44.666081 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:42:44.666513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:42:44.798642 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:42:44.807109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02ecbee2-36d3-44ab-9eb5-7c86b71aba82 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1678 microversion: 2.1 time: 0.155402 Sep 14 10:42:44.807687 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2281/6678] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:42:44 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:43:09.000985 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:09.003139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:09.005558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=12 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:09.006360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:09.012505 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:09.013015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:09.013474 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:09.014194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:09.014673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:09.015128 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:09.072484 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72211b04-32c2-4f50-b8ca-2d22ace9905b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action" status: 200 len: 69126 microversion: 2.1 time: 0.075652 Sep 14 10:43:09.073175 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4398/6679] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:43:08 2022] POST /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4/action => generated 69126 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:43:16.082207 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:16.082869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:16.086930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=15 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:16.087998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=40 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:16.093028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:16.093734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:16.094184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:16.095022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:16.095491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:16.096005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:16.130666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:43:16.152164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ced833-6735-48b8-aee9-edadc58f8ee4", "tag": "395e855c-c54b-4d44-9a71-abd9b419bdcd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:16.166770 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:16.167587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:16.168550 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:16.183082 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] Creating event network-changed:395e855c-c54b-4d44-9a71-abd9b419bdcd for instance a3ced833-6735-48b8-aee9-edadc58f8ee4 on n-h1-851028-12 Sep 14 10:43:16.188886 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-160c8b98-c373-4410-89ab-12a1b1ab4764 req-2f3d8238-5844-4c0e-9d0a-f6c84f10401d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108498 Sep 14 10:43:16.190000 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4399/6680] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:43:16.239750 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fd4e060e-ea01-416d-b4a6-bf281dabb10e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 204 len: 0 microversion: 2.1 time: 0.161661 Sep 14 10:43:16.240667 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2282/6681] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:43:16 2022] DELETE /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:43:16.250123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:16.251105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:16.258314 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:16.258820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:16.259270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:16.260216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:16.260870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:16.261468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:16.405545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:16.414230 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-92dd1e66-8073-4e81-b30d-fb51dd2acf69 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1684 microversion: 2.1 time: 0.168831 Sep 14 10:43:16.414811 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4400/6682] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:16 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:43:17.439198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:17.439831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:17.447365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:17.447857 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:17.448323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:17.449068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:17.449528 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:17.449960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:17.588389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:17.596238 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-79e37c56-15ff-45a5-b3e0-5372ceb84ed8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1684 microversion: 2.1 time: 0.161226 Sep 14 10:43:17.596815 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2283/6683] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:17 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:18.218240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ced833-6735-48b8-aee9-edadc58f8ee4", "name": "network-vif-deleted", "tag": "395e855c-c54b-4d44-9a71-abd9b419bdcd"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:18.229991 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:18.230415 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:18.230865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:18.243208 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] Creating event network-vif-deleted:395e855c-c54b-4d44-9a71-abd9b419bdcd for instance a3ced833-6735-48b8-aee9-edadc58f8ee4 on n-h1-851028-12 Sep 14 10:43:18.248521 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-cce07be5-6d99-4fbc-8555-55ac4abfdeb7 req-56a57a4b-1d0a-42ed-a6f6-c9a825291244 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033932 Sep 14 10:43:18.249146 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4401/6684] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:43:18.621093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:18.621721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:18.636032 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:18.636904 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:18.637707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:18.638625 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:18.639090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:18.639689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:18.674879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:18.676024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:18.676483 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:18.676941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lazy-loading 'fault' on Instance uuid a3ced833-6735-48b8-aee9-edadc58f8ee4 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:43:18.719520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:18.728082 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b1547cba-2eb8-4a19-805f-f3cf3e1cbe58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 200 len: 1354 microversion: 2.1 time: 0.111064 Sep 14 10:43:18.728929 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2284/6685] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:18 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 1354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:19.755763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:19.756537 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: a3ced833-6735-48b8-aee9-edadc58f8ee4] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:19.762908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:19.763410 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:19.763865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:19.764716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:19.765189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:19.765636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:19.780458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.wsgi [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] HTTP exception thrown: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Request method failure captured: Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: request: GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 HTTP/1.1 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Accept: application/json Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Accept-Encoding: identity Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Connection: close Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Content-Length: 0 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Content-Type: application/json Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Host: 10.222.0.90 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: Openstack-System-Scope: None Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: User-Agent: python-urllib3/1.26.12 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Auth-Token: gAAAAABjIa-g3AKQQ_zlQ4ClomJ5EAiFHMty9vFIFmS1j-KiCqczx8HbwEmFzcM4jSFa3BP0e3OfRsDoqdZE1aIUR-I85cjQaVfxLTF48x8zdFM02XzbhdlCI-UwAjqszGtJ-6CxQ6gAor6ocDu5rNFOB2DmoeRJTdd4iList8NqhheODQxDiY0 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Id: None Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Domain-Name: None Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Identity-Status: Confirmed Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Is-Admin-Project: True Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Id: default Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Domain-Name: Default Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Role: member,reader Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Roles: member,reader Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4710865cab4841e291ac02e1b9e23506", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4710865cab4841e291ac02e1b9e23506"}]}] Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-User: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Id: default Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-User-Domain-Name: Default Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-User-Id: ecca4d696f924555a5af00d9b2e08da7 Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: X-User-Name: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: method: > Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: exception: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: action_args: {'id': 'a3ced833-6735-48b8-aee9-edadc58f8ee4'} Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:43:19.782124 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: ERROR nova.api.openstack.wsgi Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Returning 404 to user: Instance a3ced833-6735-48b8-aee9-edadc58f8ee4 could not be found. {{(pid=122444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ee883be-c97f-48bd-8a26-72c81852024f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4" status: 404 len: 111 microversion: 2.1 time: 0.034296 Sep 14 10:43:19.787316 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4402/6686] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:19 2022] GET /compute/v2.1/servers/a3ced833-6735-48b8-aee9-edadc58f8ee4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:43:23.195103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-251e9c1a-529f-406d-a0b5-b5e26a462880 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '.version_select at 0x7f693e9d2af0>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:23.220752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-251e9c1a-529f-406d-a0b5-b5e26a462880 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-35436582" status: 202 len: 0 microversion: 2.1 time: 0.029862 Sep 14 10:43:23.221694 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2285/6687] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 10:43:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-35436582 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:43:23.253271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba4fcd41-6d99-4ec6-a6b4-3b98f276216d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: .version_select at 0x7f693c3df310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-97184005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGotcG8dv/MJwzNifUCTGbYh79XGOMk5UeSysxfSoP2jDsQajqWjenjiwOW77BUU0fLeyviKJJ6vaocAwj7hpuNjSjZyV18b81587NGYTmAzCCc2yMi86C1CzzR+Sbb3TQ=="}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:23.275110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ba4fcd41-6d99-4ec6-a6b4-3b98f276216d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:43:23.280387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-ba4fcd41-6d99-4ec6-a6b4-3b98f276216d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:43:23.305305 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba4fcd41-6d99-4ec6-a6b4-3b98f276216d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.055931 Sep 14 10:43:23.305915 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4403/6688] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:43:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:43:29.121201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:29.126820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1506872478", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "20e8916e-b6f2-4a4b-99a3-f07af27ead47"}], "key_name": "tempest-TestNetworkAdvancedServerOps-97184005", "security_groups": [{"name": "tempest-secgroup-smoke-593101837"}]}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:29.257749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.network.neutron [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] validate_networks() for [('20e8916e-b6f2-4a4b-99a3-f07af27ead47', None, None, None, None, None)] {{(pid=122443) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:43:29.738785 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:43:29.739332 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:43:29.739927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:43:29.740613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:43:29.741243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.virt.hardware [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122443) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:43:29.752672 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:29.754193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:29.754864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:29.755859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:29.756816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:29.757478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:29.780100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:43:29.789104 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:43:29.806111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Going to run 1 instances... {{(pid=122443) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:43:29.810135 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122443) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:43:29.872681 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ba4dd877-d71b-4892-8a6c-22d74a7a7c45 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753572 Sep 14 10:43:29.873750 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2286/6689] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:43:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:43:29.887168 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3ee47163-421d-4d4a-83c1-4b0b1b8e7d09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:29.887873 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3ee47163-421d-4d4a-83c1-4b0b1b8e7d09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:29.891099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:29.972986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3ee47163-421d-4d4a-83c1-4b0b1b8e7d09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:29.980856 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3ee47163-421d-4d4a-83c1-4b0b1b8e7d09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1265 microversion: 2.1 time: 0.098681 Sep 14 10:43:29.983876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4404/6690] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:29 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:31.008687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:31.009249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:31.020668 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:31.021159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:31.021593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:31.022299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:31.022754 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:31.023173 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:31.132157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:31.143136 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b9f847a9-2a2e-4b70-8b9e-4fbb824527eb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1325 microversion: 2.1 time: 0.140246 Sep 14 10:43:31.145177 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2287/6691] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:31 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1325 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:32.170119 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:32.172886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:32.183044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:32.184659 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:32.185431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:32.186417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:32.187114 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:32.187817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:32.370826 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:32.383467 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bbb1d9e-8ae6-4316-aff7-7cd7abbc1e81 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.217538 Sep 14 10:43:32.385304 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4405/6692] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:32 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:32.640498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:32.656316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:32.656808 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:32.657460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:32.670545 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] Creating event network-changed:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h2-851028-12 Sep 14 10:43:32.676961 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-5285c6ea-bc90-41f6-a744-dc8df9ec8218 req-41b43069-eded-45e5-b2bd-309b7a1cc121 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040018 Sep 14 10:43:32.677614 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2288/6693] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:43:33.408216 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:33.408838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:33.412082 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:43:33.412250 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:43:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 (ip 10.222.0.90) !!! Sep 14 10:43:33.421313 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:33.421808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:33.422257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:33.423059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:33.423524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:33.423990 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:33.559003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:33.567011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0c34ff3-4522-42a3-b7aa-4faa84df1c5f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.162657 Sep 14 10:43:33.567536 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4406/6694] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:33 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:34.592749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:34.593435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:34.600147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:34.600628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:34.601060 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:34.601741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:34.602189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:34.602611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:34.737019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:34.745397 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-904c255f-6a41-4160-8fc3-b9beab07c733 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.158495 Sep 14 10:43:34.745991 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2289/6695] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:34 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:35.768422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:35.769091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:35.776301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:35.777209 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:35.777675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:35.778395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:35.778874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:35.779322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:35.919809 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:35.930202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aefd8b2e-91bb-447a-ae2c-487b08c3e110 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.165726 Sep 14 10:43:35.930794 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4407/6696] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:35 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:36.956909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:36.958143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:36.964958 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:36.965441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:36.965871 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:36.966552 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:36.966997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:36.967417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:37.100045 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:37.108037 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-23466885-199e-47fe-af94-eccf0692c35a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.155021 Sep 14 10:43:37.108867 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2290/6697] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:36 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:38.132369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:38.133122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:38.140021 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:38.140603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:38.141124 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:38.141865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:38.142318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:38.142761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:38.278847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:38.287380 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0dc0b4e2-fcf1-457e-be14-05eed627aaef tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.159701 Sep 14 10:43:38.287985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4408/6698] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:38 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:39.311980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:39.312551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:39.324365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:39.325936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:39.325936 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:39.327111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:39.328171 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:39.328410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:39.474265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:39.486948 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd004b48-7561-4c76-a3fc-5086f661785d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.179697 Sep 14 10:43:39.487542 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2291/6699] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:39 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:39.707728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "name": "network-vif-plugged", "status": "completed", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:39.714813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:39.719365 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:39.719875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:39.720356 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:39.733038 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] Creating event network-vif-plugged:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h2-851028-12 Sep 14 10:43:39.738243 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0b939165-3cf0-43cf-b606-2db96371ff5f req-9c82be01-7c76-48ce-97d9-e338fa9cf054 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035289 Sep 14 10:43:39.738853 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4409/6700] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:43:40.510307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:40.511460 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:40.514716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:40.515688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:40.522950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:40.523444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:40.523906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:40.524630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:40.525180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:40.525698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:40.665452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:40.673225 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e79f5518-47c2-4b86-95dd-0d7a94a4ad12 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1390 microversion: 2.1 time: 0.167213 Sep 14 10:43:40.673799 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2292/6701] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:40 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:41.695138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:43:41.700239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:41.700958 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:41.707491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:41.708345 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:41.708928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:41.709750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:41.710224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:41.710670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:41.843367 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:41.851723 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-123675e3-1c79-4a16-a70e-4855064f9a42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1562 microversion: 2.1 time: 0.157747 Sep 14 10:43:41.852343 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4410/6702] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:41 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:41.874715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:41.875334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:41.883464 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:41.883986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:41.884432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:41.885134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:41.885633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:41.886120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:42.025388 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:42.033579 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-9261ccdd-7f5f-4d74-9c79-be2f57a657bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1562 microversion: 2.1 time: 0.162957 Sep 14 10:43:42.034192 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2293/6703] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:41 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:43:43.977884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:43:43.989605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:43:43.990431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:43:43.997663 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:43.998170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:43.998627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:43.999350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:43.999818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:44.000511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:44.008438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:43:44.008927 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:43:44.009454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:43:44.021708 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] Creating event network-changed:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h2-851028-12 Sep 14 10:43:44.027493 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2faf4963-ac53-48d0-bedf-545bdb99d0ad req-934985eb-7eae-46d5-8bd3-fc6a11f220a6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053558 Sep 14 10:43:44.028600 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2294/6704] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:43:44.150228 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:43:44.158800 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bbdbdbc1-30a1-4e5e-897b-a6471cb48616 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1562 microversion: 2.1 time: 0.192116 Sep 14 10:43:44.159737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4411/6705] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:43:43 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1562 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:09.418893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:09.419756 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=42 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:09.424409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:09.426606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:09.433902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:09.434372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:09.434820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:09.435508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:09.435989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:09.436414 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:09.497379 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2da09152-7001-4e65-9200-0ac3bea635f8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action" status: 200 len: 24568 microversion: 2.1 time: 0.080370 Sep 14 10:44:09.498035 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2295/6706] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:44:09 2022] POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action => generated 24568 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:44:20.571146 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:20.573243 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:20.575674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:20.576399 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=38 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:20.582079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:20.582577 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:20.583761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:20.584511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:20.584972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:20.585409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:20.627328 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:20.633970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Old instance type m1.heat2, new instance type m1.heat {{(pid=122444) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 14 10:44:20.640642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:44:20.641071 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:44:20.641570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:44:20.641970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:44:20.642387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:44:20.706688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-caf05870-a513-4b39-901f-aaa1bea290d0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action" status: 202 len: 0 microversion: 2.1 time: 0.140333 Sep 14 10:44:20.707630 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4412/6707] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:44:20 2022] POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:44:20.717057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:20.717901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:20.721166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:20.721375 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:44:20.728339 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:20.729100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:20.729544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:20.730251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:20.730793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:20.731225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:20.873856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:20.883002 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0e9a5a72-807a-4a4b-82e0-2f578b62d1f9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1689 microversion: 2.1 time: 0.170217 Sep 14 10:44:20.883588 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2296/6708] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:20 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:21.909120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:21.909746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:21.917192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:21.917904 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:21.918358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:21.919073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:21.919540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:21.920009 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:22.061981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:22.070315 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-15e14284-7f7f-4193-960e-7305fb3c59cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1689 microversion: 2.1 time: 0.166075 Sep 14 10:44:22.070933 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4413/6709] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:21 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:23.094205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:23.094820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:23.102168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:23.102667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:23.103106 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:23.104195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:23.104655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:23.105107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:23.247107 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:23.256051 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8d6aaa0f-12ef-4ab9-ae64-a2f19d8601d3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.165792 Sep 14 10:44:23.256626 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2297/6710] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:23 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:24.280969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:24.281589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:24.289170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:24.289642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:24.290095 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:24.290794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:24.291253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:24.291685 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:24.424920 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:24.433502 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cfd8810e-37ff-4541-96e5-f3de4319d9ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.156545 Sep 14 10:44:24.434084 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4414/6711] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:24 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:25.457225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:25.457750 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:25.465327 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:25.465820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:25.466264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:25.466963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:25.467431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:25.467866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:25.603741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:25.614109 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-57f1094a-17a2-4a01-abb0-5721c535f700 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.160894 Sep 14 10:44:25.614694 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2298/6712] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:25 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:26.638690 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:26.639320 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:26.646247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:26.646746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:26.647203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:26.648282 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:26.648756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:26.649200 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:26.781592 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:26.790282 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6b0e7067-e19f-4263-99bc-e1ee75880022 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.155516 Sep 14 10:44:26.790867 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4415/6713] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:26 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:27.814203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:27.814748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:27.822371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:27.822863 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:27.823304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:27.824046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:27.824507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:27.824941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:27.964587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:27.972339 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2038eb5e-9e40-43a2-88c0-dd5478a82bb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.162078 Sep 14 10:44:27.972922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2299/6714] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:27 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:28.996910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:28.997557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:29.004785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:29.005298 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:29.005788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:29.007057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:29.007542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:29.008041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:29.144605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:29.153200 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56d60e02-af0d-40cb-99ab-887a4c330eca tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.160247 Sep 14 10:44:29.153795 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4416/6715] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:28 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:30.177712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:30.178367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:30.186097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:30.186586 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:30.187028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:30.187740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:30.188233 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:30.188667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:30.325454 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:30.333235 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d131079d-d6c1-4ffc-b30b-70c582682913 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.159425 Sep 14 10:44:30.333882 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2300/6716] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:30 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:31.358063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:31.358698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:31.365820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:31.366395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:31.367051 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:31.367786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:31.368269 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:31.368717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:31.502854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:31.510731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-cde62d79-48cd-4594-ab9d-7fb26b02b016 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.156862 Sep 14 10:44:31.511309 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4417/6717] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:31 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:32.535034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:32.535798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:32.543363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:32.543856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:32.544320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:32.545016 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:32.545467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:32.545890 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:32.689124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:32.697683 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1954cee6-b9ce-45bd-a89e-376f21db893f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.166548 Sep 14 10:44:32.698270 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2301/6718] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:32 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:33.721387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:33.722052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:33.730081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:33.730584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:33.731037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:33.731748 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:33.732249 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:33.732697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:33.872062 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:33.879972 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-20d3e4b4-19d1-4fed-b305-223c91410601 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.162505 Sep 14 10:44:33.880573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4418/6719] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:33 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:34.904287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:34.904895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:34.911786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:34.912489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:34.912933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:34.913628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:34.914086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:34.915056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:35.059822 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:35.067771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-200327a7-0b1d-42ab-b458-63cf41336985 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.167474 Sep 14 10:44:35.068395 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2302/6720] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:34 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:36.091102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:36.091732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:36.098616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:36.099138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:36.099568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:36.100300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:36.100766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:36.101206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:36.236590 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:36.244989 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38d322c3-2b6b-4f09-bfef-e1fb1501558e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.157933 Sep 14 10:44:36.245570 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4419/6721] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:36 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:37.268844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:37.269461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:37.276614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:37.277166 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:37.277613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:37.278614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:37.279080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:37.279665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:37.414118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:37.421996 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fa4ada65-3ccd-447a-a088-6ec32026b6b8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.156968 Sep 14 10:44:37.422508 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2303/6722] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:37 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:38.446775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:38.447324 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:38.454186 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:38.454681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:38.455130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:38.455833 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:38.456323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:38.456766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:38.594444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:38.603176 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9c5cdef9-e02a-4abc-be55-7a87410ded58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.160151 Sep 14 10:44:38.603802 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4420/6723] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:38 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:39.627941 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:39.628563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:39.635766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:39.636294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:39.636732 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:39.637450 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:39.637906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:39.638371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:39.776343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:39.784471 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0b6310a4-ddaf-4be5-9f42-43528c3d27ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1694 microversion: 2.1 time: 0.160449 Sep 14 10:44:39.785054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2304/6724] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:39 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:40.496435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "name": "network-vif-unplugged", "status": "completed", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:40.507745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:40.508901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:40.509914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:40.521850 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Creating event network-vif-unplugged:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h1-851028-12 Sep 14 10:44:40.528252 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122444) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:44:40.543730 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-aeee5a0c-ef0e-4a68-84bb-856cc3fac2db req-35831dfd-63f5-40af-a72d-38bc178741af service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052470 Sep 14 10:44:40.544389 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4421/6725] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:44:40.809324 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:40.809948 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:40.817178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:40.817665 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:40.818108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:40.818811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:40.819269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:40.819697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:41.009283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:41.021490 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1ea2bd12-4169-49ee-be31-5b422754eb4d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1693 microversion: 2.1 time: 0.216035 Sep 14 10:44:41.022706 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2305/6726] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:40 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1693 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:42.049587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:42.050299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:42.059122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:42.059670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:42.060163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:42.060885 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:42.061359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:42.061803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:42.197353 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:42.205444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-29e4f4e3-6bb3-4250-a227-ec69565c08e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1691 microversion: 2.1 time: 0.160486 Sep 14 10:44:42.206039 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4422/6727] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:42 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:42.576676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:42.587858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:42.588365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:42.588802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:42.600406 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Creating event network-changed:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h1-851028-12 Sep 14 10:44:42.606999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-851028-12', 'n-h2-851028-12'} {{(pid=122443) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 14 10:44:42.618098 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-073cf3a4-d72e-4527-9ec8-7be8ba86d559 req-e3bf48dc-df63-4d8f-9f2a-42f413d6e44d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045182 Sep 14 10:44:42.618683 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2306/6728] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:44:43.230082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:43.230717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:43.238454 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.238959 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.239407 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.240402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.240875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.241482 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.405704 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:43.414125 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-db81db41-61e3-43ed-9c2c-3350f7db0afb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1688 microversion: 2.1 time: 0.188710 Sep 14 10:44:43.428176 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4423/6729] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:43 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:43.439244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:43.440157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:43.448062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.448632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.449011 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.449730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.450181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.450614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.512551 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6b19f20b-ae67-4068-ba73-1bfc433639e0 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action" status: 204 len: 0 microversion: 2.1 time: 0.077161 Sep 14 10:44:43.513583 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2307/6730] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:44:43 2022] POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:44:43.521728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:43.522359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:43.530722 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.531613 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.532326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.533280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.533998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.534438 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.698534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:43.707377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-54e4597b-19f0-4a4b-a602-d7905bdcb3a8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1688 microversion: 2.1 time: 0.189636 Sep 14 10:44:43.708030 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4424/6731] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:43 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:43.735859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:43.736603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:43.745329 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.745827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.746269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:43.747475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:43.747969 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:43.748405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:44.307574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:44.315820 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-946cdab3-a85b-47d7-b5a6-7b2cf55cb67b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1688 microversion: 2.1 time: 0.585607 Sep 14 10:44:44.316652 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2308/6732] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:43 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1688 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:44:45.342897 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:44:45.343518 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:44:45.350279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:45.356486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:45.357122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:45.358355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:45.358814 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:45.359410 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:45.401378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "name": "network-vif-plugged", "status": "completed", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:44:45.416245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:44:45.416745 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:44:45.417187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:44:45.428474 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] Creating event network-vif-plugged:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h1-851028-12 Sep 14 10:44:45.434728 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-3f6b4660-0414-4d8b-973d-5764c5fe417a req-5c477281-160c-4cdc-929e-f336326a8d4b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104604 Sep 14 10:44:45.435363 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4425/6733] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:44:45.498996 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:44:45.507094 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f39d66bb-7650-4799-88c2-34f0249faa17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1680 microversion: 2.1 time: 0.168397 Sep 14 10:44:45.507703 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2309/6734] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:44:45 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:45:07.696443 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=32 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:07.697255 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:07.702839 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:07.705183 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:07.712552 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:07.713045 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:07.713492 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:07.714190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:07.714686 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:07.715123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:07.772592 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bf60a82a-9ac0-4fb5-9add-15de15b074ac tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action" status: 200 len: 24570 microversion: 2.1 time: 0.077825 Sep 14 10:45:07.773261 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4426/6735] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:45:07 2022] POST /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303/action => generated 24570 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:45:15.290602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:15.291117 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:15.293626 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=28 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:15.294627 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:15.311301 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:15.312116 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:15.312564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:15.313287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:15.313755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:15.314188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:15.344496 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:45:15.372430 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:15.383943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:15.384263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:15.384718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:15.397737 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] Creating event network-changed:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h1-851028-12 Sep 14 10:45:15.403967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-98755132-e69f-4c0f-b58b-f6772a7d69b0 req-678d75be-532c-4bad-aeba-88711e0c8802 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105919 Sep 14 10:45:15.404647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4427/6736] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:15.436460 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a54145ea-1eb4-4a99-8e08-aeb8d8d1ffa8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 204 len: 0 microversion: 2.1 time: 0.149383 Sep 14 10:45:15.437233 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2310/6737] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:45:15 2022] DELETE /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:45:15.448758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:15.449518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:15.457813 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:15.458330 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:15.459012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:15.459749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:15.460452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:15.460922 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:15.605253 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:15.613903 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-13326eb3-fb36-4ce8-85ba-ac8e33d526d6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1686 microversion: 2.1 time: 0.171380 Sep 14 10:45:15.614497 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4428/6738] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:15 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:16.639112 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:16.639683 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:16.646655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:16.647123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:16.647556 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:16.648270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:16.648716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:16.649136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:16.862174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:16.870517 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7068698e-4881-46a3-8728-0008d46cd8b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 200 len: 1686 microversion: 2.1 time: 0.236518 Sep 14 10:45:16.871104 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2311/6739] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:16 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 1686 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:45:17.420468 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a160996-d0e8-44f1-9e10-6a5884f79303", "name": "network-vif-deleted", "tag": "0d791002-1b19-4dee-82c7-a016c0b05e81"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:17.431150 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:17.431670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:17.432145 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:17.444001 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] Creating event network-vif-deleted:0d791002-1b19-4dee-82c7-a016c0b05e81 for instance 6a160996-d0e8-44f1-9e10-6a5884f79303 on n-h1-851028-12 Sep 14 10:45:17.449288 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-57e1e9e5-e1a9-47d0-8b6e-46e23d472829 req-c36a8650-54b2-4bae-ad53-5e914578751d service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033258 Sep 14 10:45:17.450463 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4429/6740] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:17.895090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:17.895759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 6a160996-d0e8-44f1-9e10-6a5884f79303] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:17.903564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:17.904095 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:17.904726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:17.905238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:17.905697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:17.906155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:17.919999 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] HTTP exception thrown: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Request method failure captured: Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 HTTP/1.1 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa-g3AKQQ_zlQ4ClomJ5EAiFHMty9vFIFmS1j-KiCqczx8HbwEmFzcM4jSFa3BP0e3OfRsDoqdZE1aIUR-I85cjQaVfxLTF48x8zdFM02XzbhdlCI-UwAjqszGtJ-6CxQ6gAor6ocDu5rNFOB2DmoeRJTdd4iList8NqhheODQxDiY0 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4710865cab4841e291ac02e1b9e23506", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4710865cab4841e291ac02e1b9e23506"}]}] Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ecca4d696f924555a5af00d9b2e08da7 Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '6a160996-d0e8-44f1-9e10-6a5884f79303'} Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:45:17.921657 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Returning 404 to user: Instance 6a160996-d0e8-44f1-9e10-6a5884f79303 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f695be5b-d660-43f2-b840-ab21456b0335 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303" status: 404 len: 111 microversion: 2.1 time: 0.031974 Sep 14 10:45:17.926933 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2312/6741] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:17 2022] GET /compute/v2.1/servers/6a160996-d0e8-44f1-9e10-6a5884f79303 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:45:20.978585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-17a558d2-6329-4ebb-92df-3b46e41ba32f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '.version_select at 0x7f693dda0550>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:21.001220 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-17a558d2-6329-4ebb-92df-3b46e41ba32f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-97184005" status: 202 len: 0 microversion: 2.1 time: 0.027872 Sep 14 10:45:21.001950 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4430/6742] 10.222.0.90 () {58 vars in 1278 bytes} [Wed Sep 14 10:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-97184005 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:45:21.031821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-695915ac-0f19-4ece-8fdb-fcaaef51fb43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: .version_select at 0x7f693f26eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2147343380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAa92qO5xho+oXeD2Y+NcqzhQowmCPN/Ab/8WH8DYT/DAykkawy56YAmLh//km8cjcorKSQXFRv/ZIDpouZMm/N7KzHHcq+xOqhNrxUVmOqRecq/KmRV6JWO0FA1ySSMyA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:21.048593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-695915ac-0f19-4ece-8fdb-fcaaef51fb43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:45:21.055886 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-695915ac-0f19-4ece-8fdb-fcaaef51fb43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:45:21.082131 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-695915ac-0f19-4ece-8fdb-fcaaef51fb43 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055275 Sep 14 10:45:21.082752 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2313/6743] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:45:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:26.832081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1991960478", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "4889c802-8166-498f-8986-10a3d39885ae"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2147343380", "security_groups": [{"name": "tempest-secgroup-smoke-96864870"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:27.029638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] validate_networks() for [('4889c802-8166-498f-8986-10a3d39885ae', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:45:27.437724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=14 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:27.464174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:45:27.465015 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:45:27.465689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:45:27.466347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:45:27.466820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:45:27.477523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:27.478020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:27.478467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:27.479664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:27.484388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:27.484803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:27.505135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:45:27.510536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:45:27.523411 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:45:27.526017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:45:27.575654 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bdf854ae-7aee-4961-9c9d-cfab01e324d4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.749474 Sep 14 10:45:27.576361 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4431/6744] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:45:26 2022] POST /compute/v2.1/servers => generated 404 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:45:27.587602 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4c2a62f2-6c7c-48cd-9979-09172d6d6c68 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:27.588234 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4c2a62f2-6c7c-48cd-9979-09172d6d6c68 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:27.647860 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4c2a62f2-6c7c-48cd-9979-09172d6d6c68 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:27.663966 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4c2a62f2-6c7c-48cd-9979-09172d6d6c68 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1267 microversion: 2.1 time: 0.072170 Sep 14 10:45:27.663966 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2314/6745] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:27 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:28.686742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:28.689673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:28.702499 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:28.703447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:28.704116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:28.705383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:28.706035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:28.706789 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:28.818872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:28.831872 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c539ad81-ab61-46d3-b5f4-653d1a5e8ae4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1337 microversion: 2.1 time: 0.152943 Sep 14 10:45:28.832647 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4432/6746] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:28 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1337 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:45:29.855366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:29.856669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:29.858715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:29.869430 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:29.869942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:29.870440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:29.871163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:29.875292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:29.876035 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:30.130772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:30.141472 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-51293e5c-f586-47de-b942-03e7b8aba2e2 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.290643 Sep 14 10:45:30.156265 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2315/6747] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:29 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:30.357956 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7061c3-ef38-4fb2-b75e-a6046c6e6912", "tag": "a78e7d49-e163-45f5-afae-7fb34e7e93d3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:30.377485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:30.378480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:30.379144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:30.399751 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] Creating event network-changed:a78e7d49-e163-45f5-afae-7fb34e7e93d3 for instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 on n-h2-851028-12 Sep 14 10:45:30.406791 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-96aa86d4-24e6-4bdb-a26c-23254bc8bae0 req-2b5d6294-d306-4c97-a84d-4b2da3b2fa01 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053575 Sep 14 10:45:30.407885 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4433/6748] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:31.170979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:31.171999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:31.179127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:31.179621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:31.180097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:31.180805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:31.181265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:31.181698 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:31.317773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:31.325889 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5c15ea61-d8ab-4854-8c7f-f485e158269e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.162197 Sep 14 10:45:31.326497 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2316/6749] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:31 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:32.350782 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:32.352968 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:32.361396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:32.361912 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:32.362595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:32.363326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:32.363802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:32.364279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:32.515501 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:32.523621 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43ead055-937c-474d-83cd-380b64f08c7e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.177736 Sep 14 10:45:32.524255 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4434/6750] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:32 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:33.547084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:33.547768 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:33.554963 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:33.555446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:33.555879 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:33.556595 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:33.557043 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:33.557467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:33.695197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:33.703054 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6cd3e9da-1c7c-4f7e-9014-5fb084fa7f22 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.160038 Sep 14 10:45:33.703669 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2317/6751] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:33 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:34.775433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:34.776201 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:34.785193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:34.785891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:34.786359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:34.787135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:34.787615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:34.788606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:34.928979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:34.938978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a92ca6c3-7b2f-4188-8dfc-875a1779feb9 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.215851 Sep 14 10:45:34.939668 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4435/6752] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:34 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:35.962593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:35.963199 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:35.970377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:35.970858 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:35.971294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:35.972006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:35.972456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:35.972876 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:36.106666 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:36.114469 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8f1c5b09-3931-440f-9623-a2d619994694 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.155795 Sep 14 10:45:36.115109 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2318/6753] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:35 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:45:36.432132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7061c3-ef38-4fb2-b75e-a6046c6e6912", "name": "network-vif-plugged", "status": "completed", "tag": "a78e7d49-e163-45f5-afae-7fb34e7e93d3"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:36.445261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:36.445765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:36.446756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:36.458900 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] Creating event network-vif-plugged:a78e7d49-e163-45f5-afae-7fb34e7e93d3 for instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 on n-h2-851028-12 Sep 14 10:45:36.464171 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-4a55320b-02c2-44d5-9041-d5c79723b129 req-29f7faea-4920-4d76-8153-1a16cab5fee1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Sep 14 10:45:36.465171 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4436/6754] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:37.138727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:37.139360 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:37.146226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:37.146707 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:37.147140 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:37.147824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:37.148319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:37.148743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:37.286122 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:37.294623 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0167c4d6-bc9b-4f45-ace1-f66253eeefc4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1391 microversion: 2.1 time: 0.159823 Sep 14 10:45:37.295213 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2319/6755] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:37 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:38.319285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:38.320028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:38.322828 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:38.323516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:38.324540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:38.331048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:38.331553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:38.332031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:38.332750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:38.333219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:38.333660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:38.473337 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:38.481452 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e46ffb3a-426e-4d22-9f93-4829c5769740 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1563 microversion: 2.1 time: 0.166474 Sep 14 10:45:38.482036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4437/6756] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:38 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:38.503181 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:38.503790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:38.505700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:45:38.511611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:38.512650 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:38.513090 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:38.513784 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:38.514235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:38.514657 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:38.646291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:38.654158 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0d3292ec-2746-48f1-9277-1ac0a41537ea tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1563 microversion: 2.1 time: 0.154836 Sep 14 10:45:38.654729 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2320/6757] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:38 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:45:40.605998 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:45:40.606827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:45:40.608630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7061c3-ef38-4fb2-b75e-a6046c6e6912", "tag": "a78e7d49-e163-45f5-afae-7fb34e7e93d3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:45:40.613619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:40.620110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:40.620841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:40.622136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:40.623825 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:40.624350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:40.625126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:45:40.625797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:45:40.626245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:45:40.637749 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] Creating event network-changed:a78e7d49-e163-45f5-afae-7fb34e7e93d3 for instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 on n-h2-851028-12 Sep 14 10:45:40.643754 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-26dcf005-bc58-4ac4-af31-d050f746b416 req-1ab57eef-e2b0-43ec-9447-fc72092598eb service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040183 Sep 14 10:45:40.645098 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2321/6758] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:45:40.796431 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:45:40.805601 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bdcbd37f-b277-4fcb-a41a-c4238827cc79 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1563 microversion: 2.1 time: 0.204280 Sep 14 10:45:40.806321 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4438/6759] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:45:40 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1563 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:06.072287 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:06.073040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=38 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:06.077325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:46:06.079566 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:06.087263 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:06.087748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:06.088214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:06.088910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:06.089361 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:06.089780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:06.148093 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d5e18664-679a-4857-b182-80ae734ab18a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action" status: 200 len: 24567 microversion: 2.1 time: 0.077607 Sep 14 10:46:06.148787 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2322/6760] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:46:06 2022] POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:46:17.131861 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:46:17.136379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:17.138318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=36 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:17.149000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:17.149693 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:17.150283 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:17.174572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Going to try to stop instance {{(pid=122444) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 14 10:46:17.225505 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0568b09-46d5-4a31-8d2d-a185d4a6c3fd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action" status: 202 len: 0 microversion: 2.1 time: 0.097752 Sep 14 10:46:17.226305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4439/6761] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:46:17 2022] POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:46:17.236392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:17.237254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:17.240812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:17.241468 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:17.246531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:17.247393 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:17.247846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:17.248705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:17.249197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:17.249606 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:17.412475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:17.420998 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dfbab123-f8c1-4338-afa7-11d81dd85f0e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.189881 Sep 14 10:46:17.421571 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2323/6762] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:17 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:18.446237 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:18.446868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:18.455341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:18.455849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:18.456334 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:18.457052 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:18.457526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:18.457974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:18.600681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:18.609077 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4c724ddf-3bdb-416a-87c0-eca3caad37b1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.167198 Sep 14 10:46:18.609671 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4440/6763] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:18 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:19.633736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:19.634356 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:19.641553 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:19.642028 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:19.642471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:19.643162 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:19.643613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:19.644076 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:19.782767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:19.791771 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4a7f46f7-ec83-4475-a4e0-6a49f6fe8396 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.161977 Sep 14 10:46:19.792379 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2324/6764] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:19 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:20.816504 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:20.817126 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:20.824205 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:20.825301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:20.825755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:20.826472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:20.826941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:20.827373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:21.272951 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:21.281265 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-47694166-f01d-4efb-8e92-3e259eefc85e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.468665 Sep 14 10:46:21.281845 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4441/6765] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:20 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:22.305946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:22.306584 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:22.313787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:22.314278 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:22.314717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:22.315415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:22.315872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:22.316325 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:22.456277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:22.465447 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e75cf64-50fa-4d6d-92df-36bc071a9a09 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.162953 Sep 14 10:46:22.466175 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2325/6766] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:22 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:23.490857 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:23.491517 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:23.499932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:23.500713 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:23.501214 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:23.502091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:23.502568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:23.503039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:23.641244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:23.649313 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-482734e1-12fb-4e78-bc38-39d4f98d0849 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.162477 Sep 14 10:46:23.649896 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4442/6767] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:23 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:46:24.673874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:24.674736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:24.681590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:24.682072 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:24.682515 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:24.683205 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:24.684253 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:24.684998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:24.827218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:24.835817 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a89e789-52df-4f95-ae37-238729a17cee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.165753 Sep 14 10:46:24.836448 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2326/6768] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:24 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:25.860620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:25.861397 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:25.868378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:25.868883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:25.869333 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:25.870050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:25.870523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:25.870960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:26.025459 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:26.033874 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-eabd0e80-1c1b-47de-9d28-e9c0809c49de tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.177285 Sep 14 10:46:26.034459 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4443/6769] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:25 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:46:27.057718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:27.058337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:27.065598 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:27.066091 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:27.066531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:27.067227 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:27.067684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:27.068141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:27.200988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:27.208700 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c4e8e103-be6d-41d9-85c7-aa0322a66d32 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1692 microversion: 2.1 time: 0.154954 Sep 14 10:46:27.209274 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2327/6770] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:27 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:28.233057 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:28.233694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:28.241865 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:28.242373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:28.242830 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:28.243542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:28.244048 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:28.244493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:28.386261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:28.394353 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-82fa70f1-c0d5-4688-bf71-6ba88936e4bd tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1669 microversion: 2.1 time: 0.165656 Sep 14 10:46:28.394925 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4444/6771] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:28 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:29.493236 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:46:29.495446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:29.502629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:29.503113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:29.503563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:29.504289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:29.504749 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:29.505180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:29.557581 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2b3b9183-71db-4edc-a3ad-81a41b1a28fa tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action" status: 200 len: 38402 microversion: 2.1 time: 0.068081 Sep 14 10:46:29.558225 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2328/6772] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:46:29 2022] POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action => generated 38402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:46:29.570970 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:46:29.578667 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:29.579181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:29.579645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:29.602422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Going to try to start instance {{(pid=122444) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 14 10:46:29.645219 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-871c5bfe-d757-4671-935d-e1a38ac2bfe8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action" status: 202 len: 0 microversion: 2.1 time: 0.077802 Sep 14 10:46:29.645833 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4445/6773] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:46:29 2022] POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:46:29.655242 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:29.655967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:29.663175 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:29.663772 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:29.664243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:29.664954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:29.665435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:29.665864 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:29.903335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:29.911546 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1281af1f-4589-4c2f-9566-f7f5a2de2fb3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1678 microversion: 2.1 time: 0.261109 Sep 14 10:46:29.912178 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2329/6774] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:29 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:30.936775 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:46:30.937494 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:30.944772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:30.945273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:30.945723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:30.946432 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:30.946900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:30.947342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:31.083261 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:46:31.092112 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-701e6b8d-0768-4e2c-aae7-24f7dda9db99 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1682 microversion: 2.1 time: 0.159822 Sep 14 10:46:31.092694 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4446/6775] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:46:30 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:46:57.292894 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:46:57.295080 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:46:57.297954 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=14 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:57.298630 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=40 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:46:57.306726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:57.307215 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:57.307691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:57.308617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:46:57.309084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:46:57.310196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:46:57.362452 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40d6f1e1-b2fc-4077-9c16-c57fa2e7fa8d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action" status: 200 len: 62954 microversion: 2.1 time: 0.073467 Sep 14 10:46:57.363120 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2330/6776] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:46:57 2022] POST /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912/action => generated 62954 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:47:04.411675 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:04.412437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:04.414472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=16 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:04.415163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:04.415882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7061c3-ef38-4fb2-b75e-a6046c6e6912", "tag": "a78e7d49-e163-45f5-afae-7fb34e7e93d3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:04.427579 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:04.428459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:04.428800 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:04.430317 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:04.431224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:04.432386 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:04.433755 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:04.434822 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:04.435361 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:04.443752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] Creating event network-changed:a78e7d49-e163-45f5-afae-7fb34e7e93d3 for instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 on n-h2-851028-12 Sep 14 10:47:04.449749 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-ade4558b-1074-403f-a0ee-d2ee3eb0e100 req-f6c91af8-88fa-4af9-b36f-123a1833cc84 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038390 Sep 14 10:47:04.450366 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2331/6777] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:47:04.468606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:47:04.562420 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-bb2329be-750f-412a-8693-e256e31d56e4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 204 len: 0 microversion: 2.1 time: 0.154822 Sep 14 10:47:04.563445 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4447/6778] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:47:04 2022] DELETE /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:47:04.572820 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:04.574247 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:04.581142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:04.581779 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:04.582321 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:04.583193 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:04.584015 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:04.584912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:04.785443 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:04.794044 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-02fe36fd-4af5-4802-ab85-1b6b8c3e1bd5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1688 microversion: 2.1 time: 0.225940 Sep 14 10:47:04.794725 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2332/6779] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:04 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1688 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:47:05.819696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:05.820441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:05.828196 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:05.828718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:05.829157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:05.829874 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:05.830346 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:05.830795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:05.974436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:05.983942 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-aa7e5c0e-2409-4298-98d3-c788406aba4e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1688 microversion: 2.1 time: 0.168499 Sep 14 10:47:05.984518 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4448/6780] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:05 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:06.703103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7061c3-ef38-4fb2-b75e-a6046c6e6912", "name": "network-vif-deleted", "tag": "a78e7d49-e163-45f5-afae-7fb34e7e93d3"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:06.713654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:06.714680 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:06.715256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:06.730368 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] Creating event network-vif-deleted:a78e7d49-e163-45f5-afae-7fb34e7e93d3 for instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 on n-h2-851028-12 Sep 14 10:47:06.736334 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-8bfb9414-8bc4-454b-8d1b-e0743887f701 req-5a15f9cf-cbe5-4bf7-9805-736340ab61da service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036968 Sep 14 10:47:06.736984 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2333/6781] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:47:07.007703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:07.008383 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:07.016889 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:07.017409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:07.017866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:07.018598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:07.019072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:07.019516 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:07.054619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:07.055131 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:07.055595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:07.056102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lazy-loading 'fault' on Instance uuid aa7061c3-ef38-4fb2-b75e-a6046c6e6912 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:47:07.102035 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:07.110967 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7d85b1ef-5290-4c20-bdf3-e1f5d913b2c1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 200 len: 1357 microversion: 2.1 time: 0.107140 Sep 14 10:47:07.111566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4449/6782] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:07 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:08.135585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:08.136594 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: aa7061c3-ef38-4fb2-b75e-a6046c6e6912] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:08.143765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:08.144312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:08.144747 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:08.145435 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:08.145884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:08.146320 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:08.160280 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] HTTP exception thrown: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Request method failure captured: Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 HTTP/1.1 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa-g3AKQQ_zlQ4ClomJ5EAiFHMty9vFIFmS1j-KiCqczx8HbwEmFzcM4jSFa3BP0e3OfRsDoqdZE1aIUR-I85cjQaVfxLTF48x8zdFM02XzbhdlCI-UwAjqszGtJ-6CxQ6gAor6ocDu5rNFOB2DmoeRJTdd4iList8NqhheODQxDiY0 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4710865cab4841e291ac02e1b9e23506", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4710865cab4841e291ac02e1b9e23506"}]}] Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ecca4d696f924555a5af00d9b2e08da7 Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'aa7061c3-ef38-4fb2-b75e-a6046c6e6912'} Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:47:08.161972 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Returning 404 to user: Instance aa7061c3-ef38-4fb2-b75e-a6046c6e6912 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fe677365-7600-4e16-a219-b1bde6c0e63c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912" status: 404 len: 111 microversion: 2.1 time: 0.032022 Sep 14 10:47:08.168330 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2334/6783] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:08 2022] GET /compute/v2.1/servers/aa7061c3-ef38-4fb2-b75e-a6046c6e6912 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:47:11.651947 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-90912ef8-64d6-48ff-bdeb-8a8b9a2b8ac3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '.version_select at 0x7f693e1e3a60>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:11.680931 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-90912ef8-64d6-48ff-bdeb-8a8b9a2b8ac3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2147343380" status: 202 len: 0 microversion: 2.1 time: 0.033123 Sep 14 10:47:11.682267 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4450/6784] 10.222.0.90 () {58 vars in 1284 bytes} [Wed Sep 14 10:47:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2147343380 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 14 10:47:11.718935 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7ea10d00-fdff-4fee-9e97-d2e1a3d754bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: .version_select at 0x7f693f272670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-293209447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxzMEPS4Xy5tNOxz0N4P8gTRt+7hHL0hfoUhokhg7Qnd2JBmZorGnIjlAx4pBC+s2LFZHv5c31764wljG//synyf6yBD+Y1kXL6Eml8pZ0rzJFkp6noUvAMwM8TSVWHzA=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:11.737573 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-7ea10d00-fdff-4fee-9e97-d2e1a3d754bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:47:11.742812 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-7ea10d00-fdff-4fee-9e97-d2e1a3d754bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:47:11.768721 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7ea10d00-fdff-4fee-9e97-d2e1a3d754bb tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053831 Sep 14 10:47:11.769337 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2335/6785] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:47:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:47:17.445120 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:17.450723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1815917955", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "networks": [{"uuid": "8c485d47-97f9-490e-8f1a-7c00caac2e8d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-293209447", "security_groups": [{"name": "tempest-secgroup-smoke-191084303"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:17.578246 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] validate_networks() for [('8c485d47-97f9-490e-8f1a-7c00caac2e8d', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:47:18.085264 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:47:18.085714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:47:18.086235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:47:18.086923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:47:18.087364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:47:18.103491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:18.109983 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:18.110570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:18.111422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:18.111935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:18.112420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:18.142892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:47:18.149258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Getting quotas for user ecca4d696f924555a5af00d9b2e08da7 and project 4710865cab4841e291ac02e1b9e23506. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:47:18.166528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:47:18.170932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:47:18.240339 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e631e618-6164-4eed-a976-49dc25ae068a tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.797005 Sep 14 10:47:18.248093 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4451/6786] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:47:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:47:18.254084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-15f55ff5-c6f2-452b-9eb2-915d3a94a8cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:18.254882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-15f55ff5-c6f2-452b-9eb2-915d3a94a8cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:18.264979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=16 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:18.325184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-15f55ff5-c6f2-452b-9eb2-915d3a94a8cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:18.334292 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-15f55ff5-c6f2-452b-9eb2-915d3a94a8cc tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1266 microversion: 2.1 time: 0.083868 Sep 14 10:47:18.336913 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2336/6787] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:18 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:19.360554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ddd03e2-bf3e-40e6-a663-63080a4b8ba1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:19.361382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ddd03e2-bf3e-40e6-a663-63080a4b8ba1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:19.426446 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ddd03e2-bf3e-40e6-a663-63080a4b8ba1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:19.433995 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ddd03e2-bf3e-40e6-a663-63080a4b8ba1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1266 microversion: 2.1 time: 0.079262 Sep 14 10:47:19.434774 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4452/6788] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:19 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:20.458058 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-545e9cfb-d397-4809-8c47-38eb913fcf58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:20.458691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-545e9cfb-d397-4809-8c47-38eb913fcf58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:20.525437 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-545e9cfb-d397-4809-8c47-38eb913fcf58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:20.533591 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-545e9cfb-d397-4809-8c47-38eb913fcf58 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1266 microversion: 2.1 time: 0.079896 Sep 14 10:47:20.534401 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2337/6789] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:20 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:21.571793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-51e32ce8-8e0d-400c-81b7-b7979718fc5c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:21.574699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-51e32ce8-8e0d-400c-81b7-b7979718fc5c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:21.638870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-51e32ce8-8e0d-400c-81b7-b7979718fc5c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:21.647841 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-51e32ce8-8e0d-400c-81b7-b7979718fc5c tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1266 microversion: 2.1 time: 0.083647 Sep 14 10:47:21.648722 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4453/6790] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:21 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:22.672189 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:22.672792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:22.678781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:22.679267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:22.679711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:22.680442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:22.680912 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:22.681346 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:22.746743 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:22.754480 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3eb6e9ce-afe0-4916-8ca6-b94102ceb55e tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1270 microversion: 2.1 time: 0.087875 Sep 14 10:47:22.755061 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2338/6791] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:22 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:23.778014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:23.778641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:23.785913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:23.786422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:23.786900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:23.787614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:23.788122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:23.788571 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:23.864262 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:23.872471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b37e8abf-a2e9-4bd8-982b-af9523b27943 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1324 microversion: 2.1 time: 0.099151 Sep 14 10:47:23.873559 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4454/6792] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:23 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1324 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:47:24.867029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324c5ff3-4874-4fb4-8fd6-56efe283ce35", "tag": "652a4f1a-5432-4914-aa84-772a5a879e64"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:24.878428 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:24.879198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:24.879806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:24.896761 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:24.897379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:24.906332 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:24.906852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:24.907311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:24.908081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:24.908563 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:24.909014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:24.915275 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] Creating event network-changed:652a4f1a-5432-4914-aa84-772a5a879e64 for instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 on n-h1-851028-12 Sep 14 10:47:24.921014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9c4da3f1-9350-4092-9c0e-692aca013be4 req-17b42924-2084-4b7c-adb0-c12ad5757444 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057643 Sep 14 10:47:24.923071 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2339/6793] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:47:25.144089 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:25.152202 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3e02f395-3749-43ab-9ad7-71c97f03cc42 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.259382 Sep 14 10:47:25.152800 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4455/6794] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:24 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:26.177438 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:26.178134 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:26.184687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:26.185174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:26.185612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:26.186315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:26.186770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:26.187196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:26.324459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:26.333884 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3051a625-0001-4f72-93b9-374ce63b04ee tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.161441 Sep 14 10:47:26.334673 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2340/6795] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:26 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:27.361393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:27.361393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:27.367623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:27.368166 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:27.368634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:27.369362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:27.369840 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:27.370280 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:27.558417 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:27.571326 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b608417b-400a-493b-84da-c2147bf7574b tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.218158 Sep 14 10:47:27.572005 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4456/6796] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:27 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:28.597377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:28.597377 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:28.599877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:28.605551 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:28.606039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:28.606478 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:28.607243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:28.607774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:28.608225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:28.759572 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:28.768856 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ee35b2cd-39a7-47a0-af44-628971ba93cf tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.176356 Sep 14 10:47:28.769466 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2341/6797] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:28 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:29.792964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:29.793638 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:29.796831 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:29.805387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:29.806116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:29.806669 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:29.807696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:29.808224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:29.808868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:29.976723 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:29.984952 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324c5ff3-4874-4fb4-8fd6-56efe283ce35", "name": "network-vif-plugged", "status": "completed", "tag": "652a4f1a-5432-4914-aa84-772a5a879e64"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:29.986016 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-337baa43-8360-4f1d-8db5-c405f6426458 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.197061 Sep 14 10:47:29.986828 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4457/6798] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:29 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:29.996753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:29.997399 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:29.998257 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:30.011014 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] Creating event network-vif-plugged:652a4f1a-5432-4914-aa84-772a5a879e64 for instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 on n-h1-851028-12 Sep 14 10:47:30.016309 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-13756c20-9433-4fcb-a050-33c03236bf23 req-2f65456f-953d-4e25-9d12-3d2e08305938 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035966 Sep 14 10:47:30.017259 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2342/6799] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:47:31.009642 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:31.010273 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:31.018038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:31.018545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:31.018987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:31.019715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:31.020215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:31.020656 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:31.167083 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:31.175994 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-6bd34c33-034a-416b-8af4-70e2b6aa9289 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1391 microversion: 2.1 time: 0.170241 Sep 14 10:47:31.176593 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4458/6800] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:31 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:32.202103 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:32.202829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:32.206365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=8 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:32.213541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:32.214022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:32.214457 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:32.215159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:32.215611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:32.216088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:32.366590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:32.374622 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-223f1e94-4286-4e13-bc03-a89b066deb30 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1563 microversion: 2.1 time: 0.178027 Sep 14 10:47:32.375219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2343/6801] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:32 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:32.399926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:32.400783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:32.402733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:32.409820 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:32.410336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:32.411047 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:32.411780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:32.412284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:32.412731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:32.557623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:32.566168 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-33e7ccc3-7054-4ca7-bd37-07a7477cbdc6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1563 microversion: 2.1 time: 0.170272 Sep 14 10:47:32.566750 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4459/6802] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:32 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:34.619644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:47:34.620291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:34.622521 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324c5ff3-4874-4fb4-8fd6-56efe283ce35", "tag": "652a4f1a-5432-4914-aa84-772a5a879e64"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:34.628283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:34.629129 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:34.630153 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:34.630623 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:34.631163 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:34.631467 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:34.631806 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:34.636582 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:34.637098 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:34.637551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:34.655026 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] Creating event network-changed:652a4f1a-5432-4914-aa84-772a5a879e64 for instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 on n-h1-851028-12 Sep 14 10:47:34.661709 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-a96465cb-9496-4913-9431-80994e428fc3 req-8eb6c31e-00ff-4bd5-a049-60ee1c6e4f17 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042614 Sep 14 10:47:34.662373 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4460/6803] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:47:34.797062 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:47:34.810305 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-276f8b65-9997-4eb6-b540-30bda6294392 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1563 microversion: 2.1 time: 0.194425 Sep 14 10:47:34.811099 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2344/6804] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:47:34 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:47:57.141657 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:47:57.144026 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:47:57.147750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=40 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:47:57.152793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:57.153300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:57.153757 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:57.154476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:47:57.154952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:47:57.155396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:47:57.211622 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-89507e8d-d1c0-4aba-b4e9-3f97ad933eb8 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action" status: 200 len: 24573 microversion: 2.1 time: 0.075150 Sep 14 10:47:57.212346 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4461/6805] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:47:57 2022] POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action => generated 24573 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:48:03.549926 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:03.550530 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:03.552722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=7 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:03.554397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=34 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:03.560419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:03.560959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:03.561402 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:03.562108 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:03.562564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:03.562997 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:03.586486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lazy-loading 'flavor' on Instance uuid 324c5ff3-4874-4fb4-8fd6-56efe283ce35 {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:48:03.654987 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-45ad3eb6-31a2-4b62-b40c-eaaca48883a5 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action" status: 202 len: 0 microversion: 2.1 time: 0.109068 Sep 14 10:48:03.658685 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2345/6806] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:48:03 2022] POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:48:03.665020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:03.665766 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:03.673256 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:03.673786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:03.674203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:03.674916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:03.675379 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:03.675816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:03.814144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:03.822537 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36ae4f50-9c1d-433e-a3fe-e358e4b747a3 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1690 microversion: 2.1 time: 0.162363 Sep 14 10:48:03.823124 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4462/6807] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:03 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:04.849024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:04.850285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:04.856803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:04.857289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:04.857727 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:04.858419 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:04.858873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:04.859306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:05.001476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:05.009848 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ac1f3aef-24a3-4489-a910-e78ae97736be tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1673 microversion: 2.1 time: 0.166181 Sep 14 10:48:05.010431 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2346/6808] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:04 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:06.110581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:06.112932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:06.122561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.123078 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.123591 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.124349 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.124836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.125286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.179218 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ae217c6e-054b-4f03-9ecc-7d402026e1f6 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action" status: 200 len: 35417 microversion: 2.1 time: 0.072520 Sep 14 10:48:06.179978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4463/6809] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:48:06 2022] POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action => generated 35417 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:48:06.191764 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:06.192311 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:06.200094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.200585 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.201022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.201723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.202174 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.202600 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.272575 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3868b609-957a-4a99-afcb-d86f831a580d tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action" status: 202 len: 0 microversion: 2.1 time: 0.083785 Sep 14 10:48:06.273531 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2347/6810] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:48:06 2022] POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:48:06.282635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:06.283448 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:06.291599 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.292293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.292750 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.293497 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:06.294027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:06.294475 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:06.523082 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:06.531131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d9a95ec-595a-4173-abd7-9ec55ee37679 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1679 microversion: 2.1 time: 0.252830 Sep 14 10:48:06.531943 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4464/6811] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:06 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:07.558748 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:07.559491 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:07.565765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:07.566249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:07.566684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:07.567376 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:07.567831 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:07.568298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:07.713786 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:07.721734 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5e06eb8d-7153-4bbc-ae7a-a01313286dc7 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1679 microversion: 2.1 time: 0.169959 Sep 14 10:48:07.722328 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2348/6812] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:07 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:08.747749 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:08.748402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:08.755406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:08.755914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:08.756377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:08.757220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:08.757850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:08.758289 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:08.897716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:08.905692 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-38c3b970-f28b-43ff-9521-07b00ca9e021 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1682 microversion: 2.1 time: 0.161921 Sep 14 10:48:08.906277 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4465/6813] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:08 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:09.003160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:09.005302 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:09.012281 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:09.012770 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:09.013210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:09.013902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:09.014357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:09.014792 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:09.057308 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f504ec14-7eca-4f48-a2db-b8f678f28e77 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action" status: 200 len: 35417 microversion: 2.1 time: 0.058125 Sep 14 10:48:09.057950 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2349/6814] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:48:08 2022] POST /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35/action => generated 35417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 14 10:48:10.136724 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:10.137257 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:10.139328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324c5ff3-4874-4fb4-8fd6-56efe283ce35", "tag": "652a4f1a-5432-4914-aa84-772a5a879e64"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:10.143982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:10.144486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:10.144937 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:10.145648 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:10.146111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:10.146932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:10.152070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:10.152633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:10.153286 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:10.174796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:48:10.175317 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] Creating event network-changed:652a4f1a-5432-4914-aa84-772a5a879e64 for instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 on n-h1-851028-12 Sep 14 10:48:10.181297 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-39e57c26-d850-4766-a503-58e727696cbd req-1542900c-97c6-4dd8-a612-480e3f38d268 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046252 Sep 14 10:48:10.182338 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2350/6815] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:48:10.272581 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-56acea6e-5836-4d4c-b4bb-91b5d8e4889f tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 204 len: 0 microversion: 2.1 time: 0.139661 Sep 14 10:48:10.273641 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4466/6816] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:48:10 2022] DELETE /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:48:10.283569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:10.284508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:10.295988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:10.296610 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:10.297157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:10.297968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:10.298501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:10.299005 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:10.442293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:10.450972 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d38b54d2-1a66-4f3c-833f-1ba7fd38ef17 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1688 microversion: 2.1 time: 0.172223 Sep 14 10:48:10.451711 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2351/6817] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:10 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:11.477832 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:11.478556 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:11.485763 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:11.486270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:11.486727 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:11.487441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:11.487950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:11.488388 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:11.625364 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:11.633979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0fcf2437-ff6d-4956-a01b-d9b448678ad4 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1688 microversion: 2.1 time: 0.161156 Sep 14 10:48:11.634572 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4467/6818] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:11 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:12.417008 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324c5ff3-4874-4fb4-8fd6-56efe283ce35", "name": "network-vif-deleted", "tag": "652a4f1a-5432-4914-aa84-772a5a879e64"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:12.427976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:12.428469 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:12.429580 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:12.441370 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] Creating event network-vif-deleted:652a4f1a-5432-4914-aa84-772a5a879e64 for instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 on n-h1-851028-12 Sep 14 10:48:12.447284 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-147fc156-0554-4e6b-a7bf-4dabdeb755aa req-8f3fe8df-38dd-4645-ad5c-1e919a1ed0a4 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Sep 14 10:48:12.447917 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2352/6819] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:48:12.657751 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:12.658382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:12.667014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:12.667526 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:12.668211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:12.668945 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:12.669416 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:12.669856 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:12.705483 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:12.705982 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:12.706434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:12.706901 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lazy-loading 'fault' on Instance uuid 324c5ff3-4874-4fb4-8fd6-56efe283ce35 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:48:12.754905 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecca4d696f924555a5af00d9b2e08da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4710865cab4841e291ac02e1b9e23506', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:12.764454 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-004b8842-745a-4675-abab-eefcfa7ed1f1 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 200 len: 1356 microversion: 2.1 time: 0.110566 Sep 14 10:48:12.765056 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4468/6820] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:12 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:13.790052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:13.790765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] [instance: 324c5ff3-4874-4fb4-8fd6-56efe283ce35] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:13.799796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:13.800313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:13.800755 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:13.801485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:13.801946 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:13.802372 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:13.820810 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] HTTP exception thrown: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Request method failure captured: Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 HTTP/1.1 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIa-g3AKQQ_zlQ4ClomJ5EAiFHMty9vFIFmS1j-KiCqczx8HbwEmFzcM4jSFa3BP0e3OfRsDoqdZE1aIUR-I85cjQaVfxLTF48x8zdFM02XzbhdlCI-UwAjqszGtJ-6CxQ6gAor6ocDu5rNFOB2DmoeRJTdd4iList8NqhheODQxDiY0 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_4710865cab4841e291ac02e1b9e23506", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/4710865cab4841e291ac02e1b9e23506"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/4710865cab4841e291ac02e1b9e23506"}]}] Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 4710865cab4841e291ac02e1b9e23506 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-895159475 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: ecca4d696f924555a5af00d9b2e08da7 Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestNetworkAdvancedServerOps-895159475-project Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '324c5ff3-4874-4fb4-8fd6-56efe283ce35'} Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:48:13.822549 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Returning 404 to user: Instance 324c5ff3-4874-4fb4-8fd6-56efe283ce35 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d7864240-b208-462a-bf53-f484344b5394 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35" status: 404 len: 111 microversion: 2.1 time: 0.039245 Sep 14 10:48:13.827977 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2353/6821] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:13 2022] GET /compute/v2.1/servers/324c5ff3-4874-4fb4-8fd6-56efe283ce35 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:48:16.999838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d4737d11-2a4f-456a-86d3-0c1cfca70990 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] Calling method '.version_select at 0x7f693dd378b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:17.027979 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d4737d11-2a4f-456a-86d3-0c1cfca70990 tempest-TestNetworkAdvancedServerOps-895159475 tempest-TestNetworkAdvancedServerOps-895159475-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-293209447" status: 202 len: 0 microversion: 2.1 time: 0.032859 Sep 14 10:48:17.028762 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4469/6822] 10.222.0.90 () {58 vars in 1281 bytes} [Wed Sep 14 10:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-293209447 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:48:29.103209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=18 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:29.104147 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:29.292344 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a041c054-49eb-42d4-8a2c-73b635703c01 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'create', calling method: .version_select at 0x7f693f26e040>, body: {"keypair": {"name": "tempest-TestShelveInstance-285673382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeVn6vX/ZXJaKuY0C3t0yAXddaVxSWBEGMGr1I8SQ5iZH3KINgyB48dNlHEVcN78cxxXQ06E2IVH12kKDFw9xTBzq6tqjOC5cGRJKu4whD5a86lYcvPGb1u970J8lIgAw=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:29.310040 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a041c054-49eb-42d4-8a2c-73b635703c01 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for project 6a7383ae26d140fa872a01118671f19c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:48:29.316051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a041c054-49eb-42d4-8a2c-73b635703c01 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for user 7a187e1d36c44cbe8af3e0070419b1d1 and project 6a7383ae26d140fa872a01118671f19c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:48:29.349974 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a041c054-49eb-42d4-8a2c-73b635703c01 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.253096 Sep 14 10:48:29.351888 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2354/6823] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:48:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:48:30.420473 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:30.421486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:30.425803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1815638792", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-285673382", "security_groups": [{"name": "tempest-secgroup-smoke-301865052"}], "networks": [{"uuid": "82c5263d-a4a3-4b97-aa83-ab14db4a42c3"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:30.534719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] validate_networks() for [('82c5263d-a4a3-4b97-aa83-ab14db4a42c3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:48:30.945033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:48:30.945484 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:48:30.945978 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:48:30.946408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:48:30.946877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:48:30.965886 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:30.966393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:30.966850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:30.967600 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:30.968102 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:30.968551 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:30.986434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for project 6a7383ae26d140fa872a01118671f19c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:48:30.992707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for user 7a187e1d36c44cbe8af3e0070419b1d1 and project 6a7383ae26d140fa872a01118671f19c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:48:31.005572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:48:31.008819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:48:31.061893 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-862e64b4-272e-4352-8be1-41475b840a1b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.643180 Sep 14 10:48:31.062566 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4470/6824] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:48:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:48:31.075633 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3fdab1c6-51ac-45fb-bf32-4961555994ef tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:31.080461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3fdab1c6-51ac-45fb-bf32-4961555994ef tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:31.139160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3fdab1c6-51ac-45fb-bf32-4961555994ef tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:31.146752 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3fdab1c6-51ac-45fb-bf32-4961555994ef tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1246 microversion: 2.1 time: 0.076184 Sep 14 10:48:31.148015 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2355/6825] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:31 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:32.182391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:32.184358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:32.193031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:32.193844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:32.194643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:32.195554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:32.196222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:32.196834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:32.267634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:32.278826 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-9d639689-6990-48d9-862d-4bbd0d37c4e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1298 microversion: 2.1 time: 0.103563 Sep 14 10:48:32.279456 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4471/6826] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:32 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:33.308432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:33.313293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:33.332906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:33.333889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:33.335424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:33.337033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:33.338094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:33.339064 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:33.948052 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:33.956329 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-06b81c68-f8d0-4e6c-81cb-4792f246a717 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.656706 Sep 14 10:48:33.956924 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2356/6827] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:33 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:34.593231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:34.606581 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:34.607224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:34.607805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:34.621584 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] Creating event network-changed:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h2-851028-12 Sep 14 10:48:34.627943 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-af04501c-8724-4c7a-93bd-bd1e0482d709 req-a32a21c3-da0f-4a60-ba15-1096c7170361 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126548 Sep 14 10:48:34.628872 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4472/6828] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:48:34.982034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:34.982641 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:34.990513 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:34.991722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:34.991722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:34.992914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:34.993371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:34.993932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:35.140237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:35.148518 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b62fb50a-4da8-4df6-a51a-7689c9758c3e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.170425 Sep 14 10:48:35.149049 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2357/6829] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:34 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:48:36.175744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:36.176668 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:36.183716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:36.184427 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:36.184866 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:36.185602 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:36.186077 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:36.186559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:36.333041 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:36.342360 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e50d62d9-6cd9-48ec-84e0-3d2467d394cd tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.172589 Sep 14 10:48:36.342877 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4473/6830] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:36 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:37.367115 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:37.367720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:37.370869 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:48:37.371046 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 (ip 10.222.0.90) !!! Sep 14 10:48:37.388009 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:37.388796 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:37.389495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:37.390628 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:37.391293 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:37.391821 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:37.550030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:37.564463 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a06d7c67-de01-4987-8475-8e6f7f78efe9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.200132 Sep 14 10:48:37.565097 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2358/6831] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:37 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:38.590178 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:38.590849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:38.597908 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:38.598412 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:38.598867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:38.599584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:38.600158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:38.600695 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:38.744812 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:38.752763 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a0a0b57d-9eec-4d2c-a907-bf15c6f19921 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.166553 Sep 14 10:48:38.753365 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4474/6832] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:38 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:39.395643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "name": "network-vif-plugged", "status": "completed", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:39.408526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:39.409019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:39.409447 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:39.422757 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] Creating event network-vif-plugged:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h2-851028-12 Sep 14 10:48:39.428097 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-23efb1fd-351a-47de-901f-2787668bf3f8 req-db7db043-98d8-4e95-91f0-7e810fae2c6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Sep 14 10:48:39.428853 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2359/6833] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:48:39.776795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:39.777420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:39.784419 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:39.784916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:39.785362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:39.786070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:39.786536 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:39.786973 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:39.924281 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:39.934213 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1c29f980-d03c-4736-80a5-f0727dbddce3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1371 microversion: 2.1 time: 0.161945 Sep 14 10:48:39.934849 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4475/6834] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:39 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:40.959151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:40.960020 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:40.966753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:40.967251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:40.967691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:40.968427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:40.968931 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:40.969355 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:41.112549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:41.121675 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-faf1df57-1af1-476e-a556-800c8a449af8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1555 microversion: 2.1 time: 0.167593 Sep 14 10:48:41.122276 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2360/6835] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:40 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:41.145742 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:48:41.146880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:48:41.150162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:41.150858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:41.157623 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:41.158174 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:41.158639 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:41.159373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:41.159853 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:41.160381 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:41.319284 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:48:41.327475 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0cd69553-1853-415a-adfc-e59f334af645 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1555 microversion: 2.1 time: 0.186312 Sep 14 10:48:41.328101 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4476/6836] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:48:41 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:48:43.187068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:48:43.192494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:48:43.200371 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:48:43.200861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:48:43.201296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:48:43.213363 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] Creating event network-changed:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h2-851028-12 Sep 14 10:48:43.219045 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-97104734-6bef-4e2f-8d7d-4a8b145a111a req-464462ed-9fb6-4f58-99ca-864404a65b52 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035730 Sep 14 10:48:43.219766 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2361/6837] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:50:40.591332 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:50:40.593094 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:50:40.593244 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:50:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907/action (ip 10.222.0.90) !!! Sep 14 10:50:40.594217 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:50:40.595159 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=34 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:50:40.600206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:50:40.600765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:40.612129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:40.612634 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:40.613085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:40.613800 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:40.614786 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:40.615620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:40.643796 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lazy-loading 'flavor' on Instance uuid 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:50:40.980415 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d8625d94-9d6c-4ee0-875e-c294ab93e689 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907/action" status: 202 len: 0 microversion: 2.1 time: 0.390540 Sep 14 10:50:40.981036 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4477/6838] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:50:40 2022] POST /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:50:40.988261 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:50:40.989239 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:50:40.990511 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:50:40.991352 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=28 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:50:40.992685 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 14 10:50:40.998070 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:40.998790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:41.007155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:41.007688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:41.008167 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:41.008883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:41.009391 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:41.009805 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:41.156289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:41.164319 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-44700088-7b2a-4fd4-8047-45ea7d9a42ac tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.178440 Sep 14 10:50:41.164926 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2362/6839] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:40 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:42.188575 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:42.189294 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:42.198872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:42.199380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:42.199834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:42.200615 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:42.201084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:42.201528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:42.207175 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 56266. Sep 14 10:50:42.337409 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:42.346170 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-408ee837-d47e-4fd6-9f23-46bd7e84ce6d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.163159 Sep 14 10:50:42.346765 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4478/6840] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:42 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:43.370517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:43.371126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:43.382593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:43.383088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:43.383526 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:43.384269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:43.384726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:43.385155 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:43.389533 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 56272. Sep 14 10:50:43.391793 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 56274. Sep 14 10:50:43.521014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:43.528925 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c8cb8231-ee8a-484d-a0d7-ae3fd441c5a6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.162276 Sep 14 10:50:43.529507 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2363/6841] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:43 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:44.554532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:44.555400 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:44.562607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:44.563142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:44.563595 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:44.564347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:44.564876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:44.565385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:44.705764 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:44.714367 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-dab90ee1-d1e9-4b56-99dd-ad81b2a8fa08 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.164889 Sep 14 10:50:44.714958 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4479/6842] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:44 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:50:45.740422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:45.741204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:45.748470 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:45.748956 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:45.749417 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:45.750118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:45.750567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:45.750992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:45.890369 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:45.899174 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f41f4338-d5fc-4384-a7ff-94743f5e5451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.164225 Sep 14 10:50:45.899707 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2364/6843] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:45 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:46.923302 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:46.923954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:46.930875 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:46.931375 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:46.931827 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:46.932572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:46.933044 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:46.933485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:47.071421 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:47.079253 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c89cde04-1c0f-49be-a1f5-9a1b3ede1e4b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.160080 Sep 14 10:50:47.079830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4480/6844] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:46 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:48.104692 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:48.105312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:48.112563 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:48.113050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:48.113488 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:48.114740 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:48.115550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:48.115914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:48.252636 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:48.261453 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2c6878a6-e26b-42a1-bab7-9457021f39ff tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.160733 Sep 14 10:50:48.262032 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2365/6845] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:48 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:49.284758 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:49.285384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:49.293164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:49.293664 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:49.294138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:49.294844 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:49.295305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:49.295737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:49.434880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:49.443625 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-901fc0de-7046-4824-8ab1-a0eb7f01726d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.162624 Sep 14 10:50:49.444238 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4481/6846] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:49 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:50.467711 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:50.468328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:50.475596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:50.476120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:50.476564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:50.477267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:50.477729 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:50.478160 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:50.613560 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:50.621465 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3600eb40-585c-458b-8b0a-9d1c9c8f9bc4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.157835 Sep 14 10:50:50.622048 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2366/6847] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:50 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:51.644808 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:51.645674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:51.652926 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:51.653425 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:51.653877 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:51.654584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:51.655055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:51.655502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:51.790527 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:51.798843 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ecf6505-6ba7-49a8-aac6-e0085a66eba3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1700 microversion: 2.1 time: 0.157999 Sep 14 10:50:51.799440 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4482/6848] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:51 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:52.826761 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:52.827400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:52.836157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:52.836647 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:52.837088 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:52.837799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:52.838252 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:52.838681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:52.978472 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:52.986826 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4bb99c8b-b262-439b-84fb-78cc2e17c6a8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1700 microversion: 2.1 time: 0.164002 Sep 14 10:50:52.987421 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2367/6849] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:52 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1700 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:54.011300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:54.012606 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:54.020350 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:54.021855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:54.022612 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:54.023803 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:54.024850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:54.024850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:54.195630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:54.205645 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-45cb6788-d0dd-4c51-bc8f-b0bf275a96ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.198220 Sep 14 10:50:54.212305 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4483/6850] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:54 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:55.231109 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:55.233006 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:55.241508 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:55.243405 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:55.244118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:55.245071 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:55.245767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:55.246426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:55.408966 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:55.422710 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0409ab02-c555-4543-86fc-6c7ad106ea30 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.195404 Sep 14 10:50:55.423772 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2368/6851] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:55 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:56.322012 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "name": "network-vif-plugged", "status": "completed", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:50:56.333033 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:56.333924 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:56.334389 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:56.347732 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] Creating event network-vif-plugged:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h2-851028-12 Sep 14 10:50:56.353841 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-76dc5303-b04b-485a-85b1-59ee3a8aa4cb req-b89c22a5-74dc-4e45-9d1a-807c70a79f49 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121750 Sep 14 10:50:56.354478 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4484/6852] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:50:56.447776 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:56.448415 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:56.455865 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:56.456401 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:56.456846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:56.458285 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:56.458838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:56.459275 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:56.618819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:56.628387 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-7026b428-b863-4aec-966e-b327220396fb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.184562 Sep 14 10:50:56.629443 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2369/6853] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:56 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:57.655034 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:57.656512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:57.664508 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:57.665373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:57.666053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:57.667018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:57.667709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:57.668406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:57.833928 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:57.843656 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-36a240b4-3fc9-4943-94b7-d3d2e0c1ff88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.192500 Sep 14 10:50:57.844985 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4485/6854] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:57 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:50:58.872957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:50:58.873500 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:50:58.882644 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:58.883268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:58.883722 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:58.884471 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:50:58.884930 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:50:58.885569 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:50:59.036611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:50:59.047145 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ed5ed021-c609-4c5e-8014-eba8160c90c6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.178090 Sep 14 10:50:59.047998 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2370/6855] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:50:58 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:00.071942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:00.072992 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:00.081135 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:00.083674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:00.084986 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:00.086162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:00.086870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:00.087542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:00.247213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:00.256267 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-437f536b-9991-42be-9bd1-45dc4e0810ed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.188276 Sep 14 10:51:00.257060 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4486/6856] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:00 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:01.281322 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:01.281949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:01.293039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:01.293652 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:01.294101 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:01.294815 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:01.295279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:01.295717 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:01.454338 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:01.466474 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-736dd42d-9057-422f-831c-e186f47b531a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.189346 Sep 14 10:51:01.467079 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2371/6857] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:01 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:02.491681 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:02.492544 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:02.500279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:02.500863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:02.501385 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:02.502270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:02.502872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:02.503315 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:02.657163 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:02.666895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-459e6909-1446-44e3-a178-4202586010a1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1695 microversion: 2.1 time: 0.179664 Sep 14 10:51:02.667542 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4487/6858] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:02 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:03.690529 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:03.691148 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:03.698389 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:03.698880 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:03.699323 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:03.700050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:03.700505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:03.700928 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:03.920855 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:03.928795 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-edf2e280-cd2a-4595-b6e3-778207160349 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1677 microversion: 2.1 time: 0.242146 Sep 14 10:51:03.929394 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2372/6859] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:03 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:04.952002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:04.952618 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:04.960777 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:04.961279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:04.961732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:04.962442 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:04.962913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:04.963358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:05.100515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:05.108721 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-12b9469a-1911-4f6c-8e1a-7f93d2106946 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1677 microversion: 2.1 time: 0.160739 Sep 14 10:51:05.109307 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4488/6860] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:04 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:06.132699 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:06.133328 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:06.140209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.140877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.141127 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.141828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.142279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.142701 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.283243 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:06.291609 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4355234d-9c62-4077-ba86-0c927d887872 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1620 microversion: 2.1 time: 0.163392 Sep 14 10:51:06.292237 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2373/6861] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:06 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1620 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:06.315085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:51:06.315699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:06.323872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.324404 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.324863 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.325578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.326050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.326491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.369996 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122444) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 10:51:06.439131 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f0118e52-4cbd-4a67-a0e3-a27a8802873b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907/action" status: 202 len: 0 microversion: 2.1 time: 0.127866 Sep 14 10:51:06.439821 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4489/6862] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:51:06 2022] POST /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:51:06.449849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:06.450502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:06.456753 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.457248 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.457803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.458824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:06.459283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:06.459718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:06.606044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:06.615783 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-5dc991bf-8eda-451e-8591-fcd99684137c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1628 microversion: 2.1 time: 0.169906 Sep 14 10:51:06.616503 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2374/6863] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:06 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1628 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:07.640525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:07.641156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:07.647791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:07.648336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:07.649162 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:07.649883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:07.650358 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:07.650807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:07.796587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:07.805799 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ba3e25f1-009a-4351-8ef6-efbc0cb3e72b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.170064 Sep 14 10:51:07.806400 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4490/6864] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:07 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:08.186087 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "name": "network-vif-unplugged", "status": "completed", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:51:08.197640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:08.198342 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:08.198759 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:08.211850 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] Creating event network-vif-unplugged:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h1-851028-12 Sep 14 10:51:08.216964 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-059857e1-68aa-4e56-a912-8ffa57dc2c2f req-2d318baa-132f-4280-949d-1109d2eafef9 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034716 Sep 14 10:51:08.217730 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2375/6865] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:51:08.830434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:08.831105 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:08.839960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:08.840477 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:08.840955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:08.841689 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:08.842167 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:08.842617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:08.846975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:51:08.985130 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:08.995792 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b69a99c-89d9-47a1-89d8-21bf37d21ed4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.169322 Sep 14 10:51:08.996460 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4491/6866] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:08 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:10.021834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:10.022664 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:10.030475 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:10.030968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:10.031409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:10.032168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:10.032620 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:10.033037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:10.183136 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:10.191412 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b3e2777c-c09e-4ec0-ab93-40842cba4189 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.176292 Sep 14 10:51:10.192820 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2376/6867] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:10 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:10.242306 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:51:10.253532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:10.254122 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:10.255288 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:10.268528 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] Creating event network-changed:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h1-851028-12 Sep 14 10:51:10.275418 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-1d7f0841-6e77-4c28-b371-7e7f00f8322f req-f9f81669-a622-437c-82db-8f126bf7bd2f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037826 Sep 14 10:51:10.275990 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4492/6868] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:51:11.216503 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:11.217219 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:11.224051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=31 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:51:11.225917 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:11.226645 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:11.227351 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:11.228506 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:11.229201 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:11.229859 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:11.234185 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=87 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:51:11.379029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:11.387625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f01d7a77-a748-4f3c-8405-fd746a7dfb4a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.175029 Sep 14 10:51:11.388318 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2377/6869] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:11 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:12.415715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:12.416897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:12.419603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:51:12.427954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:12.428498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:12.429031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:12.429850 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:12.430396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:12.430932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:12.596149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:12.606895 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4710aae2-033b-4279-8362-7ee045a5ed88 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.198070 Sep 14 10:51:12.607936 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4493/6870] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:12 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:13.639044 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:13.639697 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:13.646949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:13.647670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:13.648367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:13.649154 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:13.649738 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:13.650267 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:13.814262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:13.826383 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-20d3be96-a095-438a-b8e4-5cbc282e97cb tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.191426 Sep 14 10:51:13.827223 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2378/6871] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:13 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:14.853085 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:14.853784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:14.861039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:14.861546 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:14.861993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:14.862914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:14.863387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:14.864645 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:15.017887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:15.026458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5940299c-05b6-49ad-9b6d-024c512f8e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.179296 Sep 14 10:51:15.027060 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4494/6872] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:14 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:16.052777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:16.053676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:16.060706 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:16.061200 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:16.061643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:16.062365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:16.062825 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:16.063259 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:16.223531 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:16.231846 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2093e3e-d1b9-4c04-b57d-4bba33de3b2b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.183837 Sep 14 10:51:16.232926 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2379/6873] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:16 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:17.256405 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:17.257423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:17.264091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:17.264784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:17.265258 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:17.266235 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:17.266778 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:17.267231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:17.422029 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:17.431215 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ee779cc7-62cf-4f6a-aa15-1b6958437ca9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.178931 Sep 14 10:51:17.431858 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4495/6874] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:17 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:18.454609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:18.455223 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:18.462358 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:18.462842 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:18.463279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:18.464004 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:18.464459 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:18.464883 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:18.631304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:18.642091 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85a79ec7-3131-46e5-bdca-8fe3f7549001 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.191206 Sep 14 10:51:18.642919 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2380/6875] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:18 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:19.666271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:19.666834 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:19.673921 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:19.674428 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:19.674884 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:19.675603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:19.676670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:19.677440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:19.815717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:19.824372 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2be6dc36-61ac-42ce-aa3f-e5c122299fad tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.162133 Sep 14 10:51:19.824983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4496/6876] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:19 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:20.849959 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:20.850559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:20.857741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:20.858231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:20.858671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:20.859365 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:20.859819 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:20.860274 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:21.001884 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:21.009691 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-22ebab2b-2da4-43a6-8039-9785b53b4af6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.164477 Sep 14 10:51:21.010278 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2381/6877] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:20 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:22.032847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:22.033480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:22.041523 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:22.042050 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:22.042485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:22.043203 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:22.043679 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:22.044156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:22.179557 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:22.187417 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-3bdd84f1-9ffd-4a47-ad34-c8594aaea6e4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.158553 Sep 14 10:51:22.188025 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4497/6878] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:22 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:51:23.213675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:23.215026 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:23.223279 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:23.224198 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:23.225057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:23.225998 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:23.226663 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:23.227395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:23.461228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:23.471811 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-18de69a7-6763-494d-b67e-140634c7cf42 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.262815 Sep 14 10:51:23.483426 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2382/6879] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:23 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:24.497017 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:24.497644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:24.504731 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:24.505239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:24.505696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:24.506413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:24.506888 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:24.507336 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:24.647075 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:24.654987 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-af2e5658-2862-45a1-bbb7-2ab5f9bc429f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.161934 Sep 14 10:51:24.655573 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4498/6880] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:24 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:25.087559 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "name": "network-vif-plugged", "status": "completed", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:51:25.098999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:25.098999 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:25.099282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:25.111833 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] Creating event network-vif-plugged:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h1-851028-12 Sep 14 10:51:25.117979 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-1ac949c1-cbfc-4b30-b19b-9816c310bcc0 req-de391d87-5b4b-43fb-a23f-f1dcc7c75209 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034049 Sep 14 10:51:25.118609 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2383/6881] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:51:25.679817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:25.680402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:25.687408 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:25.687950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:25.688420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:25.689138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:25.689614 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:25.690061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:25.826838 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:25.835731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e6c71d4f-aed5-49b5-abc3-0c1c314eac5d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.160597 Sep 14 10:51:25.836355 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4499/6882] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:25 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:26.861237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:26.861942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:26.869132 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:26.869621 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:26.870100 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:26.870991 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:26.871452 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:26.871932 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:27.017014 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:27.027206 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-797bc024-4c2b-49b5-bd6a-8667245ca7df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1686 microversion: 2.1 time: 0.171335 Sep 14 10:51:27.027792 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2384/6883] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:26 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:51:28.051624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:51:28.052299 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:51:28.059579 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:28.060138 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:28.060598 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:28.061321 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:51:28.061794 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:51:28.062241 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:51:28.202472 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:51:28.210756 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7fe1b2c7-2cbc-4467-bbaa-9ce5ec0c794e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1673 microversion: 2.1 time: 0.163880 Sep 14 10:51:28.211344 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4500/6884] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:51:28 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:52:42.488586 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=15 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:52:42.489654 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=54 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:52:42.490980 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:52:42.491162 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 10:52:42.495314 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:52:42.495939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:52:42.498453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=15 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:52:42.499209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=43 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:52:42.508046 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:52:42.509612 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:52:42.509765 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 (ip 10.222.0.90) !!! Sep 14 10:52:42.517914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:42.518441 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:42.518901 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:42.519618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:42.520111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:42.520689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:42.523498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:42.525373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:42.525845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:42.538638 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] Creating event network-changed:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h1-851028-12 Sep 14 10:52:42.544171 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-7e4d47db-15ae-4900-bdeb-2f8b815f9177 req-3bfeb38d-e60f-44ac-b263-29d818370bef service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062116 Sep 14 10:52:42.544797 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4501/6885] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:52:42.551255 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:52:42.644851 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ceed35ab-f821-403f-9670-583b0dfd90b9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 204 len: 0 microversion: 2.1 time: 0.165180 Sep 14 10:52:42.645645 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2385/6886] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:52:42 2022] DELETE /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:52:42.657300 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:52:42.658641 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:52:42.671371 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:42.671994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:42.672456 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:42.673189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:42.673672 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:42.674107 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:42.822293 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:52:42.830320 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43cd8abf-e51a-4294-a44a-5a2a4a7c6073 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.179895 Sep 14 10:52:42.831628 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4502/6887] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:52:42 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:52:43.860611 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:52:43.862461 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:52:43.873137 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:43.873640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:43.874078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:43.874782 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:43.875235 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:43.875659 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:44.153656 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:52:44.162096 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-c185aa53-1fa8-4e74-81a7-706aeb0798a9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 200 len: 1679 microversion: 2.1 time: 0.309301 Sep 14 10:52:44.162700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2386/6888] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:52:43 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:52:44.513170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aa4d07-8c6d-4e05-9bb5-df6e5f990907", "name": "network-vif-deleted", "tag": "966d1072-d332-4fed-b060-859c851170d8"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:52:44.524964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:44.525480 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:44.525918 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:44.539830 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] Creating event network-vif-deleted:966d1072-d332-4fed-b060-859c851170d8 for instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 on n-h1-851028-12 Sep 14 10:52:44.544825 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-62521be8-74d4-402c-a22b-d94f1d713340 req-26030a0e-655b-45a1-824d-d50eefd2216e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135733 Sep 14 10:52:44.545471 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4503/6889] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:52:45.186561 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:52:45.187178 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: 43aa4d07-8c6d-4e05-9bb5-df6e5f990907] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:52:45.194334 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:45.194818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:45.195254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:45.195968 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:52:45.196420 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:52:45.196844 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:52:45.213740 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] HTTP exception thrown: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Request method failure captured: Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 HTTP/1.1 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIbF3Ny_qPTtCkcBKpDvbks6_WteCJJiUfLEfPcElr2yrZcjRUAa7uQxRqH0EvfLCHwxttI002Fwimb1KJ2NDf3qEzcvD43uzfKLlAsJFoF24gELldsWVC_BC_nuTbwEP3flBsJy8EOdXyxWtovwa8U4bil0xNcyw1HjQjeeW-_76EpI Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6a7383ae26d140fa872a01118671f19c Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestShelveInstance-912913476 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6a7383ae26d140fa872a01118671f19c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6a7383ae26d140fa872a01118671f19c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6a7383ae26d140fa872a01118671f19c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6a7383ae26d140fa872a01118671f19c"}]}] Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestShelveInstance-912913476 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6a7383ae26d140fa872a01118671f19c Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestShelveInstance-912913476 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestShelveInstance-912913476-project Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 7a187e1d36c44cbe8af3e0070419b1d1 Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestShelveInstance-912913476-project Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '43aa4d07-8c6d-4e05-9bb5-df6e5f990907'} Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:52:45.215396 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Returning 404 to user: Instance 43aa4d07-8c6d-4e05-9bb5-df6e5f990907 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a1697ad0-2445-4957-bfec-8d419d6bd691 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907" status: 404 len: 111 microversion: 2.1 time: 0.034240 Sep 14 10:52:45.220632 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2387/6890] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:52:45 2022] GET /compute/v2.1/servers/43aa4d07-8c6d-4e05-9bb5-df6e5f990907 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:52:45.382087 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-72240aeb-5446-435a-9fa0-45db097b2ac0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '.version_select at 0x7f693e156f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:52:45.407833 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-72240aeb-5446-435a-9fa0-45db097b2ac0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285673382" status: 202 len: 0 microversion: 2.1 time: 0.030566 Sep 14 10:52:45.408749 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4504/6891] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 10:52:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285673382 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:52:45.437094 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e73fbb0c-1a34-4f7d-9e5f-655846a63755 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'create', calling method: .version_select at 0x7f693f868040>, body: {"keypair": {"name": "tempest-TestShelveInstance-658276614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsJ7fGGf4NDMYSDK++IO99fErVY7lgxjQknxPG/VKObT0q63UMx6a18jyuvC+9jnsg2TxRxcgXbU0P3LBPnwRNcSrspEJA72MKAFuXUvCR8qQpUsr0Oq94AKJIyuIVd8g=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:52:45.454099 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e73fbb0c-1a34-4f7d-9e5f-655846a63755 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for project 6a7383ae26d140fa872a01118671f19c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:52:45.459736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-e73fbb0c-1a34-4f7d-9e5f-655846a63755 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for user 7a187e1d36c44cbe8af3e0070419b1d1 and project 6a7383ae26d140fa872a01118671f19c. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:52:45.487853 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e73fbb0c-1a34-4f7d-9e5f-655846a63755 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.054022 Sep 14 10:52:45.488508 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2388/6892] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:52:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:53:01.710073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=10 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:01.710849 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:01.715422 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-513149854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-658276614", "security_groups": [{"name": "tempest-secgroup-smoke-1106801490"}], "networks": [{"uuid": "82c5263d-a4a3-4b97-aa83-ab14db4a42c3"}], "block_device_mapping_v2": [{"uuid": "88c82c3c-fb69-4040-9acf-37101a2c241f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:53:01.834296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] validate_networks() for [('82c5263d-a4a3-4b97-aa83-ab14db4a42c3', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:53:02.265583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:53:02.266025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:53:02.266518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:53:02.266944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:53:02.267373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:53:02.277239 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:02.277741 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:02.278198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:02.278943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:02.279423 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:02.279868 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:02.297701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for project 6a7383ae26d140fa872a01118671f19c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:53:02.303578 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Getting quotas for user 7a187e1d36c44cbe8af3e0070419b1d1 and project 6a7383ae26d140fa872a01118671f19c. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:53:02.361368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:53:02.364311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88c82c3c-fb69-4040-9acf-37101a2c241f',volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:53:02.494055 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-91069a36-2699-4c68-9ea4-eeeefed20d93 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785745 Sep 14 10:53:02.494731 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4505/6893] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:53:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:53:02.504411 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:02.505354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=4 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:02.506121 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:02.511848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bf8ee89b-69f9-4bbb-9907-22773110ebd8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:02.512694 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bf8ee89b-69f9-4bbb-9907-22773110ebd8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:02.574303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bf8ee89b-69f9-4bbb-9907-22773110ebd8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:02.581928 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bf8ee89b-69f9-4bbb-9907-22773110ebd8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1087 microversion: 2.1 time: 0.079983 Sep 14 10:53:02.582555 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2389/6894] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:02 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:03.605148 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:03.605785 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:03.614935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:03.615445 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:03.615929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:03.616653 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:03.617129 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:03.617574 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:03.687676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:03.697106 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-f57f60da-f4cb-49e9-b298-e7f3d005ad25 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1203 microversion: 2.1 time: 0.095846 Sep 14 10:53:03.699465 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4506/6895] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:03 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:04.722974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:04.724256 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:04.731467 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:04.732229 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:04.732874 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:04.734033 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:04.734675 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:04.735299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:04.965120 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:04.974547 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1a2d21a2-4bb6-40c1-bd7f-6c46486fa1c3 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1271 microversion: 2.1 time: 0.255934 Sep 14 10:53:04.975145 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2390/6896] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:04 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:05.200932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:53:05.214109 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:05.215018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:05.215733 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:05.228688 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] Creating event network-changed:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:53:05.236481 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-390264a7-5cc5-407d-b232-d112d04917a6 req-0f852ff7-037d-4381-92b0-faf069568e7e service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038162 Sep 14 10:53:05.237637 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4507/6897] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:53:05.998940 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:05.999934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:06.009517 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:06.010533 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:06.011141 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:06.012298 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:06.013603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:06.014299 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:06.239934 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:06.248420 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e37ae26a-9c3f-4544-a495-1e3be0dfb720 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1271 microversion: 2.1 time: 0.254093 Sep 14 10:53:06.249011 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2391/6898] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:05 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:07.273975 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:07.274728 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:07.281286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:07.281791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:07.282244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:07.282993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:07.284147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:07.284597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:07.426969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:07.435015 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b06a8220-6647-4471-a60c-c939f9ec338e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1271 microversion: 2.1 time: 0.166333 Sep 14 10:53:07.435713 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4508/6899] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:07 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:08.458848 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:08.459588 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:08.466850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:08.467431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:08.467862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:08.468614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:08.469075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:08.469510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:08.621737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:08.630085 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-8c7a19b6-0ae8-4b51-a80e-5cbb46d7bc7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1271 microversion: 2.1 time: 0.175756 Sep 14 10:53:08.630943 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2392/6900] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:08 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:09.654413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:09.655039 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:09.662202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:09.662696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:09.663142 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:09.663846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:09.664342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:09.664780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:09.809784 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:09.818745 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-e5dc62e0-2d11-46bf-bd64-e50e1d8df1df tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.168316 Sep 14 10:53:09.819335 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4509/6901] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:09 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:10.841603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:10.842190 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:10.849203 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:10.849681 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:10.850180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:10.850870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:10.851319 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:10.851742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:10.985210 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:10.993895 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fbdf55e6-b306-4512-a8b9-71cd3c3329e0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.156227 Sep 14 10:53:10.994484 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2393/6902] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:10 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:12.017028 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:12.018279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:12.025198 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:12.025698 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:12.026175 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:12.026876 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:12.027341 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:12.027779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:12.172329 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:12.182124 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dd7d347-1a1b-4913-aac6-493b8d41f748 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.168952 Sep 14 10:53:12.182737 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4510/6903] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:12 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:13.206184 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:13.207031 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:13.209763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:13.215326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:13.215816 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:13.216283 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:13.217018 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:13.217473 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:13.217902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:13.354520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:13.367603 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-dd642ed9-3b89-4fa9-a763-2944852ff198 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.165584 Sep 14 10:53:13.368673 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2394/6904] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:13 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:14.392213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:14.393060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:14.395254 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:14.395953 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:53:14.402972 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:14.403512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:14.404008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:14.404732 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:14.405206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:14.405650 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:14.542627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:14.551281 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7ab10ea6-aa2e-4bac-8631-1503924b7e07 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.163360 Sep 14 10:53:14.551876 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4511/6905] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:14 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:15.574892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:15.575514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:15.583168 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:15.583667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:15.584139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:15.584838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:15.585296 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:15.585726 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:15.722251 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:15.730118 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ae2f1660-3edc-45a8-bdb4-dc1df39bf5d1 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.159520 Sep 14 10:53:15.730714 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2395/6906] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:15 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:16.755859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:16.756549 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:16.763157 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:16.763661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:16.764144 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:16.764867 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:16.765338 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:16.765783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:16.910192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:16.918373 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d31cbe1c-3d77-491b-8f1d-ff8cc4381f7d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.167766 Sep 14 10:53:16.918968 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4512/6907] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:16 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:17.941687 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:17.942238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:17.949502 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:17.949992 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:17.950458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:17.951151 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:17.951603 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:17.952142 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:18.084335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:18.092168 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f49fa431-030b-4ced-9677-9ac6a09d09cf tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.154998 Sep 14 10:53:18.092743 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2396/6908] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:17 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:18.894170 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "name": "network-vif-plugged", "status": "completed", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:53:18.905927 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:18.906715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:18.907347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:18.920491 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] Creating event network-vif-plugged:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:53:18.926852 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c0b925dc-1dbb-4867-a402-0b16ad943622 req-d2affbde-0075-4dea-8531-42574aa200bf service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037386 Sep 14 10:53:18.927776 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4513/6909] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:53:19.115555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:19.116216 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:19.122980 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:19.123486 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:19.123937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:19.124632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:19.125079 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:19.125497 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:19.261914 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:19.269861 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-108a1f93-c9b3-488b-a28b-e013e08ea207 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1259 microversion: 2.1 time: 0.158869 Sep 14 10:53:19.270518 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2397/6910] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:19 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:20.295688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:20.296447 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:20.303841 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:20.304380 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:20.304837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:20.305620 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:20.306092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:20.306540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:20.444515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:20.454205 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-774681cd-3fd5-4b78-9175-2685b5c58108 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1444 microversion: 2.1 time: 0.163686 Sep 14 10:53:20.454798 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4514/6911] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:20 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:20.477949 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:53:20.478583 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:53:20.485818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:20.486456 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:20.487041 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:20.487828 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:20.488309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:20.488736 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:20.625960 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:53:20.634713 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6351ce2f-b2d0-4938-9dfd-96a0cff0ef5e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1444 microversion: 2.1 time: 0.160626 Sep 14 10:53:20.635310 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2398/6912] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:53:20 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:53:22.602134 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:53:22.613977 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:53:22.614589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:53:22.615378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:53:22.627631 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] Creating event network-changed:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:53:22.632531 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-68392267-c56e-40c9-a301-299ea107d58d req-1439d2c5-ab55-4707-9692-b3e2c43e4c26 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Sep 14 10:53:22.633152 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4515/6913] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:55:19.767034 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=22 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:19.767790 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=54 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:19.769132 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 14 10:55:19.769359 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd/action (ip 10.222.0.90) !!! Sep 14 10:55:19.829596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:55:19.830188 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:19.839268 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:19.839818 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:19.840297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:19.841022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:19.841485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:19.841943 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:19.869400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.objects.instance [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lazy-loading 'flavor' on Instance uuid cdcbf1ca-f264-47c1-8a8f-de88f40994bd {{(pid=122443) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 10:55:19.955512 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ec05f112-dad8-4cfe-bb7a-446d0b189451 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd/action" status: 202 len: 0 microversion: 2.1 time: 0.190288 Sep 14 10:55:19.956054 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2399/6914] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:55:19 2022] POST /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:55:19.963122 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:55:19.964135 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] AMQP server on 10.222.0.90:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 14 10:55:19.964780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:19.965880 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=50 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:19.973060 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:19.973887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:19.981878 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:19.982391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:19.982847 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:19.983576 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:19.984279 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:19.984783 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:20.150798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:20.158787 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b36998d7-54a5-44be-9230-54dad8b0204b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.197752 Sep 14 10:55:20.159374 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4516/6915] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:19 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:21.184446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:21.185159 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:21.191574 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:21.192110 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:21.192555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:21.193262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:21.193715 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:21.194143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:21.339834 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:21.348625 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-3c991689-3c87-4613-bd11-5b9417dd68f9 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.169629 Sep 14 10:55:21.349206 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2400/6916] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:21 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:22.372815 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:22.373437 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:22.383090 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:22.383588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:22.384064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:22.384779 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:22.385242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:22.385676 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:22.390638 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 56818. Sep 14 10:55:22.392961 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 56816. Sep 14 10:55:22.525737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:22.533758 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2d757abe-f1c9-4c71-986d-e121115618a2 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.164861 Sep 14 10:55:22.534350 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4517/6917] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:22 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:23.556453 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:23.557068 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:23.564113 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:23.564601 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:23.565042 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:23.565737 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:23.566194 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:23.566618 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:23.702440 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:23.711144 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-23ee0f2a-2bc7-4d7a-bbdd-e4f2ec7b4fcc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.158599 Sep 14 10:55:23.711730 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2401/6918] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:23 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:24.734531 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:24.735158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:24.742462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:24.742974 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:24.743434 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:24.744194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:24.744703 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:24.745153 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:24.886807 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:24.895186 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b325d7e0-1684-418f-9194-309274533290 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.164268 Sep 14 10:55:24.895716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4518/6919] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:24 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:25.919143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:25.919767 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:25.928974 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:25.930919 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:25.931370 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:25.933312 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:25.933774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:25.934289 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:26.073733 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:26.081610 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fd1cd0ed-faeb-42be-948b-a3d88bdbbfa5 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.166407 Sep 14 10:55:26.082760 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2402/6920] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:25 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:27.105627 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:27.106259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:27.113631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:27.114244 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:27.114587 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:27.115323 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:27.115795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:27.116272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:27.251916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:27.260589 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac643fcb-4668-4c25-be42-a1f309df6e0e tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.158980 Sep 14 10:55:27.261171 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4519/6921] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:27 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:28.282835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:28.283477 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:28.290364 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:28.290846 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:28.291282 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:28.291989 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:28.292446 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:28.292873 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:28.430838 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:28.438670 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-203d2207-0800-4dad-83b4-a65e603dc467 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.159719 Sep 14 10:55:28.439252 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2403/6922] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:28 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:29.462493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:29.463080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:29.469966 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:29.470462 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:29.470910 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:29.471647 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:29.472219 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:29.472651 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:29.607942 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:29.616260 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d7d53ad3-7598-4cdb-9bd4-97f20c82d552 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.157735 Sep 14 10:55:29.616855 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4520/6923] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:29 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:30.639909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:30.640550 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:30.647534 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:30.648078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:30.648523 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:30.649226 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:30.649682 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:30.650111 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:30.794783 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:30.802830 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f833312d-b146-4f3d-8f80-59181f1d585d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.166849 Sep 14 10:55:30.803656 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2404/6924] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:30 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:31.827108 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:31.827746 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:31.836194 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:31.836709 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:31.837164 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:31.837891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:31.838368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:31.838817 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:31.979714 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:31.989357 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-14c136f5-2d03-4b21-817d-e7dff71443c0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.165968 Sep 14 10:55:31.990453 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4521/6925] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:31 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:33.014400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:33.015195 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:33.023735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:33.024269 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:33.024705 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:33.025424 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:33.025909 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:33.026337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:33.181214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:33.189506 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-560a85f3-4c02-454d-b47f-15d97331f88b tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.178988 Sep 14 10:55:33.190358 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2405/6926] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:33 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:34.214190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:34.214855 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:34.222736 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.223373 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.223829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:34.224596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.225072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.225519 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:34.363511 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:34.372375 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ed5583b1-409e-4eca-b14f-22a77b6c9cb6 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1570 microversion: 2.1 time: 0.162067 Sep 14 10:55:34.372978 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4522/6927] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:34 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:34.396046 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:55:34.396655 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:34.404306 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.404803 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.405254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:34.405962 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.406426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.406849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:34.512590 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122443) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 14 10:55:34.580626 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-d55755fe-8413-4d52-b7ee-6c205b806ff8 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "POST /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd/action" status: 202 len: 0 microversion: 2.1 time: 0.188696 Sep 14 10:55:34.581158 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2406/6928] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:55:34 2022] POST /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:55:34.591063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:34.591702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:34.599296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.599845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.600327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:34.601084 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:34.601558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:34.602008 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:35.072829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:35.081118 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-1b2be996-efb4-4568-af5d-1f178874fbea tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1518 microversion: 2.1 time: 0.494865 Sep 14 10:55:35.082581 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4523/6929] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:34 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1518 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:35.653524 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "name": "network-vif-unplugged", "status": "completed", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:55:35.668313 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:35.668811 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:35.669249 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:35.681172 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.compute.server_external_events [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] Unable to find a host for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd. Dropping event network-vif-unplugged {{(pid=122443) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 14 10:55:35.682085 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-db988c32-0397-4cc7-817e-943be00bb86d req-ad56b927-d5ce-4eb2-aa52-d0256ca32b79 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033436 Sep 14 10:55:35.682872 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2407/6930] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 14 10:55:36.106072 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:36.106644 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:36.115116 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:36.115630 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:36.116139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:36.116881 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:36.117357 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:36.117805 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:36.263559 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:36.271780 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7b072932-b1fb-4bd3-8bc5-c357b9d67c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1520 microversion: 2.1 time: 0.169749 Sep 14 10:55:36.272406 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4524/6931] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:36 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:37.296466 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:37.297089 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:37.304336 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:37.304829 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:37.305270 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:37.305971 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:37.306427 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:37.306856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:37.444893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:37.452866 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-2d5b2ff1-1688-4c6e-8098-6c0871f18e0a tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1520 microversion: 2.1 time: 0.160780 Sep 14 10:55:37.453469 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2408/6932] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:37 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:38.477829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:38.478387 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:38.485327 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:38.486091 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:38.486540 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:38.487250 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:38.488240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:38.488687 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:38.635697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:38.645127 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-73382c9f-a94b-4dcc-8aa8-1bf17e9143d4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1520 microversion: 2.1 time: 0.171549 Sep 14 10:55:38.645751 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4525/6933] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:38 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:55:39.668950 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:39.669520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:39.676721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:39.677209 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:39.677640 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:39.678343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:39.678793 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:39.679211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:39.828700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:39.836877 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4b760f54-95b0-46b0-a8d6-3279aaedba29 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1520 microversion: 2.1 time: 0.171991 Sep 14 10:55:39.837456 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2409/6934] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:39 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:55:40.865914 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:40.867004 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:40.877215 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:40.877835 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:40.878872 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:40.879601 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:40.880165 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:40.880607 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:41.083788 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:41.092236 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8ec0c1e3-94c8-4cd7-8f0b-3b6d2692baf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.234564 Sep 14 10:55:41.092967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4526/6935] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:40 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:42.118191 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:42.119258 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:42.127501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:42.128021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:42.129343 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:42.130222 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:42.130684 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:42.131118 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:42.266549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:42.274933 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ba702964-43b7-49e3-9ad8-b56618e6aaf7 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.162607 Sep 14 10:55:42.275579 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2410/6936] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:42 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:55:43.298455 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:43.299093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:43.307449 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:43.308123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:43.308588 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:43.309301 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:43.309781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:43.310224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:43.449384 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:43.458034 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-ac8e2e52-c381-4d1c-a811-d84ac4868e53 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.163552 Sep 14 10:55:43.458623 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4527/6937] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:43 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:44.482315 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:44.482872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:44.489872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:44.490359 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:44.490801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:44.491495 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:44.491970 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:44.492397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:44.632700 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:44.640928 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-29a78f4a-c1ed-439d-91a8-a0346327aced tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.162776 Sep 14 10:55:44.641522 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2411/6938] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:44 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:45.665952 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:45.666583 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:45.673665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:45.674158 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:45.674605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:45.675987 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:45.676457 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:45.676891 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:45.810512 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:45.818882 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5053fd54-7898-4977-8a88-2b6e5bc0e9f0 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.157037 Sep 14 10:55:45.819470 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4528/6939] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:45 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:46.842882 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:46.843507 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:46.851204 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:46.851685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:46.852149 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:46.852835 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:46.853288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:46.853709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:46.992363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:47.000139 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-f6976ee8-d9a0-485d-8602-52b27ae3ad02 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.161163 Sep 14 10:55:47.000716 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2412/6940] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:46 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:48.023393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:48.024055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:48.031195 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:48.031697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:48.032191 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:48.032913 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:48.033390 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:48.033836 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:48.174718 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:48.183595 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d06b7209-113f-4f54-8fec-5230901c0c63 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.164821 Sep 14 10:55:48.184211 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4529/6941] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:48 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:49.211462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:49.212097 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:49.219536 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:49.220056 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:49.220494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:49.221211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:49.221667 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:49.222709 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:49.227734 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:49.366827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:49.374713 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-355f2584-d36b-43f5-966d-cf2d5a35cd76 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.167588 Sep 14 10:55:49.375292 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2413/6942] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:49 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:50.399204 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:50.399837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:50.402768 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=31 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:50.408795 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:50.409339 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:50.410118 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:50.410923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:50.411396 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:50.411842 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:50.416031 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=85 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:50.545994 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:50.554338 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-46407d27-87ee-4d78-ae9b-26b27568a345 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.159839 Sep 14 10:55:50.554940 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4530/6943] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:50 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:51.577787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:51.578400 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:51.581098 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:55:51.586381 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:51.586866 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:51.587297 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:51.588010 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:51.588462 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:51.588902 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:51.730710 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:51.739216 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-1aaf0cf0-ad81-43fd-ae28-96e00ee7713d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.165322 Sep 14 10:55:51.739801 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2414/6944] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:51 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:51.790110 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "name": "network-vif-plugged", "status": "completed", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:55:51.803717 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:51.804259 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:51.804719 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:51.817218 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] Creating event network-vif-plugged:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:55:51.822359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-df30c7b5-8796-45d1-a8e2-4be49fdb5ded req-0ca49f9f-4bb2-48ca-941a-71572ae958b1 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036033 Sep 14 10:55:51.822983 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4531/6945] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 10:55:52.762395 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:52.763051 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:52.770152 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:52.770638 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:52.771084 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:52.771773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:52.772264 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:52.772695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:52.908277 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:52.917831 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46971445-ebf4-48f5-9a9e-999b88702967 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1576 microversion: 2.1 time: 0.159375 Sep 14 10:55:52.918613 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2415/6946] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:52 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:55:53.944378 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:55:53.945139 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:55:53.951392 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:53.951919 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:53.952377 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:53.953093 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:55:53.953568 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:55:53.954016 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:55:54.091624 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:55:54.099827 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19883590-be14-4bcf-8248-c20d7c8edaed tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1563 microversion: 2.1 time: 0.161533 Sep 14 10:55:54.100436 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4532/6947] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:55:53 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:10.407017 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=3 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:10.408617 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=16 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:10.409554 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=5 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:10.410195 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:57:10.411326 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=13 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:10.412215 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:57:10.412368 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 10:57:10.414441 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd (ip 10.222.0.90) !!! Sep 14 10:57:10.415701 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:57:10.415885 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 10:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 10:57:10.435316 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:10.435746 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:10.443002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:10.443520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:10.443988 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:10.444827 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:10.445288 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:10.445716 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:10.472489 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 10:57:10.495267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:10.509368 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:10.510231 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:10.511020 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:10.523316 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] Creating event network-changed:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:57:10.529011 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-6ec71082-6110-4154-bc66-9ae707f14e6d req-79d429e2-5282-4f18-b8f1-eaa6bbb1a8b6 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121623 Sep 14 10:57:10.529830 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4533/6948] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:57:10.579376 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-41cf2392-85c3-4048-83bd-c334a3322f0f tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "DELETE /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 204 len: 0 microversion: 2.1 time: 0.174174 Sep 14 10:57:10.580460 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2416/6949] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 10:57:10 2022] DELETE /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 10:57:10.589854 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:10.590589 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:10.597617 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:10.598824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:10.599538 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:10.600391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:10.600870 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:10.601528 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:10.743818 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:10.751966 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-948c9428-a503-4f53-a527-04a86af94bae tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.167039 Sep 14 10:57:10.752650 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4534/6950] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:10 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:11.775674 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:11.776432 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:11.783780 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:11.784309 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:11.784758 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:11.785967 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:11.786418 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:11.786841 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:12.099745 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:12.107784 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-ab0c53b2-445f-42d5-a0a5-7f8e09661ff4 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1569 microversion: 2.1 time: 0.336543 Sep 14 10:57:12.108403 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2417/6951] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:11 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1569 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:12.771272 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdcbf1ca-f264-47c1-8a8f-de88f40994bd", "name": "network-vif-deleted", "tag": "77cb090b-5d56-4c4e-b83c-595edc78466d"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:12.782080 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:12.782580 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:12.783030 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:12.795435 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] Creating event network-vif-deleted:77cb090b-5d56-4c4e-b83c-595edc78466d for instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd on n-h2-851028-12 Sep 14 10:57:12.802964 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-8edda875-9078-4808-965d-bfa98b116170 req-3474c1fe-b1e3-4350-b68a-820dbc4a1b1b service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Sep 14 10:57:12.803735 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4535/6952] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:57:13.132983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:13.133568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:13.140596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:13.141392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:13.142048 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:13.142979 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:13.143632 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:13.145025 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:13.218612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:13.227815 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4093e366-28d8-4ee7-af01-c181b220cedc tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1218 microversion: 2.1 time: 0.099479 Sep 14 10:57:13.228428 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2418/6953] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:13 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:14.253151 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:14.254513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:14.262325 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:14.262837 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:14.263296 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:14.264064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:14.264547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:14.265027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:14.339193 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:14.347351 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-219f8d82-8590-4b35-a5cd-f91c8e65732c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1218 microversion: 2.1 time: 0.098556 Sep 14 10:57:14.348011 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4536/6954] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:14 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:15.372262 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:15.372875 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:15.380367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:15.380862 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:15.381303 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:15.382019 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:15.382476 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:15.382906 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:15.449801 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:15.458803 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-46b5fdc5-e74c-4928-bec3-e993fe6c096c tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1218 microversion: 2.1 time: 0.090497 Sep 14 10:57:15.459590 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2419/6955] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:15 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:16.482944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:16.483486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:16.491429 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:16.491955 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:16.492413 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:16.493132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:16.493603 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:16.494049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:16.561311 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a187e1d36c44cbe8af3e0070419b1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7383ae26d140fa872a01118671f19c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:16.570194 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-28e99dd5-33cf-43d1-b446-904011942a37 tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 200 len: 1218 microversion: 2.1 time: 0.091409 Sep 14 10:57:16.570790 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4537/6956] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:16 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:17.595721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:17.596341 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] [instance: cdcbf1ca-f264-47c1-8a8f-de88f40994bd] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:17.605426 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:17.606238 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:17.606849 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:17.607557 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:17.608057 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:17.608458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:17.627345 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] HTTP exception thrown: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Request method failure captured: Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd HTTP/1.1 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIbF3Ny_qPTtCkcBKpDvbks6_WteCJJiUfLEfPcElr2yrZcjRUAa7uQxRqH0EvfLCHwxttI002Fwimb1KJ2NDf3qEzcvD43uzfKLlAsJFoF24gELldsWVC_BC_nuTbwEP3flBsJy8EOdXyxWtovwa8U4bil0xNcyw1HjQjeeW-_76EpI Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: 6a7383ae26d140fa872a01118671f19c Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestShelveInstance-912913476 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_6a7383ae26d140fa872a01118671f19c", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6a7383ae26d140fa872a01118671f19c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/6a7383ae26d140fa872a01118671f19c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/6a7383ae26d140fa872a01118671f19c"}]}] Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestShelveInstance-912913476 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: 6a7383ae26d140fa872a01118671f19c Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestShelveInstance-912913476 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestShelveInstance-912913476-project Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 7a187e1d36c44cbe8af3e0070419b1d1 Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestShelveInstance-912913476-project Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': 'cdcbf1ca-f264-47c1-8a8f-de88f40994bd'} Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 10:57:17.629514 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. Sep 14 10:57:17.635044 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 10:57:17.636704 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Returning 404 to user: Instance cdcbf1ca-f264-47c1-8a8f-de88f40994bd could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 10:57:17.637594 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-668ad5be-e921-440c-8b14-05482909dabe tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd" status: 404 len: 111 microversion: 2.1 time: 0.046971 Sep 14 10:57:17.638181 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2420/6957] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:17 2022] GET /compute/v2.1/servers/cdcbf1ca-f264-47c1-8a8f-de88f40994bd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 10:57:17.817439 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-107ce077-de15-42a9-bf99-4e5dffd7d00d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] Calling method '.version_select at 0x7f693fa3d8b0>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:17.857275 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-107ce077-de15-42a9-bf99-4e5dffd7d00d tempest-TestShelveInstance-912913476 tempest-TestShelveInstance-912913476-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-658276614" status: 202 len: 0 microversion: 2.1 time: 0.043855 Sep 14 10:57:17.861492 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4538/6958] 10.222.0.90 () {58 vars in 1251 bytes} [Wed Sep 14 10:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-658276614 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 14 10:57:36.358030 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:36.360895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:36.556942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-a98ec7b4-b75a-4343-b8c6-50729ecc1ea0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Action: 'create', calling method: .version_select at 0x7f693f6ee160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1748463145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcN8YS9GfrNKyrAP+bxYfu5BLqRayO9hmGKY9L7AQ+0lHq0nI/czoWAIDupGEN4MSOykAGFOYQDSibT95Rep0ryjDztvtj+ED+ta6Ts7vPsz7JAmWTgz4sZviwjtyf+lg=="}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:36.580265 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a98ec7b4-b75a-4343-b8c6-50729ecc1ea0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for project f24c5277d8a5473cae0970384d87c2fd. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:57:36.587145 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.quota [None req-a98ec7b4-b75a-4343-b8c6-50729ecc1ea0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for user 6a91d1b3ec0e4a529f78c270523644d8 and project f24c5277d8a5473cae0970384d87c2fd. Resources: {'key_pairs'} {{(pid=122443) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:57:36.618358 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-a98ec7b4-b75a-4343-b8c6-50729ecc1ea0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.266020 Sep 14 10:57:36.624864 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2421/6959] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Sep 14 10:57:36 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:57:37.613524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=22 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:37.614359 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:37.618545 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-966942033", "imageRef": "cd58b78d-2815-4d3d-9878-b3c3c5fdce55", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1748463145", "security_groups": [{"name": "tempest-secgroup-smoke-595494734"}], "networks": [{"uuid": "119fc355-a278-48ad-b0ee-f869ae53a862"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:37.736211 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] validate_networks() for [('119fc355-a278-48ad-b0ee-f869ae53a862', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 10:57:38.152242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 10:57:38.152691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 10:57:38.153245 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 10:57:38.153616 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 10:57:38.154049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 10:57:38.163199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:38.163701 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:38.164187 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:38.164932 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:38.165597 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:38.166270 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:38.185939 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for project f24c5277d8a5473cae0970384d87c2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 10:57:38.192318 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for user 6a91d1b3ec0e4a529f78c270523644d8 and project f24c5277d8a5473cae0970384d87c2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 10:57:38.206127 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 10:57:38.208605 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd58b78d-2815-4d3d-9878-b3c3c5fdce55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 10:57:38.259204 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-b8f152f0-c986-47f8-b1e4-99c0f5a9cb93 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.647944 Sep 14 10:57:38.260252 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4539/6960] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 10:57:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 10:57:38.272854 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-37505146-1fca-49c8-9ae6-1962961ca2b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:38.273622 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-37505146-1fca-49c8-9ae6-1962961ca2b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:38.370237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-37505146-1fca-49c8-9ae6-1962961ca2b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:38.377483 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-37505146-1fca-49c8-9ae6-1962961ca2b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1248 microversion: 2.1 time: 0.110174 Sep 14 10:57:38.378922 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2422/6961] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:38 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1248 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:39.402649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:39.403286 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:39.412572 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:39.413347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:39.413961 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:39.414897 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:39.415547 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:39.416199 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:39.517694 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:39.528748 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-da91012a-b16e-4bd7-a8fb-687cb2ab3760 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1300 microversion: 2.1 time: 0.129916 Sep 14 10:57:39.546319 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4540/6962] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:39 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1300 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:40.553718 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:40.554310 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:40.561781 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:40.562272 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:40.562702 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:40.563397 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:40.563845 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:40.564331 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:40.780498 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:40.792305 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-aef51ba8-e0cc-46b4-9bc6-e91f1204fd01 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.242525 Sep 14 10:57:40.792910 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2423/6963] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:40 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:41.424189 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:41.436402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:41.437003 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:41.437452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:41.450503 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] Creating event network-changed:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 10:57:41.456960 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-c7d33f18-3bf3-4920-af40-5be28a064f40 req-a8718e08-c496-483b-a6c3-510c473e4b0a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035959 Sep 14 10:57:41.458115 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4541/6964] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:57:41.816741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:41.817353 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:41.824735 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:41.825225 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:41.825669 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:41.826367 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:41.826893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:41.827326 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:41.980544 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:41.989082 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-85ba8825-6a68-42f3-8adf-eab2dd7e6437 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.176257 Sep 14 10:57:41.989670 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2424/6965] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:41 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:43.013149 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:43.013780 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:43.020859 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:43.021362 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:43.021816 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:43.022534 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:43.023018 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:43.023466 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:43.166670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:43.175876 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-2ab6d73c-3e82-4ee2-813c-d355b000092e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.167937 Sep 14 10:57:43.176632 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4542/6966] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:43 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 10:57:44.198986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:44.199605 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:44.206307 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:44.207093 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:44.207596 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:44.208330 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:44.208787 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:44.209208 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:44.459387 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:44.467064 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-4e986f6f-bf67-418d-88d2-8578cb507140 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.272182 Sep 14 10:57:44.467646 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2425/6967] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:44 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:45.492070 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:45.492715 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:45.499518 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:45.500056 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:45.500513 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:45.501227 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:45.501696 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:45.502140 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:45.644999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:45.652813 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-c4a90fd3-1d58-43c8-94b5-a191fa6883d5 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.166423 Sep 14 10:57:45.653488 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4543/6968] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:45 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:46.416451 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "name": "network-vif-plugged", "status": "completed", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:46.426703 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:46.427180 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:46.427613 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:46.439248 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] Creating event network-vif-plugged:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 10:57:46.445263 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-d84566ff-f9c1-42f3-9fbb-8e7260df1028 req-62228657-03b6-4492-8ed2-7f93491b3c22 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092763 Sep 14 10:57:46.445874 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2426/6969] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:57:46.675824 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:46.676382 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:46.683352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:46.683846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:46.684322 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:46.685038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:46.685485 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:46.685925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:46.820802 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:46.828690 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5c566880-3a5f-4cd3-8a33-bb8f6f961f18 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1373 microversion: 2.1 time: 0.157047 Sep 14 10:57:46.829275 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4544/6970] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:46 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:47.855961 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:47.856689 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:47.864228 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:47.864720 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:47.865157 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:47.865852 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:47.866304 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:47.866730 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:48.008565 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:48.016510 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-b2713ffa-5bf6-42fe-aa60-5025c7bde44d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1557 microversion: 2.1 time: 0.165974 Sep 14 10:57:48.017094 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2427/6971] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:47 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:48.039964 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 10:57:48.040596 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:57:48.047539 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:48.048092 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:48.048542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:48.049242 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:48.049707 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:48.050285 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:48.172680 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:48.188452 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 10:57:48.196828 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-88ffaffd-b369-485a-8a29-63a99d07019f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1557 microversion: 2.1 time: 0.160923 Sep 14 10:57:48.197411 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4545/6972] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 10:57:48 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 10:57:49.859810 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=6 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:57:49.917691 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:57:49.928463 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:57:49.929055 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:57:49.929568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:57:49.942004 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] Creating event network-changed:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 10:57:49.947231 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-523a03b0-1c1a-40c4-bd89-1ea1ca1110e6 req-04e0c0da-ac56-4587-af32-2d0cb8f37e89 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092097 Sep 14 10:57:49.948023 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2428/6973] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 10:59:47.189243 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:59:47.190432 n-d-851028-12 devstack@n-api.service[122444]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] AMQP server on 10.222.0.90:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 14 10:59:47.190798 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:59:47.191673 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:59:47.192420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=34 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:59:47.198171 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1958368808"}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:59:47.200697 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 10:59:47.209440 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:59:47.209935 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:59:47.210393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:59:47.211111 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:59:47.211584 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:59:47.212061 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:59:47.415460 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-d2599141-aac1-4eab-a047-623747649442 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "POST /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490/action" status: 202 len: 0 microversion: 2.1 time: 0.228420 Sep 14 10:59:47.416173 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4546/6974] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 10:59:47 2022] POST /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 10:59:52.940080 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:59:52.941536 n-d-851028-12 devstack@n-api.service[122443]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] AMQP server on 10.222.0.90:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 14 10:59:52.942892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:59:52.944022 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=28 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 10:59:52.945324 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 10:59:52.945739 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 10:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 10:59:52.955485 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "name": "network-vif-plugged", "status": "completed", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 10:59:52.972357 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 10:59:52.974250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 10:59:52.974869 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 10:59:52.994236 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] Creating event network-vif-plugged:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 10:59:53.001063 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-9bde3194-84fa-4f68-a939-15045146512b req-72271446-5204-4fa5-b043-74945b9eb2b0 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063916 Sep 14 10:59:53.003033 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2429/6975] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 10:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:00:00.986406 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:00.987247 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:00.992883 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1860633192", "imageRef": "8d7903d2-14ee-45b3-ace0-38252b259cd1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1748463145", "security_groups": [{"name": "tempest-secgroup-smoke-595494734"}], "networks": [{"uuid": "119fc355-a278-48ad-b0ee-f869ae53a862"}]}} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:00:01.021382 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [d0591342-cc43-4aa2-ba78-36b1e58aa3f0] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 57316. Sep 14 11:00:01.023677 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] [b37ce39c-5ea3-4bd3-929f-d451478d0403] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 57314. Sep 14 11:00:01.110525 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.network.neutron [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] validate_networks() for [('119fc355-a278-48ad-b0ee-f869ae53a862', None, None, None, None, None)] {{(pid=122444) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 14 11:00:01.549053 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Flavor limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 14 11:00:01.549436 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Image limits 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 14 11:00:01.549925 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Flavor pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 14 11:00:01.550352 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Image pref 0:0:0 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 14 11:00:01.550781 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.virt.hardware [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 14 11:00:01.559740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:01.560267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:01.560721 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:01.561661 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:01.562348 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:01.562797 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:01.580222 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for project f24c5277d8a5473cae0970384d87c2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 14 11:00:01.585506 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.quota [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Getting quotas for user 6a91d1b3ec0e4a529f78c270523644d8 and project f24c5277d8a5473cae0970384d87c2fd. Resources: {'cores', 'ram', 'instances'} {{(pid=122444) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 14 11:00:01.599465 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Going to run 1 instances... {{(pid=122444) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 14 11:00:01.602022 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d7903d2-14ee-45b3-ace0-38252b259cd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 14 11:00:01.649978 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-4dc210ba-728d-4c0f-8c30-6962b9e513b9 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.666939 Sep 14 11:00:01.650660 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4547/6976] 10.222.0.90 () {60 vars in 1147 bytes} [Wed Sep 14 11:00:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 14 11:00:01.663688 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-e28f8171-8689-4017-9b3c-de18e87e00ab tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:01.664422 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-e28f8171-8689-4017-9b3c-de18e87e00ab tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:01.692591 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [7770fe3b-9ec3-44ae-b34c-3f19d9813bd2] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 57334. Sep 14 11:00:01.693353 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff58dfb9-1e82-458a-aff5-8a8d31d835c5] Reconnected to AMQP server on 10.222.0.90:5672 via [amqp] client with port 57332. Sep 14 11:00:01.727186 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-e28f8171-8689-4017-9b3c-de18e87e00ab tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:01.739591 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-e28f8171-8689-4017-9b3c-de18e87e00ab tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1249 microversion: 2.1 time: 0.080898 Sep 14 11:00:01.740219 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2430/6977] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:01 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:02.762515 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:02.763418 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:02.772305 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:02.772851 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:02.773335 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:02.774147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:02.774960 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:02.775699 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:02.895049 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:02.903731 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-de9b9024-9f19-40f4-906b-9b39e17d995f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1309 microversion: 2.1 time: 0.145216 Sep 14 11:00:02.904390 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4548/6978] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:02 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:03.926501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:03.931013 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:03.931637 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:03.939143 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:03.939937 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:03.940555 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:03.941444 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:03.942078 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:03.942670 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:04.120614 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:04.129839 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6a54b45d-c7a7-4b35-a6ca-8aa0b29acf3f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.205018 Sep 14 11:00:04.135481 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2431/6979] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:03 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:04.989655 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "name": "network-vif-unplugged", "status": "completed", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:00:05.005631 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:05.006156 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:05.006944 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:05.027190 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] Creating event network-vif-unplugged:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 11:00:05.035348 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0f461092-dec7-441b-a4d7-b8b2937d4308 req-c7b3e9a7-aa32-40f7-84e9-6886fd6b7a17 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051144 Sep 14 11:00:05.036716 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4549/6980] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:00:05.155197 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:05.155944 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:05.163214 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:05.163712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:05.164183 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:05.164895 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:05.165545 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:05.165976 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:05.315176 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:05.323612 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fb00a526-5a8d-47e6-b49c-958ee241e04a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.172739 Sep 14 11:00:05.324244 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2432/6981] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:05 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:06.349420 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:06.350476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:06.358793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:06.359744 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:06.360565 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:06.361923 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:06.362652 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:06.363486 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:06.515949 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:06.524377 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-5519d070-ebf1-4b2c-b88b-7d1cd1a516f2 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.179992 Sep 14 11:00:06.525088 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4550/6982] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:06 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:07.548802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:07.549409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:07.556609 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:07.557128 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:07.557654 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:07.558348 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:07.558799 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:07.559221 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:07.703676 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:07.713588 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-25a6b842-dc2d-4fad-bbb5-08d7ee4edb97 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.168838 Sep 14 11:00:07.728150 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2433/6983] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:07 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:08.740665 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:08.741347 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:08.749234 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:08.749852 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:08.750360 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:08.751263 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:08.751765 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:08.752304 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:08.894229 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:08.902126 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a1d155f7-f605-4a2b-9367-1884f15e7e90 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.166405 Sep 14 11:00:08.902967 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4551/6984] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:08 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:00:09.926442 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:09.927073 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:09.934465 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:09.935114 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:09.935564 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:09.937039 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:09.937510 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:09.937994 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:10.103392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:10.116322 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-782c7222-87a3-4649-8e2f-ed2988347b46 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.194012 Sep 14 11:00:10.117623 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2434/6985] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:09 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:11.145670 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:11.147553 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:11.155532 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:11.156123 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:11.156649 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:11.157635 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:11.158147 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:11.158604 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:11.314561 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:11.323921 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-a7e64388-7077-4e1c-8228-573108332ce0 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.184722 Sep 14 11:00:11.324530 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4552/6986] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:11 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:12.349029 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:12.349612 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:12.352292 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell0:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:12.357587 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:12.358778 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:12.359505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:12.360237 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:12.360695 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:12.361125 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:12.513164 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:12.522169 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-6ea1cbba-210c-4c93-ac84-9c1d9056682f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.177118 Sep 14 11:00:12.522872 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2435/6987] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:12 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:13.466079 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=2 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:13.467073 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell0:SELECT=6 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:00:13.474213 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:00:13.486791 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:13.487291 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:13.487740 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:13.500767 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] Creating event network-changed:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:00:13.505548 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-0931b3ed-ff17-4d72-b30b-3b96ae8f382c req-24be9f66-188e-43e0-9935-a84c238e194f service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040097 Sep 14 11:00:13.506185 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4553/6988] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 11:00:13.545086 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:13.546856 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:13.553872 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:13.554363 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:13.554802 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:13.555501 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:13.555983 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:13.556409 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:13.693877 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:13.702364 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-65c6bec4-a6c1-4a97-8fc3-f52c4b4861fd tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.160578 Sep 14 11:00:13.703248 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2436/6989] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:13 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:14.727756 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:14.728636 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:14.736716 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:14.737220 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:14.737674 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:14.738395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:14.738993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:14.739441 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:14.956691 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:14.964598 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-43bf7ed4-f260-46e4-aadb-68d413c375a3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.241168 Sep 14 11:00:14.965194 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4554/6990] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:14 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:15.989024 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:15.989887 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:15.999774 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:16.000335 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:16.000773 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:16.001671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:16.002126 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:16.002541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:16.142777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:16.150561 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-0320a077-d0ec-4398-81aa-dfdc3a7243a6 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.165606 Sep 14 11:00:16.151178 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2437/6991] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:15 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:00:17.175619 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:17.176354 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:17.183500 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:17.185002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:17.185002 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:17.186099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:17.186099 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:17.186493 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:17.334702 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:17.343471 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-781b5a85-f458-4d86-b452-5422e346105c tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.173186 Sep 14 11:00:17.344121 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4555/6992] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:17 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:18.367337 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:18.367973 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:18.374892 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:18.375366 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:18.375798 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:18.376509 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:18.376957 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:18.377379 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:18.507986 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:18.516114 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-75ecc917-0f13-4707-a214-e19a7cb8311f tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.152864 Sep 14 11:00:18.516700 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2438/6993] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:18 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:19.333267 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "name": "network-vif-plugged", "status": "completed", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:00:19.344240 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:19.344943 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:19.345737 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:19.361444 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] Creating event network-vif-plugged:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:00:19.367163 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-830d3c87-7e4c-401e-b032-49bb41f262a6 req-1ecdd570-2a8e-4447-a923-91d2d5afff59 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038803 Sep 14 11:00:19.367786 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4556/6994] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:00:19.539538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:19.540763 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:19.552244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:19.552741 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:19.553187 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:19.553925 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:19.554445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:19.554870 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:19.709254 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:19.718145 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-33ef5d88-7f3b-44c2-8a18-55ad26c040db tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1374 microversion: 2.1 time: 0.182834 Sep 14 11:00:19.718747 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2439/6995] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:19 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:20.745981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:20.746700 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:20.753894 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:20.754393 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:20.754846 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:20.755558 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:20.756064 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:20.756507 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:20.897476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:20.905604 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-09207ad0-e08a-41d9-a435-57b7dc38c71e tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1558 microversion: 2.1 time: 0.164567 Sep 14 11:00:20.906190 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4557/6996] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:20 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:20.927593 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:00:20.928250 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:00:20.935037 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:20.935520 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:20.936549 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:20.937541 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:20.938002 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:20.938431 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:21.070436 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:00:21.079007 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-bfd357a9-0089-46f2-94fa-ae959119e57d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1558 microversion: 2.1 time: 0.155225 Sep 14 11:00:21.079584 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2440/6997] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:00:20 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:00:22.994793 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:00:23.006391 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:00:23.006979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:00:23.007502 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:00:23.019627 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] Creating event network-changed:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:00:23.025415 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-abf42024-403d-441c-bbf5-92e3fc95d5d1 req-0993863d-907c-459d-9e70-a5c5fdaf18ea service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 Sep 14 11:00:23.026034 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4558/6998] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:01:50.141458 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=26 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:01:50.142218 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=60 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:01:50.143588 n-d-851028-12 devstack@n-api.service[122443]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 11:01:50.143817 n-d-851028-12 devstack@n-api.service[122443]: Wed Sep 14 11:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140/action (ip 10.222.0.90) !!! Sep 14 11:01:50.151021 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-621737000"}} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:01:50.153294 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:01:50.163217 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:01:50.164487 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:01:50.164942 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:01:50.165658 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:01:50.166123 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:01:50.166558 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:01:50.371732 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-fbc80510-6ff6-4d44-bb7c-dfbfec4f5253 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "POST /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140/action" status: 202 len: 0 microversion: 2.1 time: 0.232207 Sep 14 11:01:50.372454 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2441/6999] 10.222.0.90 () {60 vars in 1278 bytes} [Wed Sep 14 11:01:50 2022] POST /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 14 11:01:55.945632 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:01:55.947190 n-d-851028-12 devstack@n-api.service[122444]: DEBUG dbcounter [-] [122444] Writing DB stats nova_cell1:SELECT=52 {{(pid=122444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:01:55.948763 n-d-851028-12 devstack@n-api.service[122444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 14 11:01:55.949244 n-d-851028-12 devstack@n-api.service[122444]: Wed Sep 14 11:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.90) !!! Sep 14 11:01:55.960916 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "name": "network-vif-plugged", "status": "completed", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:01:55.978931 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:01:55.979845 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:01:55.980643 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:01:55.996262 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] Creating event network-vif-plugged:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:01:56.014155 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-83576544-1d97-4b90-87c3-c8c6c27ef23a req-3bae0b57-d42a-4cc9-9c68-45c866e42b6a service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061065 Sep 14 11:01:56.016349 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4559/7000] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:02:05.051824 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_api:SELECT=2 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:02:05.054494 n-d-851028-12 devstack@n-api.service[122443]: DEBUG dbcounter [-] [122443] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 11:02:05.059027 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:02:05.062202 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:05.063765 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:05.069555 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.070435 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.071063 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.072131 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.072723 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.073408 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.074211 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.074766 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.075291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.087628 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.compute.server_external_events [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] Creating event network-changed:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:02:05.095458 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [req-15d8e26e-d7cb-4677-b845-aee41c584ae0 req-52153229-1ca1-4d70-8bb4-374e4017154c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043845 Sep 14 11:02:05.097627 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4560/7001] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:02:05.117760 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Going to try to terminate instance {{(pid=122443) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 11:02:05.213206 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-cdff6bc1-8f4e-4859-a0bf-e3cc6325879d tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "DELETE /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 204 len: 0 microversion: 2.1 time: 0.164669 Sep 14 11:02:05.213863 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2442/7002] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 11:02:05 2022] DELETE /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 14 11:02:05.225059 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:05.225979 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:05.232819 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.233433 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.233981 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.235037 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.235887 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.237569 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.457929 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:05.466630 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-19dbefb7-846d-4f20-99ff-9af1057ee707 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1683 microversion: 2.1 time: 0.247185 Sep 14 11:02:05.467229 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4561/7003] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:05 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 14 11:02:05.944721 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "name": "network-vif-unplugged", "status": "completed", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:02:05.954383 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:05.955354 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:05.955861 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:05.968294 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] Creating event network-vif-unplugged:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:02:05.974392 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7f63ecc6-b9d0-4bde-bf8f-fdbf8b400479 req-0b970dc6-755b-4fdd-9730-5ae23db30f98 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033703 Sep 14 11:02:05.975099 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2443/7004] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 14 11:02:06.491202 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:06.492271 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:06.499206 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:06.499858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:06.500181 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:06.500900 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:06.501369 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:06.502343 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:06.654081 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:06.662359 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0402ec70-4576-4090-aecf-3495a24447d3 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1683 microversion: 2.1 time: 0.175622 Sep 14 11:02:06.662951 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4562/7005] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:06 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:02:07.216712 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0fcb3a-92ea-4818-816b-4a63eaf60140", "name": "network-vif-deleted", "tag": "fcb4133b-68fd-4a43-8c9e-2298ebae517c"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:02:07.227138 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:07.227762 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:07.228244 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:07.240369 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] Creating event network-vif-deleted:fcb4133b-68fd-4a43-8c9e-2298ebae517c for instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 on n-h1-851028-12 Sep 14 11:02:07.245361 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-49f42280-c24b-4952-8920-e6002c52590f req-b2ab2c9e-ff39-42b7-b2b7-2c42f5b098e3 service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034037 Sep 14 11:02:07.245968 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2444/7006] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:02:07.686858 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:07.687498 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:07.696319 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:07.696829 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:07.697292 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:07.698014 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:07.698491 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:07.698941 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:07.745225 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:07.745735 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:07.746192 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:07.746660 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lazy-loading 'fault' on Instance uuid 3f0fcb3a-92ea-4818-816b-4a63eaf60140 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 11:02:07.790570 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:07.798064 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-7cf152d6-3b3e-4ee4-b2d0-8f7619e68e0b tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 200 len: 1339 microversion: 2.1 time: 0.115733 Sep 14 11:02:07.798723 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4563/7007] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:07 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:02:08.823196 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:08.823910 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 3f0fcb3a-92ea-4818-816b-4a63eaf60140] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:08.830939 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:08.831540 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:08.832075 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:08.832769 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:08.833231 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:08.833685 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:08.847104 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] HTTP exception thrown: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Request method failure captured: Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 HTTP/1.1 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIbOaKuGJ_nSDC5O9PaxjmQl2-UiRX0QusFHYZdTFux2yK68dW8Xn26BmJBx416bN5JnjYF9sZKhHlMuq5Iazd3nvmohR13Jeuai548x5dKynqzvOrO607OmLzRiQqJTVXUiuM7I2N3pHPqgaGMtmTDCCjUCshUmnRYwv6_hoUT6r_V8 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: f24c5277d8a5473cae0970384d87c2fd Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f24c5277d8a5473cae0970384d87c2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f24c5277d8a5473cae0970384d87c2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f24c5277d8a5473cae0970384d87c2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f24c5277d8a5473cae0970384d87c2fd"}]}] Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: f24c5277d8a5473cae0970384d87c2fd Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestSnapshotPattern-209235073-project Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6a91d1b3ec0e4a529f78c270523644d8 Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestSnapshotPattern-209235073-project Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '3f0fcb3a-92ea-4818-816b-4a63eaf60140'} Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:02:08.848751 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Returning 404 to user: Instance 3f0fcb3a-92ea-4818-816b-4a63eaf60140 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-40797048-991f-4953-9900-15529d0bd62a tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140" status: 404 len: 111 microversion: 2.1 time: 0.032060 Sep 14 11:02:08.854643 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2445/7008] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:08 2022] GET /compute/v2.1/servers/3f0fcb3a-92ea-4818-816b-4a63eaf60140 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 11:02:10.499476 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:10.500132 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:10.501889 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:02:10.507906 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:10.508524 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:10.509038 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:10.509993 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:10.510542 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:10.511055 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:10.513050 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:10.513535 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:10.513965 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:10.526278 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] Creating event network-changed:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 11:02:10.531417 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-2e576d89-4a36-449e-be87-3027476bdcc4 req-dc8e067f-2a78-4ad7-9797-fa7dd16102ca service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033482 Sep 14 11:02:10.532090 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2446/7009] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:02:10.545000 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Going to try to terminate instance {{(pid=122444) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 14 11:02:10.633551 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-101bd08f-0941-46a0-be7d-3b20fc2da661 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "DELETE /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 204 len: 0 microversion: 2.1 time: 0.137542 Sep 14 11:02:10.637873 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4564/7010] 10.222.0.90 () {58 vars in 1239 bytes} [Wed Sep 14 11:02:10 2022] DELETE /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 14 11:02:10.645568 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:10.646538 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:10.653445 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:10.654139 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:10.654777 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:10.655648 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:10.656907 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:10.657567 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:10.806291 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.policy [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122443) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:10.814125 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-499a264d-4938-40b4-aa09-11aa7719e0c8 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1682 microversion: 2.1 time: 0.174033 Sep 14 11:02:10.815370 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2447/7011] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:10 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:02:11.840121 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:11.840772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:11.848451 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:11.848950 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:11.849402 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:11.850113 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:11.850585 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:11.851025 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:11.990892 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:11.999089 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-8a33ba05-a7a0-4a88-84c6-5eb4fcad5123 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1682 microversion: 2.1 time: 0.163475 Sep 14 11:02:11.999649 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4565/7012] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:11 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:02:12.823629 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "606afa45-528d-45f0-8095-44c3b7b8f490", "name": "network-vif-deleted", "tag": "a0a18e14-164a-4007-b0a1-8e0358ba5534"}]} {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 14 11:02:12.833893 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:12.834392 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:12.834850 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:12.846437 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.compute.server_external_events [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] Creating event network-vif-deleted:a0a18e14-164a-4007-b0a1-8e0358ba5534 for instance 606afa45-528d-45f0-8095-44c3b7b8f490 on n-h2-851028-12 Sep 14 11:02:12.851128 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [req-7a793018-cc17-4c71-9efe-c706a652764d req-852e9d6f-3cc7-40c7-b519-5756af9c574c service nova] 10.222.0.90 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090183 Sep 14 11:02:12.851751 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2448/7013] 10.222.0.90 () {64 vars in 1317 bytes} [Wed Sep 14 11:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 14 11:02:13.022342 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:13.022969 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.compute.api [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122444) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:13.029999 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:13.030772 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:13.031224 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:13.031967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:13.032444 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:13.033403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:13.067395 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:13.067954 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:13.068403 n-d-851028-12 devstack@n-api.service[122444]: DEBUG oslo_concurrency.lockutils [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:13.068862 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.objects.instance [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lazy-loading 'fault' on Instance uuid 606afa45-528d-45f0-8095-44c3b7b8f490 {{(pid=122444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 14 11:02:13.110967 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.policy [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a91d1b3ec0e4a529f78c270523644d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24c5277d8a5473cae0970384d87c2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122444) authorize /opt/stack/nova/nova/policy.py:199}} Sep 14 11:02:13.120687 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-41a380a9-a085-40a6-94d6-e43ece3146d7 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 200 len: 1338 microversion: 2.1 time: 0.102171 Sep 14 11:02:13.121311 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4566/7014] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:13 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 14 11:02:14.146003 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '>' {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:14.146742 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.compute.api [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] [instance: 606afa45-528d-45f0-8095-44c3b7b8f490] Fetching instance by UUID {{(pid=122443) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 14 11:02:14.153059 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:14.153543 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:14.153981 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:14.154671 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Acquiring lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 14 11:02:14.155124 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 14 11:02:14.155554 n-d-851028-12 devstack@n-api.service[122443]: DEBUG oslo_concurrency.lockutils [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Lock "9dda0999-63fa-48b3-a8b7-dc8019427d51" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 14 11:02:14.169247 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.wsgi [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] HTTP exception thrown: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Request method failure captured: Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: request: GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 HTTP/1.1 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Accept: application/json Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Accept-Encoding: identity Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Connection: close Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Content-Length: 0 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Content-Type: application/json Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Host: 10.222.0.90 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: Openstack-System-Scope: None Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: User-Agent: python-urllib3/1.26.12 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Auth-Token: gAAAAABjIbOaKuGJ_nSDC5O9PaxjmQl2-UiRX0QusFHYZdTFux2yK68dW8Xn26BmJBx416bN5JnjYF9sZKhHlMuq5Iazd3nvmohR13Jeuai548x5dKynqzvOrO607OmLzRiQqJTVXUiuM7I2N3pHPqgaGMtmTDCCjUCshUmnRYwv6_hoUT6r_V8 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Id: None Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Domain-Name: None Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Identity-Status: Confirmed Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Is-Admin-Project: True Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Id: default Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Domain-Name: Default Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Id: f24c5277d8a5473cae0970384d87c2fd Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Project-Name: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Role: member,reader Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Roles: member,reader Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:8080/v1/AUTH_f24c5277d8a5473cae0970384d87c2fd", "adminURL": "http://10.222.0.90:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f24c5277d8a5473cae0970384d87c2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/volume/v3/f24c5277d8a5473cae0970384d87c2fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.90/compute/v2/f24c5277d8a5473cae0970384d87c2fd"}]}] Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Id: f24c5277d8a5473cae0970384d87c2fd Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-Tenant-Name: tempest-TestSnapshotPattern-209235073 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-User: tempest-TestSnapshotPattern-209235073-project Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Id: default Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-User-Domain-Name: Default Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-User-Id: 6a91d1b3ec0e4a529f78c270523644d8 Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: X-User-Name: tempest-TestSnapshotPattern-209235073-project Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: method: > Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: exception: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: action_args: {'id': '606afa45-528d-45f0-8095-44c3b7b8f490'} Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: {{(pid=122443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 14 11:02:14.170847 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: ERROR nova.api.openstack.wsgi Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: DEBUG nova.api.openstack.wsgi [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Returning 404 to user: Instance 606afa45-528d-45f0-8095-44c3b7b8f490 could not be found. {{(pid=122443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: INFO nova.api.openstack.requestlog [None req-31a1c4a8-4bb5-4de0-b749-158f96e5df53 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490" status: 404 len: 111 microversion: 2.1 time: 0.031410 Sep 14 11:02:14.176505 n-d-851028-12 devstack@n-api.service[122443]: [pid: 122443|app: 0|req: 2449/7015] 10.222.0.90 () {58 vars in 1236 bytes} [Wed Sep 14 11:02:14 2022] GET /compute/v2.1/servers/606afa45-528d-45f0-8095-44c3b7b8f490 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 14 11:02:14.337688 n-d-851028-12 devstack@n-api.service[122444]: DEBUG nova.api.openstack.wsgi [None req-0b739522-d07d-4479-9bd3-ff86fbd2ed29 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] Calling method '.version_select at 0x7f693fa29f70>' {{(pid=122444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 14 11:02:14.363564 n-d-851028-12 devstack@n-api.service[122444]: INFO nova.api.openstack.requestlog [None req-0b739522-d07d-4479-9bd3-ff86fbd2ed29 tempest-TestSnapshotPattern-209235073 tempest-TestSnapshotPattern-209235073-project] 10.222.0.90 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1748463145" status: 202 len: 0 microversion: 2.1 time: 0.029953 Sep 14 11:02:14.364620 n-d-851028-12 devstack@n-api.service[122444]: [pid: 122444|app: 0|req: 4567/7016] 10.222.0.90 () {58 vars in 1257 bytes} [Wed Sep 14 11:02:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1748463145 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)